StarCluster - Mailing List Archive

Re: sge submit host question

From: Rayson Ho <no email>
Date: Fri, 24 Feb 2012 20:56:48 -0800 (PST)


I spent some time on this this evening, and basically if you follow the steps I
listed, PLUS if you set up the security group to allow traffic to port 63231
(should be very easy if you use the Management Console), then you can have your
local machine submitting jobs to the cluster on EC2.

*However*, I recommend against this, because SGE traffic is not encrypted.

So, the best way is to use the sshmaster command to remotely execute qsub.

You might find that it is not as convenient, as for example you will need to
setup environment variables, etc on the EC2 machines. (I also did try SSH port
forwarding but the SGE protocol will simply block the connection as the qmaster
finds it weird that the source IP comes from the host on EC2, while qsub claims
that it is from your local machine.)

If you have a use case that would strongly benefit from SSH port forwarding,
please let me know.


Open Grid Scheduler / Grid Engine

Scalable Grid Engine Support Program

----- Original Message -----
From: Justin Riley <>
To: David Erickson <>
Cc: Robert Yu <>; starcluster <>
Sent: Friday, February 24, 2012 4:36 PM
Subject: Re: [StarCluster] sge submit host question

Hash: SHA1

Yes the environment issue is related to the fact that SSH does not
source /etc/profile by default. For the time being you can get around
this using:

$ starcluster sshmaster mycluster 'source /etc/profile; <command>'

Sourcing /etc/profile should probably be done by default when running
commands using sshmaster/sshnode. I created an issue to keep track of



On 02/24/2012 03:38 PM, David Erickson wrote:
> On 2/24/2012 12:07 PM, Robert Yu wrote:
>> Hi,
>> This is more of a best-practice question.
>> Let's say I am on machine A.  From it, I create a cluster.  I can
>> then ssh into the "master" and launch jobs.  Can this also be
>> done from machine A directly?  I know one can do "starcluster
>> sshmaster -u sgeadmin<clustername>  'some command'" but then I
>> typically run into environment issues.  Is there (simple) a way
>> to make machine A an sge submit host?
> I ran into this too and found out I had to source
> /etc/profile.d/  I also am curious if there is a better
> solution, presumably this is an interactive vs noninteractive shell
> issue.
> -D _______________________________________________ StarCluster
> mailing list

Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla -

StarCluster mailing list
Received on Fri Feb 24 2012 - 23:56:50 EST
This archive was generated by hypermail 2.3.0.


Sort all by: