Re: remotely run jobs on starcluster

From: Mark Gordon <no email>
Date: Fri, 14 Oct 2011 09:03:48 -0600

Hi Liang:

At ceswp.ca we wrote a Python program called LaunchServer. Our webapp (the
equivalent of your EC2 instance 'A') posts a request to LaunchSever
specifying the AMI ID, the machine type, number of nodes, etc, and
LaunchServer uses StarCluster to create the cluster (and to run a scientific
model on the cluster). It would be straight forward (I believe!) to add the
ability you describe (submit a job to SGE on an existing cluster).

Email me if you would like a copy of LaunchServer.

cheers,
Mark

On Fri, Oct 14, 2011 at 1:37 AM, liang cheng <liang.cheng_at_gmail.com> wrote:

> Hi,
>
> I have a http server running on Linux, I would like to run some
> scripts on that server which actually submits jobs to a known
> starcluster. That is, how can I run a job from a machine that is
> outside my cluster.
>
> For example:
>
> I have an EC2 instance named A.
> I have a EC2 based starcluster which is composed of two nodes: B
> (master) and C.(slave)
>
> Currently I run my jobs in this way:
>
> log in to A.
> run "starcluster sshmaster mycluster"
> At the master node (B), I run "qsub sh myjob.sh"
>
> Now I would like to simplify it to:
> log in to A
> run "sh myremotejob.sh"
>
> "myremotejob.sh" should include 1) login to B and 2) run jobs at B and C.
>
> Can someone help me ?
>
> Thanks,
> -Liang
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>

-- 
Mark Gordon
Systems Analyst
Department of Physics
University of Alberta
This communication is intended for the use of the recipient to which it is
addressed and may contain confidential, personal and/or privileged
information. Please contact us immediately if you are not the intended
recipient of this communication. If you are not the intended recipient of
this communication do not copy, distribute or take action on it. Any
communication received in error, or subsequent reply, should be deleted or
destroyed.

Received on Fri Oct 14 2011 - 11:03:49 EDT