Re: Starcluster SGE usage

From: Jesse Lu <no email>
Date: Tue, 16 Oct 2012 14:12:04 -0700

You can modify the all.q queue to assign a fixed number of slots to each
node.

   - If I remember correctly, "$ qconf -mq all.q" will bring up the
   configuration of the all.q queue in an editor.
   - Under the "slots" attribute should be a semilengthly string such as
   "[node001=16],[node002=16],..."
   - Try replacing the entire string with a single number such as "2". This
   should assign each host to have only two slots.
   - Save the configuration and try a simple submission with the 'orte'
   parallel environment and let me know if it works.

Jesse

On Tue, Oct 16, 2012 at 1:37 PM, John St. John
<johnthesaintjohn_at_gmail.com>wrote:

> Hello,
> I am having issues telling qsub to limit the number of jobs ran at any one
> time on each node of the cluster. There are sometimes ways to do this with
> things like "qsub -l node=1:ppn=1" or "qsub -l procs=2" or something. I
> even tried "qsub -l slots=2" but that gave me an error and told me to use
> the parallel environment. When I tried to use the "orte" parallel
> environment like "-pe orte 2" I see "slots=2" in my qstat list, but
> everything gets executed on one node at the same parallelization as before.
> How do I limit the number of jobs per node? I am running a process that
> consumes a very large amount of ram.
>
> Thanks,
> John
>
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
Received on Tue Oct 16 2012 - 17:12:05 EDT