Re: how long will it take to initialize 3000 nodes

From: Rayson Ho <no email>
Date: Tue, 4 Jun 2013 16:29:12 -0400

The "right" way is to first boot a cluster of say, 8-10 nodes, submit
jobs, and then use the StarCluster addnode command to grow your
cluster.

http://star.mit.edu/cluster/docs/0.93.3/manual/addremovenode.html

Also, note that NFS will likely be the bottleneck of the cluster when
you have 3000 nodes!!

Last year, we created the world's first 10,000-node cluster (yes,
nodes, not cores like previous attempts) with StarCluster and some of
our own hacks. It is possible to create extremely large clusters in
EC2, but not booting all at once.

http://blogs.scalablelogic.com/2012/11/running-10000-node-grid-engine-cluster.html

Rayson

==================================================
Open Grid Scheduler - The Official Open Source Grid Engine
http://gridscheduler.sourceforge.net/


On Mon, Jun 3, 2013 at 4:39 PM, Jin Yu <yujin2004_at_gmail.com> wrote:
> Hi,
>
> I am planning to use STAR for a big data analysis, which will submit 3000
> jobs to different nodes in parallel and each job will take 1-2 hours to
> finish.
>
> When I watched the tutorial video, I found it took about 5 mins to
> initialize a 8 nodes cluster. So I am wondering how much time will need to
> initialize a cluster of ~3000 nodes in order to estimate the cost more
> precisely.
>
> Thanks,
> Jin
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
Received on Tue Jun 04 2013 - 16:29:14 EDT