StarCluster - Mailing List Archive

Re: note for usage

From: Igor Tatarinov <no email>
Date: Tue, 7 Dec 2010 10:24:31 -0800

Boris,

What kind of write throughput are you able to get? I would expect the
network bandwidth at the NFS server node to be the bottleneck rather than
the CPUs on that box.

An obvious question: are you compressing the data before you write it to
NFS?

Thanks,
igor

On Mon, Dec 6, 2010 at 4:36 PM, Boris Fain <boris_at_freecurve.com> wrote:

> This may be useful to everyone. When launching a cluster on Amazon, if you
> have a lot of processes writing to a shared EBS volume
> NFS does become a bottleneck. Everyone's output is different, so everyone
> will have to figure out their own limits. In our case we had to
> limit the head node compute load to 2/8 - it simply could not handle more.
> We have 12 8-core (xlarge high-cpu) instances, and there's quite
> a bit of writing from each MPI thread.
>
> --
>
> b.
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
Received on Tue Dec 07 2010 - 13:24:34 EST
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject