Boris,
What kind of write throughput are you able to get? I would expect the
network bandwidth at the NFS server node to be the bottleneck rather than
the CPUs on that box.
An obvious question: are you compressing the data before you write it to
NFS?
Thanks,
igor
On Mon, Dec 6, 2010 at 4:36 PM, Boris Fain <boris_at_freecurve.com> wrote:
> This may be useful to everyone. When launching a cluster on Amazon, if you
> have a lot of processes writing to a shared EBS volume
> NFS does become a bottleneck. Everyone's output is different, so everyone
> will have to figure out their own limits. In our case we had to
> limit the head node compute load to 2/8 - it simply could not handle more.
> We have 12 8-core (xlarge high-cpu) instances, and there's quite
> a bit of writing from each MPI thread.
>
> --
>
> b.
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
Received on Tue Dec 07 2010 - 13:24:34 EST
This archive was generated by
hypermail 2.3.0.