This may be useful to everyone. When launching a cluster on Amazon, if you
have a lot of processes writing to a shared EBS volume
NFS does become a bottleneck. Everyone's output is different, so everyone
will have to figure out their own limits. In our case we had to
limit the head node compute load to 2/8 - it simply could not handle more.
We have 12 8-core (xlarge high-cpu) instances, and there's quite
a bit of writing from each MPI thread.
--
b.
Received on Mon Dec 06 2010 - 19:36:16 EST
This archive was generated by
hypermail 2.3.0.