Re: IPython cluster plugin questions and suggested improvements

From: Justin Riley <no email>
Date: Thu, 18 Oct 2012 11:58:09 -0400

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Yep, /home is NFS shared across the cluster by default along with any
external EBS volumes you're using. The current implementation of the
ipcluster plugin already relies on this for sharing the IPy security
file across the cluster.

~Justin

On 10/18/2012 04:34 AM, Olivier Grisel wrote:
> 2012/10/17 MinRK <benjaminrk_at_gmail.com>:
>>
>>
>> Sure, if starcluster didn't set up NFS already. You can
>> certainly use sshfs, or (much lighter) scp, of course. I'm not
>> sure why you would in the context of StarCluster, though, which
>> already has NFS all set up.
>
> I have not checked which mount point is on NFS on the default setup
> of starcluster. Is the home folder of each node mapped to the home
> folder of the master by default?
>
> Ideally I would only use NFS for small sharing configuration files
> and maybe a development workspace with editable source code while
> having each node use a the local disk for reading / writing large
> datafiles that are dispatched from / saved to S3 buckets at the
> beginning / end of the processing.
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://www.enigmail.net/

iEYEARECAAYFAlCAJxEACgkQ4llAkMfDcrng8gCfe984iXMbYdUG2SGalKGQmjm+
MEIAoJGT9S6QLb/RlszXCIL48z6oqW+B
=APjn
-----END PGP SIGNATURE-----
Received on Thu Oct 18 2012 - 11:58:15 EDT