StarCluster - Mailing List Archive

Re: sshfs to access volumes

From: Justin Riley <no email>
Date: Wed, 1 Aug 2012 00:42:44 -0400

Hi Robert,

Awesome tip, thanks for sharing! You could even do this in a StarCluster
plugin. This would completely automate the process and eliminate needing
to look up the master's dns name each time. Here's a draft
implementation to get you started (untested but should work):

https://gist.github.com/3223691

The gist includes the plugin (sshfs.py) as well as an example
StarCluster config for the plugin...

HTH,

~Justin

On Thu, Jun 07, 2012 at 08:42:54PM -0700, Robert Yu wrote:
> Hello,
> I thought I'd pass along this method to access a volume you have attached
> to the master node (and shared with all slave nodes) from any machine. To
> me this was easier than having the master node do the setup and collecting
> of results. I prefer to keep the master as a pure submit host.
> I am using ubuntu 10.04.
> 1. Iinstall sshfs
> % sudo apt-get install sshfs
> % sudo modprobe fuse
> 2. Run sshfs:
> % mkdir <mount_point>
> % sshfs -o ssh_command="ssh -i /full/path/to/your/private/RSA/key"
> <user>_at_<aws IP addresss>:/<volume> <mount_point>
> Example:
> % mkdir ./results
> % sshfs -o ssh_command="ssh -i $PWD/id_rsa.key"
> sgeadmin_at_ec2-01-23-45-678.us-west-1.compute.amazonaws.com:/results
> ./results
> To unmount, do:
> % fusermont -u <mount_point>
> --
> Robert Yu, Member Technical Staff
> [1]www.aditazz.com | [2]robert.yu_at_aditazz.com
> 1111 Bayhill Drive Suite 260 | San Bruno | CA 94066
> 510.459.0216 | cell
> 650.627.7357 | 650.492.7000 x1008 | work
> 650.684.1149 | fax
>
> References
>
> Visible links
> 1. http://www.aditazz.com/
> 2. mailto:robert.yu_at_aditazz.com

> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster




  • application/pgp-signature attachment: stored
Received on Wed Aug 01 2012 - 00:42:48 EDT
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject