StarCluster - Mailing List Archive

Re: technical problem

From: Steve Darnell <no email>
Date: Tue, 12 Nov 2013 00:22:29 +0000

Hi Yehuda,

To prevent a manual conformation for adding a new host to the known_hosts file, you can add this snippet to your ~/.ssh/config file:

Host ec2-*amazonaws.com
        StrictHostKeyChecking no
        UserKnownHostsFile /dev/null

This will automatically add any ec2 host to your known_hosts file and sets this file to /dev/null, which prevents a lot of one time ec2 host names in your known_hosts file.

I cannot comment on your NFS sharing performance concerns. You can always start by writing your data in the local scratch space and transferring the end results to the master node in one batch step.

Best regards,
Steve

From: Yehuda Landau [mailto:didist_at_gmail.com]
Sent: Monday, November 11, 2013 5:58 PM
To: Steve Darnell
Subject: Re: [StarCluster] technical problem

Hi Steve
Thanks for your kind reply
Concerning the same issue of running scripts i have a linux shell script running on my LOCAL machine which starts starcluster cluster
BUT then when i send the first remote command
e.g. startcluster sshmaster mycluster "easy_install [package name]"
I have to confirm the first SSH connection
but if i am not near the keyboard for a minute or two the connection is broken and the script fails
HOW can i make the password less ssh ALSO not to ask the first confirmation

I understand i have to had the ip to the known_hosts file somehow but every time a connect to ec2 i get a different machine?

And another small issue since STARCLUSTER was NFS share for the /home directory of the nodes if my application writes a big amount of data is it better to write it to different directory than /home because the sharing will cause delay?

Best
Yehuda

On Mon, Nov 11, 2013 at 11:28 PM, Steve Darnell <darnells_at_dnastar.com<mailto:darnells_at_dnastar.com>> wrote:
Hi Yehuda,

Is 'sgeadmin' even in the sudoers list (/etc/sudoers)? I did not think so, but I do not have a cluster running to confirm. If not, sgeadmin will not have sudo privileges without a configuration change.

Alternatively, the 'ubuntu' user should be preinstalled and configured for password-less sudo by Amazon (http://askubuntu.com/questions/192050/how-to-run-sudo-command-with-no-password) since the starcluster image is based on an Ubuntu instance.

Another option is to run a single remote command as root with sshmaster/sshnode (http://star.mit.edu/cluster/docs/latest/manual/runcommands.html?highlight=sshmaster). This approach is functionally similar to sudo with regards to preventing the accidental use of an open root shell. Neither approach will prevent the actual script from doing "bad things" with elevated privileges. This is the approach I have used in the past since it is well supported in starcluster.

Best regards,
Steve

From: starcluster-bounces_at_mit.edu<mailto:starcluster-bounces_at_mit.edu> [mailto:starcluster-bounces_at_mit.edu<mailto:starcluster-bounces_at_mit.edu>] On Behalf Of Yehuda Landau
Sent: Monday, November 11, 2013 1:12 PM
To: starcluster_at_mit.edu<mailto:starcluster_at_mit.edu>
Subject: [StarCluster] technical problem

Hi
I want to write a bash script and run on an instance
To do so i login as a user (sgeamin) --> starcluster sshmaster -u sgeadmin mycluster
but then i like to run a script using : sudo [script_name]
BUT was is the SU PASSWORD
i know i can login as root but i would prefer not to
Thanks
Received on Mon Nov 11 2013 - 19:23:03 EST
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject