Re: cluster settings are not valid

From: Justin Riley <no email>
Date: Fri, 02 Dec 2011 18:38:48 -0500

Quang,

Looks like your key_location setting is not pointing to the proper RSA
key file for your EC2 keypair. This is why you're getting "Invalid rsa
key or passphrase" errors. I'm working on a validation check to make
sure you've specified a matching key.

Make sure you downloaded the proper RSA key for the keypair and that
key_location points to this file. If all else fails try creating a new
key using starcluster's 'createkey' command[1] which will save the RSA
key file to any location you like. Don't forget to add the new keypair
to the config.

~Justin

[1]
http://web.mit.edu/stardev/cluster/docs/latest/quickstart.html?highlight=createkey

On Fri Dec 2 17:46:14 2011, Quang Trinh wrote:
> Yes, that helped! THanks. But I am getting this error message now.
> Attached is the crash report.
>
> StarCluster - (http://web.mit.edu/starcluster) (v. 0.92.1)
> Software Tools for Academics and Researchers (STAR)
> Please submit bug reports to starcluster_at_mit.edu
>
>>>> Using default cluster template: smallcluster
>>>> Validating cluster template settings...
>>>> Cluster template settings are valid
>>>> Starting cluster...
>>>> Launching a 2-node cluster...
>>>> Creating security group _at_sc-smallcluster...
> Reservation:xxxxxxxx
>>>> Waiting for cluster to come up... (updating every 30s)
>>>> Waiting for instances to activate...
>>>> Waiting for all nodes to be in a 'running' state...
> 2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>>> Waiting for SSH to come up on all nodes...
> !!! ERROR - invalid rsa key or passphrase specified | 0%
> !!! ERROR - invalid rsa key or passphrase specified
> 2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>>> Waiting for cluster to come up took 3.061 mins
>>>> The master node is xxxxxxxx
>>>> Setting up the cluster...
>>>> Configuring hostnames...
> No handlers could be found for logger "paramiko.transport" | 0%
> 2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>>> Shutting down threads...
> 20/20 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
> error occured in job (id=master):
> Traceback (most recent call last):
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/threadpool.py",
> line 32, in run
> job.run()
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/threadpool.py",
> line 59, in run
> r = self.method(*self.args, **self.kwargs)
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/node.py",
> line 661, in set_hostname
> hostname_file = self.ssh.remote_file("/etc/hostname", "w")
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/ssh.py",
> line 284, in remote_file
> rfile = self.sftp.open(file, mode)
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/ssh.py",
> line 174, in sftp
> self._sftp = paramiko.SFTPClient.from_transport(self.transport)
> File "build/bdist.macosx-10.7-intel/egg/paramiko/sftp_client.py",
> line 102, in from_transport
> chan = t.open_session()
> File "build/bdist.macosx-10.7-intel/egg/paramiko/transport.py", line
> 658, in open_session
> return self.open_channel('session')
> File "build/bdist.macosx-10.7-intel/egg/paramiko/transport.py", line
> 746, in open_channel
> raise e
> EOFError
>
> error occured in job (id=node001):
> Traceback (most recent call last):
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/threadpool.py",
> line 32, in run
> job.run()
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/threadpool.py",
> line 59, in run
> r = self.method(*self.args, **self.kwargs)
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/node.py",
> line 661, in set_hostname
> hostname_file = self.ssh.remote_file("/etc/hostname", "w")
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/ssh.py",
> line 284, in remote_file
> rfile = self.sftp.open(file, mode)
> File "/Library/Python/2.7/site-packages/StarCluster-0.92.1-py2.7.egg/starcluster/ssh.py",
> line 174, in sftp
> self._sftp = paramiko.SFTPClient.from_transport(self.transport)
> File "build/bdist.macosx-10.7-intel/egg/paramiko/sftp_client.py",
> line 102, in from_transport
> chan = t.open_session()
> File "build/bdist.macosx-10.7-intel/egg/paramiko/transport.py", line
> 658, in open_session
> return self.open_channel('session')
> File "build/bdist.macosx-10.7-intel/egg/paramiko/transport.py", line
> 746, in open_channel
> raise e
> EOFError
>
>
> !!! ERROR - Oops! Looks like you've found a bug in StarCluster
> !!! ERROR - Crash report written to:
> /Users/qtrinh/.starcluster/logs/crash-report-6804.txt
> !!! ERROR - Please remove any sensitive data from the crash report
> !!! ERROR - and submit it to starcluster_at_mit.edu
>
>
>
> On Fri, Dec 2, 2011 at 11:04 AM, Justin Riley <jtriley_at_mit.edu> wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> Hi Quang,
>>
>> Your [key] section name must match the name of a keypair you've
>> created on EC2. You can see your current keys on EC2 using the
>> listkeypairs command:
>>
>> $ starcluster listkeypairs
>>
>> For example, if the output of listkeypairs shows a key called
>> 'mykeypair' then a StarCluster [key] section for that keypair should
>> look like:
>>
>> [key mykeypair]
>> key_location = /path/to/key.rsa
>>
>> Hope that helps,
>>
>> ~Justin
>>
>> On 12/01/2011 08:15 PM, Quang Trinh wrote:
>>> Hi, After installing starcluster successfully, I now get this error
>>> when attempted to start my small cluster:
>>>
>>> StarCluster - (http://web.mit.edu/starcluster) (v. 0.92.1) Software
>>> Tools for Academics and Researchers (STAR) Please submit bug
>>> reports to starcluster_at_mit.edu
>>>
>>>>>> Using default cluster template: smallcluster Validating
>>>>>> cluster template settings...
>>> !!! ERROR - Cluster settings are not valid: !!! ERROR - Account
>>> does not contain a key with keyname = qt_id_rsa.
>>>
>>> My key_location path is correct. Can someone please tell me how
>>> to resolve this?
>>>
>>> thanks.
>>>
>>> Q _______________________________________________ StarCluster
>>> mailing list StarCluster_at_mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v2.0.17 (GNU/Linux)
>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>>
>> iEYEARECAAYFAk7Y9vQACgkQ4llAkMfDcrl6KwCfazS3ZASGG3qTJ07gA0pY5q2E
>> J9EAn1lPm4OTSWBz8CcEGHIZwHA4Qehq
>> =1TjB
>> -----END PGP SIGNATURE-----
Received on Fri Dec 02 2011 - 18:38:49 EST