Re: [Starcluster] Error while ">>> Installing Sun Grid Engine..."

From: Justin Riley <no email>
Date: Sat, 6 Mar 2010 12:37:18 -0500

Nicolas,

This error has something to do with paramiko. Which version of paramiko are
you using? I've had a couple other users report a similar problem but I have
not been able to reproduce it myself to track it down. If you're not already,
make sure you're using the latest paramiko version.

My only real guess as to why people experience this is that there's a loss of
an ssh connection somehow. The point in my code that causes this is when I
request a remote file from paramiko (/opt/sge6/ec2_sge.conf). I'm not doing
anything fancy there. It's either a connection problem or a paramiko bug. If
you can reproduce it, let me know.

Perhaps I should try/except all remote_file calls and just retry a few times
if they fail and then error out completely if it still cant create the file.

Does this happen repeatedly?

~Justin

On Friday 05 March 2010 8:48:10 pm Nicolas Pinto wrote:
> Hey Justin,
>
> I'm getting the following error when launching a cluster using 0.90.1
> (I changed the user to be 'thor' instead of 'sgeadmin')
>
> >>> Installing Sun Grid Engine...
>
> Traceback (most recent call last):
> File "/usr/local/bin/starcluster", line 100, in <module>
> main()
> File "/usr/local/bin/starcluster", line 71, in main
> ec2utils.start_cluster(create=create)
> File "/usr/local/lib/python2.6/dist-packages/starcluster/ec2utils.py",
> line 27, in wrapper
> res = func(*arg, **kargs)
> File "/usr/local/lib/python2.6/dist-packages/starcluster/ec2utils.py",
> line 321, in start_cluster
> cluster_setup.main(get_nodes())
> File
> "/usr/local/lib/python2.6/dist-packages/starcluster/cluster_setup.py",
> line 227, in main
> setup_sge(nodes)
> File
> "/usr/local/lib/python2.6/dist-packages/starcluster/cluster_setup.py",
> line 189, in setup_sge
> ec2_sge_conf = mconn.remote_file("/opt/sge6/ec2_sge.conf")
> File "/usr/local/lib/python2.6/dist-packages/starcluster/ssh.py",
> line 109, in remote_file
> rfile = self._sftp.open(file, mode)
> File "/usr/local/lib/python2.6/dist-packages/paramiko/sftp_client.py",
> line 245, in open
> t, msg = self._request(CMD_OPEN, filename, imode, attrblock)
> File "/usr/local/lib/python2.6/dist-packages/paramiko/sftp_client.py",
> line 628, in _request
> return self._read_response(num)
> File "/usr/local/lib/python2.6/dist-packages/paramiko/sftp_client.py",
> line 675, in _read_response
> self._convert_status(msg)
> File "/usr/local/lib/python2.6/dist-packages/paramiko/sftp_client.py",
> line 701, in _convert_status
> raise IOError(errno.ENOENT, text)
> IOError: [Errno 2] No such file
>
> Any idea what's wrong?
>
> Best,
>
Received on Sat Mar 06 2010 - 12:37:23 EST