Re: problem with "starcluster put"

From: Justin Riley <no email>
Date: Mon, 31 Oct 2011 17:57:49 -0400

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Sunjai,

Glad to hear you got it working eventually. For future reference you
do not need to terminate a cluster if a put/get command fails. Just
simply retry the put/get command again. If you're still having issues
you can try reconfiguring the cluster without terminating and losing
instance hours using the 'restart' command:

$ starcluster restart mycluster

This will reboot the instances and reconfigure them from scratch
without wasting instance hours.

HTH

~Justin


On 10/31/2011 04:48 PM, Sujai Kumar wrote:
> Hi Justin
>
> Thanks for the prompt response. Yes it worked on a subsequent
> cluster instance (I terminated that previous one because a cluster
> you can't put data into is not much use :-))
>
> Cheers,
>
> - Sujai
>
> On 31 October 2011 17:32, Justin Riley <jtriley_at_mit.edu> wrote: Hi
> Sunjai,
>
> This happened because some how you lost connection to the EC2
> instance. This could be because of a network connection issue
> either on your side or Amazon's side. I've updated the latest code
> to better report connection-related errors. Were you able to
> successfully retry the command?
>
> ~Justin
>
> On 10/30/2011 04:51 AM, Sujai Kumar wrote:
>>>> Dear Starcluster team
>>>>
>>>> First of all, thank you for an amazing set of tools!
>>>>
>>>> Just wanted to report a problem with "starcluster put" on an
>>>> ubuntu 10.04 desktop. Thanks in advance for your time and
>>>> help,
>>>>
>>>> - Sujai
>>>>
>>>> ----
>>>>
>>>> I tried this command:
>>>>
>>>> starcluster put mycluster g_meloflo_100522_2_1.txt.gz /mnt/
>>>>
>>>> And it seemed to be chugging along nicely:
>>>>
>>>> g_meloflo_100522_2_1.txt.gz 2% | | ETA:
>>>> 00:04:23 5.24 M/s
>>>>
>>>> But then gave me this (crash report attached):
>>>>
>>>> No handlers could be found for logger "paramiko.transport"
>>>> 00:01:33 3.74 M/s Traceback (most recent call
>>>> last):///////////// | ETA: 00:01:33 3.73 M/s File
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/cli.py",
>>>>
>>>>
>
>>>>
>>>>
line 157, in main
>>>> sc.execute(args) File
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/commands/put.py",
>>>>
>>>>
>
>>>>
>>>>
line 59, in execute
>>>> node.ssh.put(lpaths, rpath) File
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/ssh.py",
>>>>
>>>>
>
>>>>
>>>>
line 430, in put
>>>> self.scp.put(localpaths, remote_path=remotepath,
>>>> recursive=recursive) File
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py",
>>>>
>>>>
>
>>>>
>>>>
line 100, in put
>>>> self._send_files(files) File
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py",
>>>>
>>>>
>
>>>>
>>>>
line 168, in _send_files
>>>> chan.sendall(file_hdl.read(buff_size)) File
>>>> "build/bdist.linux-x86_64/egg/paramiko/channel.py", line
>>>> 763, in sendall raise socket.error('Socket is closed')
>>>> error: Socket is closed !!! ERROR - Oops! Looks like you've
>>>> found a bug in StarCluster !!! ERROR - Crash report written
>>>> to: /home/s0674613/.starcluster/crash-report-11564.txt !!!
>>>> ERROR - Please remove any sensitive data from the crash
>>>> report !!! ERROR - and submit it to starcluster_at_mit.edu
>>>> ==================================================
>>>>
>>>>
>
>>
>>
>
>
>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk6vGd0ACgkQ4llAkMfDcrn9qwCgkZqhqoMbAk84iEPwof69v2K6
3LIAn1dPTsYSlWx897b1wDC4EvxPJZ5s
=zQ/o
-----END PGP SIGNATURE-----
Received on Mon Oct 31 2011 - 17:57:51 EDT