StarCluster - Mailing List Archive

Re: Help needed with running mpich2 plugin using starcluster

From: Justin Riley <no email>
Date: Mon, 27 Feb 2012 17:14:40 -0500

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Subbarao,

Yes it is, have a look at the following doc:

http://web.mit.edu/star/cluster/docs/latest/manual/create_new_ami.html

HTH,

~Justin

On 02/27/2012 05:08 PM, Subbarao Kota wrote:
> Thanks Justin.
>
> Is it possible to create a new AMI of my choice using StarCluster
> and use it?
>
> Specifically with m1.small and c1.medium with Linux on them?
>
> Please advise. Thanks.
>
> Subbarao Kota.
>
> On Feb 27, 2012, at 4:58 PM, Justin Riley <jtriley_at_MIT.EDU> wrote:
>
> Hi Subbarao,
>
> The AMI you're using (ami-31814f58) is not supported by
> StarCluster. Please use one of the StarCluster Ubuntu 11.10 AMIs
> when using the mpich2 plugin. You can get a list of StarCluster
> supported AMIs using:
>
> $ starcluster listpublic
>
> HTH,
>
> ~Justin
>
> On 02/26/2012 02:54 PM, Subbarao Kota wrote:
>>>> Hi Justin, Thanks so much for taking time on this.
>>>>
>>>> Everytimg I am starting the cluster using StarCluster I am
>>>> receiving the errors as in the attached file. I have also
>>>> attached my config file. Some values are replaced such as
>>>> access_keys.
>>>>
>>>> 1. Why are these errors being received? See attached file
>>>> (cluster_startup_errors) for errors. Also attached is the
>>>> crash_report. 2. I included a [plugin mpich2] section in the
>>>> config file but when starting the cluster with this setting
>>>> doesn't seem start the plugins. Why is that?
>>>>
>>>> My goal is to run some benchmarks (specifically STREAM (MPI
>>>> version in C), IOR and NAS MPI) on Amazon EC2 instances. Once
>>>> I am successful in running these on just 1 instance, my plan
>>>> is to run them on 2 nodes, 4 nodes, 6 nodes and 8 nodes to
>>>> evaluate the performance of these benchmarks. And I need to
>>>> run them with MPICH2.
>>>>
>>>> So far I have been able to run STREAM and IOR benchmarks on
>>>> t1.micro instance. Now I want to create a small cluster of 2
>>>> nodes and run them. I think StarCluster can help me
>>>> accomplish it.
>>>>
>>>> Thanks, Subbarao Kota.
>>>>
>>>>
>>>>
>>>> On Feb 22, 2012, at 11:51 AM, Justin Riley wrote:
>>>>
>>>> Hi Subbarao,
>>>>
>>>> Which AMI are you using? This error usually occurs because
>>>> you're using an AMI that does not allow root logins.
>>>>
>>>> In general you should use either the StarCluster supported
>>>> AMIs or an AMI based on the StarCluster supported AMIs. Have
>>>> a look at the following doc on how to customize the
>>>> StarCluster supported AMIs:
>>>>
>>>> http://web.mit.edu/star/cluster/docs/latest/manual/create_new_ami.html
>>>>
>>>>
>>>>
Also, do you still have the 'crash report' that was generated when
>>>> you got this error? It would be useful to take a look at this
>>>> as well if it's still around....
>>>>
>>>> ~Justin
>>>>
>>>> On 02/20/2012 02:57 PM, Subbarao Kota wrote:
>>>>>>> Hello, I received the below error when attempted to run
>>>>>>> the mpich2 plugin on a 2-node cluster of t1.micro
>>>>>>> instance via starcluster. Can you please let me know
>>>>>>> what needs to be fixed or corrected? what additional
>>>>>>> information you will need to help.
>>>>>>>
>>>>>>> Please advise. Thanks.
>>>>>>>
>>>>>>> ====
>>>>>>>
>>>>>>> StarCluster - (http://web.mit.edu/starcluster) (v.
>>>>>>> 0.93.1) Software Tools for Academics and Researchers
>>>>>>> (STAR) Please submit bug reports to
>>>>>>> starcluster_at_mit.edu
>>>>>>>
>>>>>>>>>> Running plugin mpich2 Creating MPICH2 hosts file
>>>>>>> !!! ERROR - Error occurred while running plugin
>>>>>>> 'mpich2': Traceback (most recent call last): File
>>>>>>>
>>>>> "/Library/Python/2.7/site-packages/StarCluster-0.93.1-py2.7.egg/starcluster/cluster.py",
>>>>>>>
>>>>>
>
>>>>>
line 1482, in run_plugin func(*args) File
>>>>>>>
>>>>> "/Library/Python/2.7/site-packages/StarCluster-0.93.1-py2.7.egg/starcluster/plugins/mpich2.py",
>>>>>>>
>>>>>
>
>>>>>
line 33, in run mpich2_hosts =
>>>>>>> master.ssh.remote_file(self.MPICH2_HOSTS, 'w') File
>>>>>>>
>>>>> "/Library/Python/2.7/site-packages/StarCluster-0.93.1-py2.7.egg/starcluster/ssh.py",
>>>>>>>
>>>>>
>
>>>>>
line 290, in remote_file rfile = self.sftp.open(file, mode) File
>>>>>>>
>>>>> "/Library/Python/2.7/site-packages/StarCluster-0.93.1-py2.7.egg/starcluster/ssh.py",
>>>>>>>
>>>>>
>
>>>>>
line 180, in sftp self._sftp =
>>>>>>> paramiko.SFTPClient.from_transport(self.transport) File
>>>>>>>
>>>>>>> "build/bdist.macosx-10.7-intel/egg/paramiko/sftp_client.py",
>>>>>>>
>>>>>>>
line 106, in from_transport return cls(chan) File
>>>>>>> "build/bdist.macosx-10.7-intel/egg/paramiko/sftp_client.py",
>>>>>>>
>>>>>>>
line 87, in __init__ server_version = self._send_version()
>>>>>>> File
>>>>>>> "build/bdist.macosx-10.7-intel/egg/paramiko/sftp.py",
>>>>>>> line 108, in _send_version t, data =
>>>>>>> self._read_packet() File
>>>>>>> "build/bdist.macosx-10.7-intel/egg/paramiko/sftp.py",
>>>>>>> line 179, in _read_packet raise SFTPError('Garbage
>>>>>>> packet received') SFTPError: Garbage packet received
>>>>>>> _______________________________________________
>>>>>>> StarCluster mailing list StarCluster_at_mit.edu
>>>>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>>
>>>>
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk9MAFAACgkQ4llAkMfDcrnUpwCeKHZ2y7CP02RcmY5djw9NvR18
jDQAn33h9hoX5Cmk4WQJgNMvLigzyqit
=h7QG
-----END PGP SIGNATURE-----
Received on Mon Feb 27 2012 - 17:14:42 EST
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject