Re: StarCluster Digest, Vol 22, Issue 9
Justin>
The rc2 version allows easy_install to complete a successful install. Just easier to use this mode in a script to grab the most recent release on a new virtual machine.
Thanks,
<Adam
---------------------------------------------------
Adam G. Marsh, Ph.D.
Associate Professor
Marine Biological Sciences
University of Delaware
302.645.4367
------------------------------------------------
On Jun 28, 2011, at 12:23 AM, starcluster-request_at_mit.edu wrote:
> Send StarCluster mailing list submissions to
> starcluster_at_mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/starcluster
> or, via email, send a message with subject or body 'help' to
> starcluster-request_at_mit.edu
>
> You can reach the person managing the list at
> starcluster-owner_at_mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of StarCluster digest..."
>
>
> Today's Topics:
>
> 1. Re: stalled install 0.92rc1 (Justin Riley)
> 2. StarCluster 0.92 release candidate 2 (Justin Riley)
> 3. starcluster help (Christopher K. Lee)
> 4. Re: starcluster help (Justin Riley)
> 5. Re: starcluster help (Christopher K. Lee)
> 6. Re: starcluster help (Justin Riley)
> 7. Re: starcluster help (Justin Riley)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 27 Jun 2011 14:16:47 -0400
> From: Justin Riley <jtriley_at_MIT.EDU>
> Subject: Re: [StarCluster] stalled install 0.92rc1
> To: starcluster_at_MIT.EDU
> Message-ID: <4E08C90F.7050306_at_mit.edu>
> Content-Type: text/plain; charset=ISO-8859-1
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi Adam,
>
> This should be fixed now. I just pushed a new hotfix version 0.92rc2,
> could you please test it out and let me know if this resolves the issue
> for you?
>
> Thanks!
>
> ~Justin
>
> On 06/27/2011 11:57 AM, Justin Riley wrote:
>> Hi Adam,
>>
>> This is happening because I was trying to be clever in setup.py and
>> import the version number from the source package so that I have a
>> central place to update the version number when it comes time to
>> release. This works for distribute/pip but breaks
>> setuptools/easy_install. Fortunately I think this is easy to fix. I'm
>> working on a hotfix now:
>>
>> https://github.com/jtriley/StarCluster/tree/hotfix-0.92rc2
>>
>> If things go well I will release and announce 0.92rc2 today.
>>
>> ~Justin
>>
>>
>> On 06/25/2011 01:14 PM, Adam Marsh wrote:
>>
>>
>>> When I run the install routine for the 0.92rc1 version of SC, it aborts
>>> with the following error message:
>>> ImportError: No module named starcluster
>>
>>
>>> I'm using the following AMI for a single server, from which I would then
>>> launch a cluster:
>>> ami-0af31963
>>> starcluster/starcluster-base-ubuntu-10.04-x86_64-rc1.manifest.xml
>>
>>
>>> Full output from the command "sudo easy_install StarCluster" from this
>>> cloud server is appended below.
>>
>>> I've been using SC for the last year and have my setup and run scripts
>>> finely tuned for initiating and managing specific cluster
>>> configurations. Between May 15 and June 15 I ran three separate clusters
>>> (from 48 to 96 cores) with no problems whatsoever.
>>
>>
>>> Here are the first several upstream script commands
>>> (fn=mastersetup.sh) I run to setup a new cloud server:
>>
>>> #!/bin/bash
>>
>>> apt-get -y update
>>> apt-get -y install libx11-dev
>>> apt-get -y install xvfb
>>> apt-get -y install python-setuptools
>>> #--- For StarCluster ----------------------
>>> apt-get -y install python-crypto
>>> apt-get -y install python-paramiko
>>> #--- For running python analysis/plotting scripts ----------
>>> # apt-get -y install gfortran
>>> # apt-get -y install python-numpy
>>> # apt-get -y install python-matplotlib
>>
>>> easy_install StarCluster
>>> . . . . . .
>>
>>> This script file is called by the command "sudo bash mastersetup.sh"
>>
>>> Error output message from 'easy_install StarCluster' is the same whether
>>> it is invoked within this script or directly called from the command
>>> line as: 'sudo easy_install StarCluster'
>>
>>
>>> Thanks for any light you may be able to shed on this issue,
>>
>>> Adam
>>
>>> ---------------------------------------------------
>>> Adam G. Marsh, Ph.D.
>>> Associate Professor
>>> Marine Biological Sciences
>>> University of Delaware
>>> 302.645.4367
>>> ------------------------------------------------
>>
>>
>>
>>
>>> prompt> sudo easy_install StarCluster
>>
>>> Searching for StarCluster
>>> Reading http://pypi.python.org/simple/StarCluster/
>>> Reading http://web.mit.edu/starcluster
>>> Best match: StarCluster 0.92rc1
>>> Downloading
>>> http://pypi.python.org/packages/source/S/StarCluster/StarCluster-0.92rc1.tar.gz#md5=0e2fadfa011de41bf6a6868bc37c61ed
>>> Processing StarCluster-0.92rc1.tar.gz
>>> Running StarCluster-0.92rc1/setup.py -q bdist_egg --dist-dir
>>> /tmp/easy_install-_L48LL/StarCluster-0.92rc1/egg-dist-tmp-ZZxqNG
>>> Traceback (most recent call last):
>>> File "/usr/bin/easy_install", line 9, in <module>
>>> load_entry_point('distribute==0.6.10', 'console_scripts',
>>> 'easy_install')()
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 1760, in main
>>> with_ei_usage(lambda:
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 1741, in with_ei_usage
>>> return f()
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 1764, in <lambda>
>>> distclass=DistributionWithoutHelpCommands, **kw
>>> File "/usr/lib/python2.6/distutils/core.py", line 152, in setup
>>> dist.run_commands()
>>> File "/usr/lib/python2.6/distutils/dist.py", line 975, in run_commands
>>> self.run_command(cmd)
>>> File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
>>> cmd_obj.run()
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 254, in run
>>> self.easy_install(spec, not self.no_deps)
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 489, in easy_install
>>> return self.install_item(spec, dist.location, tmpdir, deps)
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 519, in install_item
>>> dists = self.install_eggs(spec, download, tmpdir)
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 698, in install_eggs
>>> return self.build_and_install(setup_script, setup_base)
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 975, in build_and_install
>>> self.run_setup(setup_script, setup_base, args)
>>> File
>>> "/usr/lib/python2.6/dist-packages/setuptools/command/easy_install.py",
>>> line 964, in run_setup
>>> run_setup(setup_script, args)
>>> File "/usr/lib/python2.6/dist-packages/setuptools/sandbox.py", line
>>> 29, in run_setup
>>> lambda: execfile(
>>> File "/usr/lib/python2.6/dist-packages/setuptools/sandbox.py", line
>>> 70, in run
>>> return func()
>>> File "/usr/lib/python2.6/dist-packages/setuptools/sandbox.py", line
>>> 31, in <lambda>
>>> {'__file__':setup_script, '__name__':'__main__'}
>>> File "setup.py", line 5, in <module>
>>> ImportError: No module named starcluster
>>
>>
>>
>>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.17 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAk4IyQ8ACgkQ4llAkMfDcrn47QCdGC9UvSYewDSRxHSwx1+0G2sl
> mZ4AnRyGDzR1pZ0IIjpVxNeXpOGSHHh+
> =NFTZ
> -----END PGP SIGNATURE-----
>
>
> ------------------------------
>
> Message: 2
> Date: Mon, 27 Jun 2011 14:21:06 -0400
> From: Justin Riley <justin.t.riley_at_gmail.com>
> Subject: [StarCluster] StarCluster 0.92 release candidate 2
> To: starcluster <starcluster_at_mit.edu>
> Message-ID: <4E08CA12.9050801_at_gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> Hi All,
>
> I've released a hotfix version of StarCluster 0.92rc2. This version
> doesn't change any of the core code from 0.92rc1 but should fix a
> show-stopper bug for easy_install users. Please upgrade to the latest
> version at your earliest convenience and report any issues you encounter
> to github or the list.
>
> Thanks!!
>
> ~Justin
>
>
> ------------------------------
>
> Message: 3
> Date: Mon, 27 Jun 2011 14:01:56 -0700
> From: "Christopher K. Lee" <chris.kelvin.lee_at_gmail.com>
> Subject: [StarCluster] starcluster help
> To: starcluster_at_mit.edu
> Message-ID: <BANLkTimLwJyFYF_rqwOreJWQVjPvbj-B4w_at_mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> I pressed 1 on accident. How do I get another copy of the template, or
> rerun starcluster help so I can write a config template to [2] Write
> config template to /home/user/.starcluster/config.
>
> Thanks,
> Chris
>
>
> ------------------------------
>
> Message: 4
> Date: Mon, 27 Jun 2011 17:06:56 -0400
> From: Justin Riley <jtriley_at_MIT.EDU>
> Subject: Re: [StarCluster] starcluster help
> To: "Christopher K. Lee" <chris.kelvin.lee_at_gmail.com>
> Cc: "starcluster_at_mit.edu" <starcluster_at_mit.edu>
> Message-ID: <4E08F0F0.6030205_at_mit.edu>
> Content-Type: text/plain; charset=ISO-8859-1
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi Chris,
>
> If you pressed [1] then the config has not been written and running
> "starcluster help" will give you the same menu again at which point you
> can press [2] and write it to $HOME/.starcluster/config
>
> HTH,
>
> ~Justin
>
> On 06/27/2011 05:01 PM, Christopher K. Lee wrote:
>> I pressed 1 on accident. How do I get another copy of the template, or
>> rerun starcluster help so I can write a config template to [2] Write
>> config template to /home/user/.starcluster/config.
>>
>> Thanks,
>> Chris
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.17 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAk4I8PAACgkQ4llAkMfDcrmtNQCfQP+vcd2acuHCytjKs4nci0Cv
> QAYAnRCihnWl4wnRpNZsrzu4SO3IABHJ
> =vUNA
> -----END PGP SIGNATURE-----
>
>
> ------------------------------
>
> Message: 5
> Date: Mon, 27 Jun 2011 14:05:34 -0700
> From: "Christopher K. Lee" <chris.kelvin.lee_at_gmail.com>
> Subject: Re: [StarCluster] starcluster help
> To: starcluster_at_mit.edu
> Message-ID: <BANLkTi=MKZYoWbJZdZXiPR-KcOQSR8o-3A_at_mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> nvm, found the template in the install file. thx.
>
>
>
>
>
>
> On Mon, Jun 27, 2011 at 2:01 PM, Christopher K. Lee
> <chris.kelvin.lee_at_gmail.com> wrote:
>> I pressed 1 on accident. How do I get another copy of the template, or
>> rerun starcluster help so I can write a config template to [2] Write
>> config template to /home/user/.starcluster/config.
>>
>> Thanks,
>> Chris
>>
>
>
> ------------------------------
>
> Message: 6
> Date: Mon, 27 Jun 2011 17:28:38 -0400
> From: Justin Riley <jtriley_at_MIT.EDU>
> Subject: Re: [StarCluster] starcluster help
> To: "Christopher K. Lee" <chris.kelvin.lee_at_gmail.com>
> Cc: starcluster_at_mit.edu
> Message-ID: <4E08F606.1070401_at_mit.edu>
> Content-Type: text/plain; charset=ISO-8859-1
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Great. BTW, please join the list for future posts:
>
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
> Just keeps me from having to approve each message.
>
> Thanks!
>
> ~Justin
>
> On 06/27/2011 05:05 PM, Christopher K. Lee wrote:
>> nvm, found the template in the install file. thx.
>>
>>
>>
>>
>>
>>
>> On Mon, Jun 27, 2011 at 2:01 PM, Christopher K. Lee
>> <chris.kelvin.lee_at_gmail.com> wrote:
>>> I pressed 1 on accident. How do I get another copy of the template, or
>>> rerun starcluster help so I can write a config template to [2] Write
>>> config template to /home/user/.starcluster/config.
>>>
>>> Thanks,
>>> Chris
>>>
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.17 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAk4I9gYACgkQ4llAkMfDcrmwOQCcD9fsTRmHOVKSKhND1LoOQf2b
> Lu0An1xKdwFGVgfXmxjXxSpZMO0kk/81
> =Lsdo
> -----END PGP SIGNATURE-----
>
>
> ------------------------------
>
> Message: 7
> Date: Tue, 28 Jun 2011 00:23:05 -0400
> From: Justin Riley <jtriley_at_MIT.EDU>
> Subject: Re: [StarCluster] starcluster help
> To: "starcluster_at_mit.edu" <starcluster_at_MIT.EDU>
> Message-ID: <9BDC9136-2080-4541-9F79-4F9936A58A4B_at_mit.edu>
> Content-Type: text/plain; charset="us-ascii"
>
> Hi Chris,
>
> Thanks for joining the list and welcome. Given that you created a blank $HOME/.starcluster/config file from vi, all you should need to do is remove the blank $HOME/.starcluster/config file and then run "starcluster help" again to get the same "first-time" menu. At the menu be sure to press "2" to write a sample config to $HOME/.starcluster/config. From there you should be able to customize in vi.
>
> HTH
>
> ~Justin
>
> On Jun 27, 2011, at 5:39 PM, Christopher K. Lee wrote:
>
>> Thanks Justin, for the prompt replies. I just added myself to the mailing list.
>>
>> The problem is that I created an empty config file by running vi
>> $HOME/.starcluster/config before pressing 1 or 2. Now when I run
>> "starcluster help" I think it believes that I don't need the template
>> file anymore. I tried the following, and I don't think the setup is
>> working for me:
>>
>> cd $HOME/packages/StarCluster-0.92rc2/starcluster/templates
>> cp config.py $HOME/.starcluster/config
>>
>> My apologies for all these questions...I'm a bit new to this. Is there
>> an easier solution where I can do a clean install?
>>
>> Thanks,
>> Chris
>>
>>
>>
>>
>> On Mon, Jun 27, 2011 at 2:06 PM, Justin Riley <jtriley_at_mit.edu> wrote:
>>> -----BEGIN PGP SIGNED MESSAGE-----
>>> Hash: SHA1
>>>
>>> Hi Chris,
>>>
>>> If you pressed [1] then the config has not been written and running
>>> "starcluster help" will give you the same menu again at which point you
>>> can press [2] and write it to $HOME/.starcluster/config
>>>
>>> HTH,
>>>
>>> ~Justin
>>>
>>> On 06/27/2011 05:01 PM, Christopher K. Lee wrote:
>>>> I pressed 1 on accident. How do I get another copy of the template, or
>>>> rerun starcluster help so I can write a config template to [2] Write
>>>> config template to /home/user/.starcluster/config.
>>>>
>>>> Thanks,
>>>> Chris
>>>> _______________________________________________
>>>> StarCluster mailing list
>>>> StarCluster_at_mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>
>>> -----BEGIN PGP SIGNATURE-----
>>> Version: GnuPG v2.0.17 (GNU/Linux)
>>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>>>
>>> iEYEARECAAYFAk4I8PAACgkQ4llAkMfDcrmtNQCfQP+vcd2acuHCytjKs4nci0Cv
>>> QAYAnRCihnWl4wnRpNZsrzu4SO3IABHJ
>>> =vUNA
>>> -----END PGP SIGNATURE-----
>>>
>
>
>
>
> ------------------------------
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
> End of StarCluster Digest, Vol 22, Issue 9
> ******************************************
Received on Tue Jul 05 2011 - 14:53:34 EDT
This archive was generated by
hypermail 2.3.0.