Re: Starcluster, etc., in Public AMI?

From: Jacob Barhak <no email>
Date: Wed, 16 Oct 2013 19:57:19 -0500

Hi Lyn,

The advantage of using the Anaconda solution is that you can upgrade the python libraries and keep a python version with all the library versions you like through easy install, pip install, and conda commands. You don't need a new AMI copy if you decide to upgrade starcluster there.

I believe you can control such things from the configuration file. Yet I did not try it so correct me if I am wrong.

I hope this helps you decide better.

       Jacob

Sent from my iPhone

On Oct 16, 2013, at 7:50 PM, Lyn Gerner <schedulerqueen_at_gmail.com> wrote:

> Thanks, Rayson and Jacob.
>
> I already have an AMI I'm developing for the back end (SGE) nodes; was hoping to not have to do another one (under a crunched schedule at this point).
>
> Jacob, will let you know if I use the Anaconda image you've pointed to.
>
> Thanks,
> Lyn
>
>
> On Wed, Oct 16, 2013 at 2:15 PM, Jacob Barhak <jacob.barhak_at_gmail.com> wrote:
>> Hi Lyn,
>>
>> The Anaconda AMI that I am using has the capability to easy_install or pip install. See:
>> https://github.com/ContinuumIO/anaconda-ec2/blob/master/README.md
>>
>> Therefore it is one shell command away from what you need.
>>
>> However, I did encounter issues with easy install with version 0.94 of starcluster. I did not check the new version yet I saw something on the list.
>>
>> If you try it, let us know if it works for you.
>>
>> Jacob
>>
>> Sent from my iPhone
>>
>> On Oct 16, 2013, at 6:16 PM, Lyn Gerner <schedulerqueen_at_gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> Is there a public, paravirtual, relatively recent Linux AMI out there that has starcluster built into it? I'd like to integrate a web-front-end/SQL cluster with a back-end SGE compute cluster by having the former launch the latter.
>>>
>>> More generally, is there an AMI that already has the ec2-api and ec2-ami command-line tools, aws, s3cmd, etc., in addition to starcluster, built into it?
>>>
>>> Would love to not reinvent the wheel to the greatest extent possible. Thanks for any pointers.
>>>
>>> Best,
>>> Lyn
>>> _______________________________________________
>>>
>>> StarCluster mailing list
>>> StarCluster_at_mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>
Received on Wed Oct 16 2013 - 20:57:26 EDT