Re: Starcluster, etc., in Public AMI?

From: Lyn Gerner <no email>
Date: Wed, 16 Oct 2013 18:55:14 -1000

Thanks for the additional perspective, Jacob.

Best,
Lyn


On Wed, Oct 16, 2013 at 2:57 PM, Jacob Barhak <jacob.barhak_at_gmail.com>wrote:

> Hi Lyn,
>
> The advantage of using the Anaconda solution is that you can upgrade the
> python libraries and keep a python version with all the library versions
> you like through easy install, pip install, and conda commands. You don't
> need a new AMI copy if you decide to upgrade starcluster there.
>
> I believe you can control such things from the configuration file. Yet I
> did not try it so correct me if I am wrong.
>
> I hope this helps you decide better.
>
> Jacob
>
> Sent from my iPhone
>
> On Oct 16, 2013, at 7:50 PM, Lyn Gerner <schedulerqueen_at_gmail.com> wrote:
>
> Thanks, Rayson and Jacob.
>
> I already have an AMI I'm developing for the back end (SGE) nodes; was
> hoping to not have to do another one (under a crunched schedule at this
> point).
>
> Jacob, will let you know if I use the Anaconda image you've pointed to.
>
> Thanks,
> Lyn
>
>
> On Wed, Oct 16, 2013 at 2:15 PM, Jacob Barhak <jacob.barhak_at_gmail.com>wrote:
>
>> Hi Lyn,
>>
>> The Anaconda AMI that I am using has the capability to easy_install or
>> pip install. See:
>> https://github.com/ContinuumIO/anaconda-ec2/blob/master/README.md
>>
>> Therefore it is one shell command away from what you need.
>>
>> However, I did encounter issues with easy install with version 0.94 of
>> starcluster. I did not check the new version yet I saw something on the
>> list.
>>
>> If you try it, let us know if it works for you.
>>
>> Jacob
>>
>> Sent from my iPhone
>>
>> On Oct 16, 2013, at 6:16 PM, Lyn Gerner <schedulerqueen_at_gmail.com> wrote:
>>
>> Hi All,
>>
>> Is there a public, paravirtual, relatively recent Linux AMI out there
>> that has starcluster built into it? I'd like to integrate a
>> web-front-end/SQL cluster with a back-end SGE compute cluster by having the
>> former launch the latter.
>>
>> More generally, is there an AMI that already has the ec2-api and ec2-ami
>> command-line tools, aws, s3cmd, etc., in addition to starcluster, built
>> into it?
>>
>> Would love to not reinvent the wheel to the greatest extent possible.
>> Thanks for any pointers.
>>
>> Best,
>> Lyn
>>
>> _______________________________________________
>>
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>>
>
Received on Thu Oct 17 2013 - 00:55:15 EDT