Saving and Restoring State

From: Alessandro Gagliardi <no email>
Date: Fri, 16 Nov 2012 10:08:26 -0800

Excellent. I'll try that. Thanks!


On Fri, Nov 16, 2012 at 9:47 AM, Don MacMillen <macd_at_nimbic.com> wrote:

> Hi Alessandro,
>
> For your use case you might consider making your own customized ami.
> Once you have one up and running you can use StarCluster's ebscreate
> command to do this. Then just put the new ami id into the config file.
> From the docs:
>
> $ starcluster ebsimage -h
> StarCluster - (http://web.mit.edu/starcluster) (v. 0.93.3)
> Software Tools for Academics and Researchers (STAR)
> Please submit bug reports to starcluster_at_mit.edu
>
> Usage: ebsimage [options] <instance-id> <image_name>
>
> Create a new EBS image (AMI) from a running EC2 instance
>
> Example:
>
> $ starcluster ebsimage i-999999 my-new-image-ebs
>
> NOTE: It should now be safe to create an image from an instance
> launched by
> StarCluster. If you have issues please submit a bug report to the
> mailing
> list.
> ...
>
> Now while you have made your life easier with this, there is always the
> danger that
> you delete the image and/or forget the recipe. As long as you don't have
> a bunch of
> different instance types, or have very complex image build recipes, this
> is mostly OK.
>
> Don
>
>
>
>
>
> On Wed, Nov 14, 2012 at 12:07 PM, Alessandro Gagliardi <
> alessandro_at_path.com> wrote:
>
>> So it sounds like anything using the StarCluster 11.10 AMIs should be
>> EBS-backed automatically (so long as I'm not using spot instances, which
>> I'm not) and so should be able to be started after being stopped (with the
>> -x) flag.
>>
>> If that's the case, then it doesn't answer my original question of why,
>> when I tried starting my cluster after stopping it, it got stuck on Waiting
>> for JSON connector file.../.
>>
>> I'd really like to solve this problem as I only need to use these
>> clusters about 1/4 of the week, but it takes me almost a full day to
>> configure them the way I want (with installing IPython 0.14 and Pandas and
>> RPy and all that) so I can't just spin up a new one every time I need it.
>>
>>
>> On Wed, Nov 14, 2012 at 11:44 AM, Justin Riley <jtriley_at_mit.edu> wrote:
>>
>>> -----BEGIN PGP SIGNED MESSAGE-----
>>> Hash: SHA1
>>>
>>> Hi Alessandro,
>>>
>>> Yes you can only stop an EBS-backed cluster. With that said any
>>> cluster started with EBS-backed AMIs is stoppable provided it's not a
>>> spot cluster. The latest StarCluster 11.10 AMIs are EBS-backed so if
>>> you're using them with on-demand instances you can stop your cluster
>>> using the 'stop' command and then restart them later on using:
>>>
>>> $ starcluster start -x your_stopped_cluster
>>>
>>> HTH,
>>>
>>> ~Justin
>>>
>>> On 11/08/2012 07:37 PM, Alessandro Gagliardi wrote:
>>> > I think the problem is that I can only start a stopped StarCluster
>>> > if it's EBS-backed. (At least, that's what it looks like from
>>> > reading
>>> >
>>> http://star.mit.edu/cluster/docs/latest/manual/launch.html#stopping-an-ebs-backed-cluster
>>> .)
>>> >
>>> >
>>> But how do I make it EBS-backed? (Sadly, searching the documentation for
>>> > ebs-backed
>>> > <
>>> http://star.mit.edu/cluster/docs/latest/search.html?q=ebs-backed&check_keywords=yes&area=default
>>> >
>>> >
>>> >
>>> yields no results.)
>>> >
>>> > Thank you in advance, -Alessandro
>>> >
>>> >
>>> > On Wed, Oct 31, 2012 at 1:51 PM, Alessandro Gagliardi
>>> > <alessandro_at_path.com <mailto:alessandro_at_path.com>> wrote:
>>> >
>>> > Hello folks,
>>> >
>>> > I stopped my StarCluster (after successfully using it with IPython
>>> > 0.14) and when I tried starting it up again the next day, it hangs
>>> > at this point:
>>> >
>>> > !!! ERROR - command 'source /etc/profile && ipcluster start --n=37
>>> > --delay=5 --daemonize' failed with status 10
>>> >>>> Waiting for JSON connector file.../
>>> >
>>> > Any idea why and what (if anything) I can do about it?
>>> >
>>> > Thanks, -Alessandro
>>> >
>>> >
>>> >
>>> >
>>> > -- Alessandro Gagliardi • • alessandro_at_path.com
>>> > <mailto:alessandro_at_path.com>
>>> >
>>> >
>>> > _______________________________________________ StarCluster mailing
>>> > list StarCluster_at_mit.edu
>>> > http://mailman.mit.edu/mailman/listinfo/starcluster
>>> >
>>>
>>> -----BEGIN PGP SIGNATURE-----
>>> Version: GnuPG v2.0.19 (GNU/Linux)
>>> Comment: Using GnuPG with Mozilla - http://www.enigmail.net/
>>>
>>> iEYEARECAAYFAlCj9KEACgkQ4llAkMfDcrlE/wCeMebO/XJv9IGNgeVidngQYn2J
>>> dCUAn2D9oHS+C/dfNN44ToRqcqDHBO1g
>>> =L/JA
>>> -----END PGP SIGNATURE-----
>>>
>>
>>
>>
>> --
>> Alessandro Gagliardi • • alessandro_at_path.com
>>
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>>
>

-- 
Alessandro Gagliardi •  • alessandro_at_path.com

Received on Fri Nov 16 2012 - 13:08:48 EST