Re: Waiting for JSON connector file...

From: Don MacMillen <no email>
Date: Fri, 16 Nov 2012 09:47:49 -0800

Hi Alessandro,

For your use case you might consider making your own customized ami.
Once you have one up and running you can use StarCluster's ebscreate
command to do this. Then just put the new ami id into the config file.
>From the docs:

$ starcluster ebsimage -h
StarCluster - (http://web.mit.edu/starcluster) (v. 0.93.3)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster_at_mit.edu

Usage: ebsimage [options] <instance-id> <image_name>

    Create a new EBS image (AMI) from a running EC2 instance

    Example:

        $ starcluster ebsimage i-999999 my-new-image-ebs

    NOTE: It should now be safe to create an image from an instance
launched by
    StarCluster. If you have issues please submit a bug report to the
mailing
    list.
...

Now while you have made your life easier with this, there is always the
danger that
you delete the image and/or forget the recipe. As long as you don't have a
bunch of
different instance types, or have very complex image build recipes, this is
mostly OK.

Don




On Wed, Nov 14, 2012 at 12:07 PM, Alessandro Gagliardi
<alessandro_at_path.com>wrote:

> So it sounds like anything using the StarCluster 11.10 AMIs should be
> EBS-backed automatically (so long as I'm not using spot instances, which
> I'm not) and so should be able to be started after being stopped (with the
> -x) flag.
>
> If that's the case, then it doesn't answer my original question of why,
> when I tried starting my cluster after stopping it, it got stuck on Waiting
> for JSON connector file.../.
>
> I'd really like to solve this problem as I only need to use these clusters
> about 1/4 of the week, but it takes me almost a full day to configure them
> the way I want (with installing IPython 0.14 and Pandas and RPy and all
> that) so I can't just spin up a new one every time I need it.
>
>
> On Wed, Nov 14, 2012 at 11:44 AM, Justin Riley <jtriley_at_mit.edu> wrote:
>
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> Hi Alessandro,
>>
>> Yes you can only stop an EBS-backed cluster. With that said any
>> cluster started with EBS-backed AMIs is stoppable provided it's not a
>> spot cluster. The latest StarCluster 11.10 AMIs are EBS-backed so if
>> you're using them with on-demand instances you can stop your cluster
>> using the 'stop' command and then restart them later on using:
>>
>> $ starcluster start -x your_stopped_cluster
>>
>> HTH,
>>
>> ~Justin
>>
>> On 11/08/2012 07:37 PM, Alessandro Gagliardi wrote:
>> > I think the problem is that I can only start a stopped StarCluster
>> > if it's EBS-backed. (At least, that's what it looks like from
>> > reading
>> >
>> http://star.mit.edu/cluster/docs/latest/manual/launch.html#stopping-an-ebs-backed-cluster
>> .)
>> >
>> >
>> But how do I make it EBS-backed? (Sadly, searching the documentation for
>> > ebs-backed
>> > <
>> http://star.mit.edu/cluster/docs/latest/search.html?q=ebs-backed&check_keywords=yes&area=default
>> >
>> >
>> >
>> yields no results.)
>> >
>> > Thank you in advance, -Alessandro
>> >
>> >
>> > On Wed, Oct 31, 2012 at 1:51 PM, Alessandro Gagliardi
>> > <alessandro_at_path.com <mailto:alessandro_at_path.com>> wrote:
>> >
>> > Hello folks,
>> >
>> > I stopped my StarCluster (after successfully using it with IPython
>> > 0.14) and when I tried starting it up again the next day, it hangs
>> > at this point:
>> >
>> > !!! ERROR - command 'source /etc/profile && ipcluster start --n=37
>> > --delay=5 --daemonize' failed with status 10
>> >>>> Waiting for JSON connector file.../
>> >
>> > Any idea why and what (if anything) I can do about it?
>> >
>> > Thanks, -Alessandro
>> >
>> >
>> >
>> >
>> > -- Alessandro Gagliardi • • alessandro_at_path.com
>> > <mailto:alessandro_at_path.com>
>> >
>> >
>> > _______________________________________________ StarCluster mailing
>> > list StarCluster_at_mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/starcluster
>> >
>>
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v2.0.19 (GNU/Linux)
>> Comment: Using GnuPG with Mozilla - http://www.enigmail.net/
>>
>> iEYEARECAAYFAlCj9KEACgkQ4llAkMfDcrlE/wCeMebO/XJv9IGNgeVidngQYn2J
>> dCUAn2D9oHS+C/dfNN44ToRqcqDHBO1g
>> =L/JA
>> -----END PGP SIGNATURE-----
>>
>
>
>
> --
> Alessandro Gagliardi • • alessandro_at_path.com
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
Received on Fri Nov 16 2012 - 12:47:52 EST