StarCluster - Mailing List Archive

Re: StarCluster Digest, Vol 71, Issue 8

From: Sergio Mafra <no email>
Date: Fri, 10 Jul 2015 08:58:21 -0300

Hi Boris,

ThereĀ“s a public AMI in virginia that can help too -> ami-38b99850

All best,

Sergio

On Fri, Jul 10, 2015 at 1:12 AM, Boris Fain <boris_at_freecurve.com> wrote:

> Hi all -
>
> All problems solved. An amazing thank you for the creator of ami-bdeecb8d
> from https://www.youtube.com/watch?v=2RBupgpi_ec
>
> If anyone needs ubuntu 14 (and everyone does) look for ami-bdeecb8d in
> Oregon region it works like a charm.
>
> b.
>
> On Thu, Jul 9, 2015 at 7:32 PM, <starcluster-request_at_mit.edu> wrote:
>
>> Send StarCluster mailing list submissions to
>> starcluster_at_mit.edu
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>> or, via email, send a message with subject or body 'help' to
>> starcluster-request_at_mit.edu
>>
>> You can reach the person managing the list at
>> starcluster-owner_at_mit.edu
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of StarCluster digest..."
>>
>>
>> Today's Topics:
>>
>> 1. Re: StarCluster Digest, Vol 59, Issue 6 (Boris Fain)
>> 2. createusers (Boris Fain)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Thu, 9 Jul 2015 19:20:09 -0700
>> From: Boris Fain <boris_at_freecurve.com>
>> Subject: Re: [StarCluster] StarCluster Digest, Vol 59, Issue 6
>> To: starcluster_at_mit.edu, cmckay_at_uw.edu
>> Message-ID:
>> <
>> CAOxi5U5FoSjC3vDLJS9n8pwjZJ8BejmOvB_6oVvajcTG2S8_qA_at_mail.gmail.com>
>> Content-Type: text/plain; charset="utf-8"
>>
>> Has this been fixed? I'm using the 12.04 ami's and having a lot of
>> problems
>> with packages.
>>
>> Thank you.
>>
>> On Thu, Jul 17, 2014 at 9:25 AM, <starcluster-request_at_mit.edu> wrote:
>>
>> > Send StarCluster mailing list submissions to
>> > starcluster_at_mit.edu
>> >
>> > To subscribe or unsubscribe via the World Wide Web, visit
>> > http://mailman.mit.edu/mailman/listinfo/starcluster
>> > or, via email, send a message with subject or body 'help' to
>> > starcluster-request_at_mit.edu
>> >
>> > You can reach the person managing the list at
>> > starcluster-owner_at_mit.edu
>> >
>> > When replying, please edit your Subject line so it is more specific
>> > than "Re: Contents of StarCluster digest..."
>> >
>> >
>> > Today's Topics:
>> >
>> > 1. Re: apt-get 403 error (Cedar McKay)
>> >
>> >
>> > ----------------------------------------------------------------------
>> >
>> > Message: 1
>> > Date: Wed, 16 Jul 2014 12:29:14 -0700
>> > From: Cedar McKay <cmckay_at_uw.edu>
>> > Subject: Re: [StarCluster] apt-get 403 error
>> > To: David Mrva <davidm_at_cantabresearch.com>
>> > Cc: starcluster_at_mit.edu
>> > Message-ID: <4AF036EC-F558-4646-AD83-D30F8C0E4539_at_uw.edu>
>> > Content-Type: text/plain; charset=iso-8859-1
>> >
>> > This problem just went from bad to worse. Now it appears that even
>> > changing the sources.list file doesn't work. My guess is that ubuntu has
>> > withdrawn the 13.04 repos from their servers. That means that there is
>> now
>> > no way to install packages using apt-get that I'm aware of. This is a
>> big
>> > problem for my work.
>> >
>> > Does anyone have any advice for workarounds?
>> >
>> > I respectfully request that the starcluster folks create some 14.04
>> based
>> > AMIs, and retire the 13.04 based AMIs. I took a crack at it upgrading to
>> > 14.04, but failed, it was a bit over my head.
>> >
>> >
>> > best,
>> > Cedar
>> >
>> >
>> >
>> > On Jun 18, 2014, at 12:58 AM, David Mrva <davidm_at_cantabresearch.com>
>> > wrote:
>> >
>> > > Hello,
>> > >
>> > > The EC2 Ubuntu repository mirrors are down and according to
>> > communication from Canonical, they will not come up. This is because
>> 13.04
>> > is on a short support cycle, see
>> > >
>> >
>> http://fridge.ubuntu.com/2013/03/19/changes-in-ubuntu-releases-decided-by-the-ubuntu-technical-board/
>> > > and it has reached end of life in January 2014:
>> > https://wiki.ubuntu.com/Releases.
>> > >
>> > > This is very inconvenient. When I start a new spot instance with the
>> > loadbalancer, the pkginstaller plugin needs to install packages and the
>> > central (us.archive.ubuntu.com) repositories are not enabled by
>> default.
>> > >
>> > > Would it be possible to:
>> > > a/ always enable archive.ubuntu.com repositories to be used if EC2
>> > mirrors go down (or add an option to the pkginstall plugin to accept
>> > repository URLs to add to sources.list),
>> > > b/ add StarCluster AMIs with Ubuntu 14.10 LTS?
>> > >
>> > > Currently, out of the Ubuntu releases supported by StarCluster only
>> > 12.04 has not reached end-of-life:
>> > >
>> > > >>> Listing all public StarCluster images...
>> > >
>> > > 32bit Images:
>> > > -------------
>> > > [0] ami-b2badb82 us-west-2 starcluster-base-ubuntu-13.04-x86 (EBS)
>> > > [1] ami-0a6afe3a us-west-2 starcluster-base-ubuntu-12.04-x86 (EBS)
>> > > [2] ami-c2bd30f2 us-west-2 starcluster-base-ubuntu-11.10-x86 (EBS)
>> > >
>> > > 64bit Images:
>> > > --------------
>> > > [0] ami-04bedf34 us-west-2 starcluster-base-ubuntu-13.04-x86_64 (EBS)
>> > > [1] ami-80bedfb0 us-west-2 starcluster-base-ubuntu-13.04-x86_64-hvm
>> > (HVM-EBS)
>> > > [2] ami-486afe78 us-west-2 starcluster-base-ubuntu-12.04-x86_64-hvm
>> > (HVM-EBS)
>> > > [3] ami-706afe40 us-west-2 starcluster-base-ubuntu-12.04-x86_64 (EBS)
>> > > [4] ami-c6bd30f6 us-west-2 starcluster-base-ubuntu-11.10-x86_64 (EBS)
>> > >
>> > >
>> > > Best regards,
>> > > David
>> > >
>> > >
>> > >
>> > > On 09/06/2014 22:25, Stephen How wrote:
>> > >> All,
>> > >>
>> > >> For a temporary fix for the problem, I've edited my
>> > /etc/apt/sources.list file, fixing the URLs (shortening the hostname to
>> > archive.ubuntu.com).
>> > >>
>> > >> Then you can
>> > >> >apt-get update
>> > >> and
>> > >> >apt-get install (your-package)
>> > >>
>> > >> That'll work until the main issue is fixed
>> > (/etc/cloud/templates/sources.list.ubuntu.tmpl ?).
>> > >>
>> > >> Steve
>> > >>
>> > >> On Jun 9, 2014, at 2:03 PM, Stephen How <stephenhow_at_me.com> wrote:
>> > >>
>> > >>> I believe the URL changed to
>> > >>>
>> > >>>
>> >
>> http://archive.ubuntu.com/ubuntu/pool/main/s/sqlite3/sqlite3_3.7.15.2-1ubuntu1_amd64.deb
>> > >>>
>> > >>> I'm reading the manual on how to change the apt-get source URL :)
>> > >>>
>> > >>> Will update soon ...
>> > >>>
>> > >>> On Jun 9, 2014, at 2:01 PM, Cedar McKay <cmckay_at_uw.edu> wrote:
>> > >>>
>> > >>>> Same problem here.
>> > >>>>
>> > >>>>
>> > >>>> Cedar
>> > >>>>
>> > >>>> On Jun 9, 2014, at 1:37 PM, Stephen How <stephenhow_at_me.com> wrote:
>> > >>>>
>> > >>>>> Hello,
>> > >>>>>
>> > >>>>> Today I'm having trouble with apt-get install on the ami-56172513
>> > image [us-west-1 starcluster-base-ubuntu-13.04-x86_64 (EBS)].
>> > >>>>>
>> > >>>>> Usually, I apt-get install packages on this AMI without any
>> > problems. Today it looks like something changed.
>> > >>>>>
>> > >>>>> apt-get update didn't help
>> > >>>>>
>> > >>>>> Failed to fetch
>> >
>> http://us-west-1.ec2.archive.ubuntu.com/ubuntu/pool/main/s/sqlite3/sqlite3_3.7.15.2-1ubuntu1_amd64.deb
>> > 403 Forbidden
>> > >>>>>
>> > >>>>> Is this an ubuntu.com http archive issue? Can I point to some
>> > other package source?
>> > >>>>>
>> > >>>>> Thanks,
>> > >>>>> Steve
>> > >>>>>
>> > >>>>> root_at_master:~# apt-get install sqlite3
>> > >>>>> Reading package lists... Done
>> > >>>>> Building dependency tree
>> > >>>>> Reading state information... Done
>> > >>>>> Suggested packages:
>> > >>>>> sqlite3-doc
>> > >>>>> The following NEW packages will be installed:
>> > >>>>> sqlite3
>> > >>>>> 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
>> > >>>>> Need to get 29.2 kB of archives.
>> > >>>>> After this operation, 187 kB of additional disk space will be
>> used.
>> > >>>>> Err http://us-west-1.ec2.archive.ubuntu.com/ubuntu/ raring/main
>> > sqlite3 amd64 3.7.15.2-1ubuntu1
>> > >>>>> 403 Forbidden
>> > >>>>> Failed to fetch
>> >
>> http://us-west-1.ec2.archive.ubuntu.com/ubuntu/pool/main/s/sqlite3/sqlite3_3.7.15.2-1ubuntu1_amd64.deb
>> > 403 Forbidden
>> > >>>>> E: Unable to fetch some archives, maybe run apt-get update or try
>> > with --fix-missing?
>> > >>>>> _______________________________________________
>> > >>>>> StarCluster mailing list
>> > >>>>> StarCluster_at_mit.edu
>> > >>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>> > >>>
>> > >>> _______________________________________________
>> > >>> StarCluster mailing list
>> > >>> StarCluster_at_mit.edu
>> > >>> http://mailman.mit.edu/mailman/listinfo/starcluster
>> > >>
>> > >>
>> > >>
>> > >> _______________________________________________
>> > >> StarCluster mailing list
>> > >>
>> > >> StarCluster_at_mit.edu
>> > >> http://mailman.mit.edu/mailman/listinfo/starcluster
>> > >
>> > > _______________________________________________
>> > > StarCluster mailing list
>> > > StarCluster_at_mit.edu
>> > > http://mailman.mit.edu/mailman/listinfo/starcluster
>> >
>> >
>> >
>> >
>> > ------------------------------
>> >
>> > _______________________________________________
>> > StarCluster mailing list
>> > StarCluster_at_mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/starcluster
>> >
>> >
>> > End of StarCluster Digest, Vol 59, Issue 6
>> > ******************************************
>> >
>>
>>
>>
>> --
>>
>> b.
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL:
>> http://mailman.mit.edu/pipermail/starcluster/attachments/20150709/18a15e57/attachment-0001.htm
>>
>> ------------------------------
>>
>> Message: 2
>> Date: Thu, 9 Jul 2015 19:32:20 -0700
>> From: Boris Fain <boris_at_freecurve.com>
>> Subject: [StarCluster] createusers
>> To: starcluster_at_mit.edu
>> Message-ID:
>> <CAOxi5U7DNzj26s-FcHQecHNQ0eqMn3aeO=2_sMfR=
>> 2ikand-PA_at_mail.gmail.com>
>> Content-Type: text/plain; charset="utf-8"
>>
>> Hi -
>>
>> Thank you very much for a great package!
>>
>> I am having problems adding users to the cluster:
>>
>> boris_at_MacBook-Pro:~$ starcluster runplugin createusers md_cluster
>> StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
>> Software Tools for Academics and Researchers (STAR)
>> Please submit bug reports to starcluster_at_mit.edu
>>
>> !!! ERROR - Plugin "createusers" not found in config
>>
>> and in the plugins directory in the config file I have:
>>
>> [plugin createusers]
>> SETUP_CLASS = starcluster.plugins.users.CreateUsers
>> # # NUM_USERS = 5
>> usernames = boris, illarionov, kurnikov, leonidp, tatianap
>> DOWNLOAD_KEYS = True
>> download_keys_dir = /Users/boris/Work/strela/starcluster_ec2
>>
>> # # you can also comment out NUM_USERS and specify exact usernames, e.g.
>>
>> and, also, in the md_cluster definition:
>>
>> PLUGINS = sge, pkginstaller, createusers
>>
>> Any help much appreciated.
>>
>>
>> P.S. create volume does not find the default ami in us-west-2a but I just
>> did this manually.
>>
>> --
>>
>> b.
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL:
>> http://mailman.mit.edu/pipermail/starcluster/attachments/20150709/215b6040/attachment.htm
>>
>> ------------------------------
>>
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>>
>> End of StarCluster Digest, Vol 71, Issue 8
>> ******************************************
>>
>
>
>
> --
>
> b.
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
Received on Fri Jul 10 2015 - 07:58:23 EDT
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject