Re: MIT StarCluster and the new C3 instances

From: Sergio Mafra <no email>
Date: Wed, 27 Nov 2013 17:40:26 -0200

Hi fellows,

I´ve talked to Jeff Barr and he told me that EC2 group said to him:
"Ø C3.8xl instance is indeed on 10GB network like CC2. We don’t have it
correctly described on our website and console."

So someone has to change the code to put c3.8xlarge in the placement group.

All best,

Sergio Mafra



On Wed, Nov 27, 2013 at 4:47 PM, Sergio Mafra <sergiohmafra_at_gmail.com>wrote:

> I´m a little confused about the c3.8xlarge instance.
> Despite all documentation that tell us that this runs on a 1 Gb network,
> AWS told me today that it really runs on a 10 Gb network...
> Does anybody has more info on that?
>
>
>
> On Mon, Nov 25, 2013 at 3:42 PM, Rayson Ho <raysonlogin_at_gmail.com> wrote:
>
>> Thanks Sergio, I check the docs the day when c3 was announced, there's
>> no mention of placement group support for c3. I think I was reading
>> the older version of the doc.
>>
>> Yuichi, we can't take advantage of SR-IOV (yet) as we don't run in a VPC.
>>
>> Rayson
>>
>> ==================================================
>> Open Grid Scheduler - The Official Open Source Grid Engine
>> http://gridscheduler.sourceforge.net/
>> http://gridscheduler.sourceforge.net/GridEngine/GridEngineCloud.html
>>
>>
>> On Mon, Nov 25, 2013 at 9:39 AM, Yoshiara, Yuichi <yoshiara_at_amazon.co.jp>
>> wrote:
>> >
>> > Hi Sergio,
>> >
>> >
>> >
>> > There is a new feature called Enhanced Networking which is available in
>> C3 instances.
>> >
>> > Please read through the link below and see if it helps you.
>> >
>> >
>> >
>> >
>> http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/enhanced-networking.html
>> >
>> >
>> >
>> >
>> http://aws.amazon.com/ec2/faqs/#What_networking_capabilities_are_included_in_this_feature
>> >
>> >
>> >
>> > Yuichi Yoshiara
>> >
>> >
>> >
>> >
>> >
>> > From: starcluster-bounces_at_mit.edu [mailto:starcluster-bounces_at_mit.edu]
>> On Behalf Of Sergio Mafra
>> > Sent: Monday, November 25, 2013 8:16 PM
>> > To: Rayson Ho; starcluster_at_mit.edu
>> > Subject: Re: [StarCluster] MIT StarCluster and the new C3 instances
>> >
>> >
>> >
>> > Hi Rayson,
>> >
>> >
>> >
>> > I noticed that StarCluster didn´t allocate a placement group for C3
>> instances and did it by myself in the code.
>> >
>> > But this was not helpfull since C3 instances uses high throughput
>> insted of the 10 giga network.
>> >
>> > In my tests, using C3 or CC2 in a cluster config where MPI is required
>> will be equal to same processing time.
>> >
>> > Hope that AWS put them on 10 Giga net in the near future.
>> >
>> >
>> >
>> >
>> >
>> > Compute optimized
>> >
>> > c3.8xlarge
>> >
>> > 64-bit
>> >
>> > Intel Xeon E5-2680
>> >
>> > 32
>> >
>> > 108
>> >
>> > 60.00
>> >
>> > 640 GB (2 x 320 SSD)
>> >
>> > -
>> >
>> > 240
>> >
>> > High
>> >
>> > Compute optimized
>> >
>> > cc2.8xlarge
>> >
>> > 64-bit
>> >
>> > Intel Xeon E5-2670
>> >
>> > 32
>> >
>> > 88
>> >
>> > 60.50
>> >
>> > 3370 GB (4 x 840)
>> >
>> > -
>> >
>> > 240
>> >
>> > 10 Gigabit
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Mon, Nov 18, 2013 at 7:13 PM, Sergio Mafra <sergiohmafra_at_gmail.com>
>> wrote:
>> >
>> > Hi Rayson,
>> >
>> >
>> >
>> > I´ll try to do that.
>> >
>> >
>> >
>> > All best,
>> >
>> >
>> >
>> > Sergio
>> >
>> >
>> >
>> > On Mon, Nov 18, 2013 at 1:27 PM, Rayson Ho <raysonlogin_at_gmail.com>
>> wrote:
>> >
>> > It's in the development branch:
>> >
>> > https://github.com/jtriley/StarCluster/pull/325
>> >
>> > It's a few lines of code, and you can merge the changes into your
>> > local version very easily.
>> >
>> > Rayson
>> >
>> > ==================================================
>> > Open Grid Scheduler - The Official Open Source Grid Engine
>> > http://gridscheduler.sourceforge.net/
>> > http://gridscheduler.sourceforge.net/GridEngine/GridEngineCloud.html
>> >
>> >
>> >
>> > On Mon, Nov 18, 2013 at 8:29 AM, Sergio Mafra <sergiohmafra_at_gmail.com>
>> wrote:
>> > > Hi everyone,
>> > >
>> > > I attended AWS Re:Invent this year and liked a lot. Right place to go.
>> > > AWS announced there the new C3 family of HPC instances.
>> > > I´m anxious to test them in my models but I understand that
>> StarCluster must
>> > > take aware of them in the code.
>> > > So when will be the C3s available?
>> > >
>> > > All the best,
>> > >
>> > > Sergio Mafra
>> > >
>> >
>> > > _______________________________________________
>> > > StarCluster mailing list
>> > > StarCluster_at_mit.edu
>> > > http://mailman.mit.edu/mailman/listinfo/starcluster
>> > >
>> >
>> >
>> >
>> >
>>
>
>
Received on Wed Nov 27 2013 - 14:40:30 EST