Re: No panic, but Disco is now available with starcluster

From: Don MacMillen <no email>
Date: Fri, 30 Mar 2012 14:48:34 -0700

Hi Justin,

Great ideas, Justin. It is all very doable. One of Chris' points
was that Disco is a lot easier to install than Hadoop. He did not
mention any gotcha's on the install but I will ask. Let me know
if there is anything I can help you with.

Regards,

Don

On Fri, Mar 30, 2012 at 9:32 AM, Justin Riley <jtriley_at_mit.edu> wrote:
> Hi Don,
>
> Awesome stuff, thanks for sharing! I'm definitely interested in
> integrating disco with the next round of AMIs and including the disco
> plugin with StarCluster. I'm thinking we should also support installing
> disco from the plugin to support the current SC AMIs until new AMIs can
> be released. Not sure how hairy the install process is but if it's not
> too bad it's probably worth doing. I'll look into this but any gotchas I
> should know about?
>
> Thanks again for sharing!
>
> ~Justin
>
> On Wed, Mar 28, 2012 at 06:44:40PM -0700, Don MacMillen wrote:
>> Hi All,
>>
>> For those who'd like to try an alternative to Hadoop, Chris Mueller
>> has put together
>> a StarCluster image with Disco (an alternative, open source map-reduce system
>> from Nokia Research, more at http://discoproject.org/ ) and a plugin for it.
>> It's a great Python way into map-reduce.
>>
>> The post to the disco group is here and it has the link to github and a link to
>> a video of Chris' talk at the PyData  Workshop.
>>
>> http://groups.google.com/group/disco-dev/browse_thread/thread/50d6d8de5cfce252
>>
>> Don
>>
>> PS: Although I helped with the plugin, my ability to help with Disco
>> may be limited.
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
Received on Fri Mar 30 2012 - 17:48:37 EDT