Re: No panic, but Disco is now available with starcluster
This archive was generated by
Great ideas, Justin. It is all very doable. One of Chris' points
was that Disco is a lot easier to install than Hadoop. He did not
mention any gotcha's on the install but I will ask. Let me know
if there is anything I can help you with.
On Fri, Mar 30, 2012 at 9:32 AM, Justin Riley <jtriley_at_mit.edu> wrote:
> Hi Don,
> Awesome stuff, thanks for sharing! I'm definitely interested in
> integrating disco with the next round of AMIs and including the disco
> plugin with StarCluster. I'm thinking we should also support installing
> disco from the plugin to support the current SC AMIs until new AMIs can
> be released. Not sure how hairy the install process is but if it's not
> too bad it's probably worth doing. I'll look into this but any gotchas I
> should know about?
> Thanks again for sharing!
> On Wed, Mar 28, 2012 at 06:44:40PM -0700, Don MacMillen wrote:
>> Hi All,
>> For those who'd like to try an alternative to Hadoop, Chris Mueller
>> has put together
>> a StarCluster image with Disco (an alternative, open source map-reduce system
>> from Nokia Research, more at http://discoproject.org/ ) and a plugin for it.
>> It's a great Python way into map-reduce.
>> The post to the disco group is here and it has the link to github and a link to
>> a video of Chris' talk at the PyData Workshop.
>> PS: Although I helped with the plugin, my ability to help with Disco
>> may be limited.
>> StarCluster mailing list
Received on Fri Mar 30 2012 - 17:48:37 EDT