StarCluster - Mailing List Archive

Re: Adding new nodes to hadoop cluster

From: Justin Riley <no email>
Date: Tue, 31 Jul 2012 13:54:32 -0400

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Håvard,

Unfortunately the Hadoop plugin doesn't currently implement the
on_add_node and on_remove_node methods which is why new nodes are not
configured to work with the existing Hadoop cluster. We need to
experiment with this and see what's required to add a node to the
cluster. I've created an issue to keep track of this:

https://github.com/jtriley/StarCluster/issues/131

If you have time to experiment with the steps needed to manually add a
node to the Hadoop cluster and then comment on the issue with the
necessary steps I can translate that to plugin code. Otherwise this
will need to wait until I have time to experiment...

~Justin

On 06/27/2012 05:31 AM, Håvard Wahl Kongsgård wrote:
> Hi, when adding nodes
> (http://web.mit.edu/star/cluster/docs/latest/manual/addremovenode.html)
>
>
to a hadoop cluster, starcluster skips the hadoop part. Therefore the
> new nodes will not be configured to work with the rest of the
> hadoop cluster. Is it possible to correct this behavior?
>
> -Håvard
>
> _______________________________________________ StarCluster mailing
> list StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAlAYG9gACgkQ4llAkMfDcrkGEwCeLyIRH8e1E1IGm2z81rqde+ra
E74An06lKcDnz2FHD9Gj4xe04JfFbbtB
=8Jjc
-----END PGP SIGNATURE-----
Received on Tue Jul 31 2012 - 13:54:35 EDT
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject