Re: loadbalancer race condition with plugin.on_add_node()

From: Rajat Banerjee <no email>
Date: Mon, 21 Feb 2011 16:38:08 -0500

Hi Jeff,
Your assumption seems correct. I know a lot about ELB but very little about
plugins. I know Justin is still very busy so may not get to your question
soon.

>From the looks of things, you could add plugin code to:
starcluster/cluster.py : line 788-789

OR

starcluster/clustersetup.py: line 473

As a stop gap until there is time to add something more formal and check it
in.
Let us know if that works for you temporarily.
Raj


On Mon, Feb 21, 2011 at 2:50 PM, Jeff White <jeff_at_decide.com> wrote:

> I believe there is a race condition when nodes are added via the
> loadbalancer. The configured plugins are run after the new node is added to
> SGE. The issue is our plugin needs to do some setup on the new node before
> jobs get submitted to the new node. It would be better if plugins were run
> before the node is available to run jobs. If there is a use case for running
> a plugin after the node is added to SGE, then more hooks should be added,
> e.g. on_add_node_before_sge(), on_add_node_after_sge().
>
> jeff
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
Received on Mon Feb 21 2011 - 16:38:29 EST