StarCluster - Mailing List Archive

Re: Starcluster and elastic load balancing

From: Rajat Banerjee <no email>
Date: Fri, 28 Jan 2011 13:31:53 -0500

Hi Archie,
Yes, there is ELB built into the latest releases of StarCluster. I wrote it,
so feel free to write me (+ the list) with any questions.

The docs on
http://web.mit.edu/stardev/cluster/docs/index.html

haven't been updated in a while. There is a documentation page on
starcluster in the code base, see
/starcluster/StarCluster/docs/sphinx/load_balancer.rst

That doc should have all of the information you need, and is readable in
plain text.

Typically, this is how I fire up the load balancer:
starcluster bal <cluster_tag> -m <MAX_NODES you want> -n <MIN_NODES you
want>

It will poll the cluster every 60 seconds and make decisions. The decisions
are described in load_balancer.rst. There is a visualizer which makes 6
graphs with matplotlib to show you how many nodes are working, how many jobs
are running, queued, avg load, etc, but the visualizer still needs a little
bit of work.

Hope that helps, and feel free to send back questions.
Rajat Banerjee


On Fri, Jan 28, 2011 at 12:29 PM, <starcluster-request_at_mit.edu> wrote:

> Send StarCluster mailing list submissions to
> starcluster_at_mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/starcluster
> or, via email, send a message with subject or body 'help' to
> starcluster-request_at_mit.edu
>
> You can reach the person managing the list at
> starcluster-owner_at_mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of StarCluster digest..."
>
> Today's Topics:
>
> 1. Starcluster and elastic load balancing (Archie Russell)
>
>
> ---------- Forwarded message ----------
> From: Archie Russell <archier_at_gmail.com>
> To: starcluster_at_mit.edu
> Date: Thu, 27 Jan 2011 11:40:00 -0800
> Subject: [StarCluster] Starcluster and elastic load balancing
>
> Hi,
>
> Online it says Starcluster has Elastic Load Balancing built into the
> latest code
> version at Github. How would I go about using this? How does
> it work, e.g.
> when does it fire up new nodes and when does it shut them down?
>
> Thanks,
> Archie
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
>
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
Received on Fri Jan 28 2011 - 13:32:14 EST
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject