Re: [Starcluster] Configure cluster with lam/mpi?

From: markos calderon <no email>
Date: Sun, 27 Jun 2010 20:37:50 -0500

Hi,

I have a related question, are these instructions also posible for
installing MPICH?... or is there a StarCluster MPICH version? =D

Thanks in advance...


On Wed, Jun 2, 2010 at 1:21 PM, Justin Riley <jtriley_at_mit.edu> wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Hi Jun-Wei,
>
> Just following up, I took a quick look and found that lam is actually
> included in the Ubuntu repos. So, my instructions are now modified as:
>
> 1. launch a single instance of the StarCluster AMI with ElasticFox or
> the AWS management console
>
> 2. Log into this instance as root and run the following command to
> uninstall OpenMPI:
>
> $ apt-get remove libopenmpi-dbg libopenmpi-dev \
> libopenmpi1.3openmpi-bin openmpi-common openmpi-doc
>
> 3. Install lam by running:
>
> $ apt-get install lam4-dev
>
> 4. Log out of the instance and use StarCluster's createimage command, e.g:
>
> $ starcluster createimage i-99999 mybucket myimagename
>
> 5. Use the newly created AMI id in one of your cluster templates in the
> config file.
>
> 6. Launch a cluster using that cluster template.
>
> 7. Login to the master node and edit /etc/lam/lam-bhost.def and add all
> node aliases on a new line, e.g:
>
> # ...
> # This file is part of the LAM/MPI software package. For license
> # information, see the LICENSE file in the top level directory of the
> # LAM/MPI source distribution.
> #
> # $HEADER$
> #
> # Function: - bhost.def
> # - a single-node LAM
> #
>
> master
> node001
> ...
>
> 8. Save that file and run "lamboot" command as normal user to start the
> lam daemons.
>
> 9. Compile and run your code :D
>
> I'm considering creating a LAM image and sharing it publicly. Would
> anyone else be interested in this?
>
> ~Justin
>
>
> On 06/02/2010 02:08 PM, Justin Riley wrote:
> > Hi Jun-Wei,
> >
> > StarCluster currently comes with OpenMPI 1.3.2 so it's hard to tell if
> > the results/conclusions from that paper are still valid without
> > re-running their tests.
> >
> > With that said, we've chosen OpenMPI because it's the successor of LAM
> > and is also provided by the default Ubuntu package repository. It also
> > comes with support for integrating with Sun Grid Engine. These things
> > combined make OpenMPI much more attractive from a packaging/support
> > perspective.
> >
> > However, StarCluster does not limit you to using OpenMPI provided you're
> > willing to install LAM yourself. You *should* be able to install LAM by
> > launching an instance of the StarCluster AMI, removing OpenMPI and
> > installing LAM, and then re-bundling the AMI. Here are some detailed
> > instructions:
> >
> > 1. launch a single instance of the StarCluster AMI with ElasticFox or
> > the AWS management console
> >
> > 2. Log into this instance as root and run the following command to
> > uninstall OpenMPI:
> >
> > $ apt-get remove libopenmpi-dbg libopenmpi-dev \
> > libopenmpi1.3openmpi-bin openmpi-common openmpi-doc
> >
> > 3. Download and install LAM on the instance manually
> >
> > 4. Log out of the instance and use StarCluster's createimage command,
> e.g:
> >
> > $ starcluster createimage i-99999 mybucket myimagename
> >
> > 5. Use the newly created AMI id in one of your cluster templates in the
> > config file.
> >
> > 6. Launch a cluster using that cluster template and give it a shot
> >
> > If you decide to go this route please keep the list informed on your
> > progress. If you're successful and find the performance to be better
> > I'll consider making a separate AMI for LAM and posting it on the
> website.
> >
> > Hope that helps,
> >
> > ~Justin
> >
> > On 06/02/2010 01:27 PM, Huang, Jun-Wei wrote:
> >> Hello:
> >> I have followed the StarCluster's documentation and created a small
> >> cluster successfully. I notice that only openmpi is available on the
> >> virtual cluster. According to the abstract by Constantinos Evangelinos
> >> and Chris Hill (2008), they found openmpi 1.2.6 does not work and
> >> lam/mpi has the lowest latency. My question is that are their
> >> observations still hold true for the virtual cluster created using
> >> StarCluster? If so, what is the way to add lam/mpi implementation to the
> >> virtual cluster. Thank you very much.
> >
> >> Best wishes,
> >> Junwei
> >
> >
> >
> >
> >> _______________________________________________
> >> Starcluster mailing list
> >> Starcluster_at_mit.edu
> >> http://mailman.mit.edu/mailman/listinfo/starcluster
> >
> _______________________________________________
> Starcluster mailing list
> Starcluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.14 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAkwGoTwACgkQ4llAkMfDcrkj5gCgkr9AU37pn3qR+hT5xfTw5LHh
> TigAniPzTPJpxTXlPsBCNfQ9ONpHHm7N
> =wsdC
> -----END PGP SIGNATURE-----
> _______________________________________________
> Starcluster mailing list
> Starcluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>

-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Markos Calderon
TAWS http://www.taws.espol.edu.ec
BigBlueButton http://github.com/bigbluebutton/bigbluebutton
Skype: markos.calderon
Facebook: http://www.facebook.com/markos.calderon
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Received on Sun Jun 27 2010 - 21:38:12 EDT