Re: Using DRMAA on StarCluster

From: Justin Riley <no email>
Date: Tue, 31 Jul 2012 12:21:42 -0400

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Chris/Min,

I'm super behind on responding to mailing list threads. Apologies to all!

You're correct that DRMAA_LIBRARY_PATH has to be exported. Fortunately
this is already fixed in the latest github version of StarCluster via
the following merged PR from jakebiesinger:

https://github.com/jtriley/StarCluster/pull/122

HTH,

~Justin

On 07/29/2012 08:25 PM, Chris Diehl wrote:
> FYI I was able to successfully submit a job following the
> tutorial. Note that if you start with the "Running a job" example,
> you will need a "s.initialize()" statement after "s =
> drmaa.Session()".
>
> Chris
>
> On Sun, Jul 29, 2012 at 5:16 PM, Chris Diehl <cpdiehl_at_gmail.com>
> wrote:
>> This export statement seems to solve the problem I was having.
>> export
>> DRMAA_LIBRARY_PATH="/opt/sge6-fresh/lib/linux-x64/libdrmaa.so.1.0"
>>
>>
>>
>>
>>
>>
>>
Going to try the tutorial example for submitting a job now.
>> http://code.google.com/p/drmaa-python/wiki/Tutorial
>>
>> On Sun, Jul 29, 2012 at 5:13 PM, MinRK <benjaminrk_at_gmail.com>
>> wrote:
>>> From IPython's perspective, I would love to use a Python
>>> library, rather than qsub via a subprocess to launch engines
>>> with SGE in ipcluster.
>>>
>>> On Sun, Jul 29, 2012 at 4:56 PM, Chris Diehl
>>> <cpdiehl_at_gmail.com> wrote:
>>>>
>>>> Hi Justin,
>>>>
>>>> Should I be able to use DRMAA on a StarCluster instance to
>>>> submit jobs from Python to the Grid Engine? It appears
>>>> drmaa-python is installed. When I try to do an "import
>>>> drmaa", I get the following response.
>>>>
>>>> root_at_master:/usr# python Python 2.7.2+ (default, Oct 4 2011,
>>>> 20:06:09) [GCC 4.6.1] on linux2 Type "help", "copyright",
>>>> "credits" or "license" for more information.
>>>>>>> import drmaa
>>>> Traceback (most recent call last): File "<stdin>", line 1, in
>>>> <module> File
>>>> "/usr/local/lib/python2.7/dist-packages/drmaa/__init__.py",
>>>> line 41, in <module> import drmaa.wrappers as _w File
>>>> "/usr/local/lib/python2.7/dist-packages/drmaa/wrappers.py",
>>>> line 43, in <module> raise RuntimeError(errmsg) RuntimeError:
>>>> could not find drmaa library. Please specify its full path
>>>> using the environment variable DRMAA_LIBRARY_PATH
>>>>>>>
>>>>
>>>> The Python DRMAA library looked like a good way to submit and
>>>> monitor jobs running in SGE from Python. So I'd like to get
>>>> this up and running if possible.
>>>>
>>>> Any suggestions you have would be most appreciated!
>>>>
>>>> Chris _______________________________________________
>>>> StarCluster mailing list StarCluster_at_mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>
>>>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAlAYBhYACgkQ4llAkMfDcrnFCwCggmH6TgrdphtjoZtj5N3UOiCd
n+wAn1goL7qVRVtGVA0jk3JkPHdfjhw6
=vWll
-----END PGP SIGNATURE-----
Received on Tue Jul 31 2012 - 12:21:45 EDT