Re: ERROR - "Incorrect padding" in listclusters command (github version)

From: Justin Riley <no email>
Date: Tue, 15 Mar 2011 18:04:04 -0400

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Kyeong,

Could you please login to the Amazon Console and remove any security
groups that start with '_at_sc'? This is likely what's causing the issue.
The latest github version stores some cluster meta-data in the security
group's description field for convenience. I've been experimenting with
the format a bit which causes this issue from time to time for folks
using the github version.

Let me know if that works...

~Justin

On 03/15/2011 05:54 PM, Kyeong Soo (Joseph) Kim wrote:
> Justin,
>
> Today I tested this with the newest version from github and
> encountered exactly the same error (i.e., incorrect padding) as
> before.
> To make sure, I started from scratch (including new configure file
> from the new version of starcluster), but the result was the same.
>
> By the way, it doesn't matter whether there is any running cluster or not.
>
> Regards,
> Joseph
>
>
> On Thu, Feb 3, 2011 at 3:06 PM, Justin Riley <justin.t.riley_at_gmail.com> wrote:
>> Joseph,
>>
>> The version number when using the github version will always be 9999
>> (because it's the development version).
>>
>> ~Justin
>>
>> On Wed, Feb 2, 2011 at 6:32 AM, Kyeong Soo (Joseph) Kim
>> <kyeongsoo.kim_at_gmail.com> wrote:
>>> Hi Justin,
>>> No need to apologize!
>>> I could understand how busy you were as I myself started classes this week
>>> here in the UK.
>>> Per your instruction, I will try it again and report back, if needed.
>>> Many thanks for your detailed response,
>>> Joseph
>>> P.S.
>>> How can I know the version number?
>>> I just did 'git pull', installed it ('sudo python setup.py install'), and
>>> typed 'starcluster --version'.
>>> The version number returned, however, is '0.9999', exactly the same as
>>> before.
>>>
>>> On Tue, Feb 1, 2011 at 5:20 PM, Justin Riley <justin.t.riley_at_gmail.com>
>>> wrote:
>>>>
>>>> Hi Kyeong,
>>>>
>>>> I apologize for the delay in responding, the last few weeks have been
>>>> insanely busy as classes are starting at MIT and we've been busy
>>>> preparing.
>>>>
>>>> The error you received is because the latest github code is not
>>>> compatible with clusters started using the 0.91.2 version of
>>>> StarCluster. The patch you provided does get around the problem
>>>> however it prevents the code from working as intended. To properly fix
>>>> this you need to remove any old clusters you started with the 0.91.2
>>>> version. You should then be able to use the development version
>>>> without your patch. I'm working to put in some logistics that will
>>>> prompt users with an error detailing this issue and how to fix it.
>>>>
>>>> Thanks for reporting,
>>>>
>>>> ~Justin
>>>>
>>>> On Fri, Jan 14, 2011 at 1:55 PM, Kyeong Soo (Joseph) Kim
>>>> <kyeongsoo.kim_at_gmail.com> wrote:
>>>>> After some debugging, I found out the cause of the said problem. Below
>>>>> is
>>>>> the output from "git diff":
>>>>> ================================================
>>>>> diff --git a/starcluster/cluster.py b/starcluster/cluster.py
>>>>> index 0e820a7..436ae44 100644
>>>>> --- a/starcluster/cluster.py
>>>>> +++ b/starcluster/cluster.py
>>>>> _at_@ -544,7 +544,7 @@ class Cluster(object):
>>>>> description field.
>>>>> """
>>>>> try:
>>>>> - compressed_data =
>>>>> base64.b64decode(self.cluster_group.description)
>>>>> + compressed_data =
>>>>> base64.b64encode(self.cluster_group.description)
>>>>> pkl_data = zlib.decompress(compressed_data)
>>>>> cluster_settings = cPickle.loads(str(pkl_data)).__dict__
>>>>> for key in cluster_settings:
>>>>> ================================================
>>>>> As you can see, "base64.b64decode" should have been "base64.b64encode"
>>>>> in
>>>>> line 547.
>>>>> Regards,
>>>>> Joseph
>>>>>
>>>>>
>>>>> On Thu, Jan 13, 2011 at 3:02 PM, Kyeong Soo (Joseph) Kim
>>>>> <kyeongsoo.kim_at_gmail.com> wrote:
>>>>>>
>>>>>> Hello Justin and All,
>>>>>> Another bug report for the development version from github.
>>>>>> Here below is the error message from "listclusters" command:
>>>>>> =============================================
>>>>>> ~$ starcluster listclusters
>>>>>> StarCluster - (http://web.mit.edu/starcluster) (v. 0.9999)
>>>>>> Software Tools for Academics and Researchers (STAR)
>>>>>> Please submit bug reports to starcluster_at_mit.edu
>>>>>> cli.py:156 - ERROR - failed to load cluster receipt: Incorrect padding
>>>>>> =============================================
>>>>>> With the development version, I could go through all the examples in
>>>>>> the
>>>>>> documentation -- which means there is no problem with the account
>>>>>> credentials -- but the listcluster command.
>>>>>> By the way, the development version seems quite stable and provides
>>>>>> much
>>>>>> more information in the configuration template than the stable one
>>>>>> (e.g.,
>>>>>> the updated information on the use of AMIs in different zones/regions).
>>>>>> Regards,
>>>>>> Joseph
>>>>>
>>>>> _______________________________________________
>>>>> StarCluster mailing list
>>>>> StarCluster_at_mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> StarCluster mailing list
>>>> StarCluster_at_mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>
>>>
>>
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster_at_mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>
> _______________________________________________
> StarCluster mailing list
> StarCluster_at_mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk1/4lQACgkQ4llAkMfDcrkelQCeIeHyz4ms+HLDZxAjTZ0Sb57U
5Q8Anib5yvYa9+kbnr3WLoMERVmO8ByI
=1zjl
-----END PGP SIGNATURE-----
Received on Tue Mar 15 2011 - 18:04:28 EDT