StarCluster - Mailing List Archive

IOError: [Errno 13] Permission denied

From: Alessandro Gagliardi <no email>
Date: Wed, 15 May 2013 13:16:02 -0700

I tried starting over (incase something got fubared in my previous config)
and this time installed the development version from git. When I tried
starting a cluster in us-west-2, I got the following error:

!!! ERROR - Error occured while running plugin 'ipcluster':
!!! ERROR - Unhandled exception occured
Traceback (most recent call last):
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cli.py",
line 257, in main
    sc.execute(args)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/commands/start.py",
line 197, in execute
    validate_running=validate_running)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cluster.py",
line 1460, in start
    return self._start(create=create, create_only=create_only)
  File "<string>", line 2, in _start
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/utils.py",
line 92, in wrap_f
    res = func(*arg, **kargs)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cluster.py",
line 1483, in _start
    self.setup_cluster()
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cluster.py",
line 1492, in setup_cluster
    self._setup_cluster()
  File "<string>", line 2, in _setup_cluster
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/utils.py",
line 92, in wrap_f
    res = func(*arg, **kargs)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cluster.py",
line 1504, in _setup_cluster
    self.run_plugins()
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cluster.py",
line 1522, in run_plugins
    self.run_plugin(plug, method_name=method_name, node=node)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/cluster.py",
line 1547, in run_plugin
    func(*args)
  File "<string>", line 2, in run
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/utils.py",
line 92, in wrap_f
    res = func(*arg, **kargs)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/plugins/ipcluster.py",
line 283, in run
    self._start_notebook(master, user, profile_dir)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/plugins/ipcluster.py",
line 232, in _start_notebook
    master.ssh.makedirs(self.notebook_directory)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/sshutils/__init__.py",
line 221, in makedirs
    self.makedirs(head, mode)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/sshutils/__init__.py",
line 221, in makedirs
    self.makedirs(head, mode)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/sshutils/__init__.py",
line 221, in makedirs
    self.makedirs(head, mode)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/sshutils/__init__.py",
line 229, in makedirs
    self.mkdir(path, mode)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/StarCluster-0.9999-py2.7.egg/starcluster/sshutils/__init__.py",
line 240, in mkdir
    return self.sftp.mkdir(path, mode)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/paramiko-1.10.1-py2.7.egg/paramiko/sftp_client.py",
line 303, in mkdir
    self._request(CMD_MKDIR, path, attr)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/paramiko-1.10.1-py2.7.egg/paramiko/sftp_client.py",
line 689, in _request
    return self._read_response(num)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/paramiko-1.10.1-py2.7.egg/paramiko/sftp_client.py",
line 736, in _read_response
    self._convert_status(msg)
  File
"/Users/alessandro/.envs/starcluster/lib/python2.7/site-packages/paramiko-1.10.1-py2.7.egg/paramiko/sftp_client.py",
line 764, in _convert_status
    raise IOError(errno.EACCES, text)
IOError: [Errno 13] Permission denied

---------- Forwarded message ----------
From: Alessandro Gagliardi <alessandro_at_path.com>
Date: Wed, May 15, 2013 at 10:04 AM
Subject: !!! ERROR - command 'DEBIAN_FRONTEND='noninteractive' apt-get -o
Dpkg::Options::='--force-confnew' . . . failed with status 100
To: "starcluster_at_mit.edu" <starcluster_at_mit.edu>


Hello all,

I've been having trouble with the pkginstaller plugin recently. I get the
following error when it tries to install packages:

> !!! ERROR - command 'DEBIAN_FRONTEND='noninteractive' apt-get -o
> Dpkg::Options::='--force-confnew' -y --force-yes install g++ gfortran
> git-core subversion python-all-dev python-virtualenv mongodb libblas-dev
> liblapack-dev libatlas-dev r-base-core cython python-dateutil
> python-requests python-pymongo python-rpy2 python-nltk r-base-core
> mysql-client build-essential python-setuptools python-dev python-numpy
> python-matplotlib prover9 python-scipy python-tz python-pandas
> python-mysqldb libsnappy-dev python-xlwt msgpack-python lzop libpq-dev
> python-psycopg2' failed with status 100

I thought the problem might be because I was trying to start an Anaconda
cluster using https://github.com/ContinuumIO/anaconda-ec2 but I tried
spinning up a vanilla StarCluster just now and had the same problem. I also
thought that it might be one of the packages causing a problem, but even
when I reduced it to just g++ I got the same error. Any thoughts on how to
fix would be greatly appreciated.

-- 
Alessandro Gagliardi
Data Scientist / Analytics Engineer
Path, Inc.
alessandro_at_path.com
-- 
Alessandro Gagliardi
Data Scientist / Analytics Engineer
Path, Inc.
alessandro_at_path.com



Received on Wed May 15 2013 - 16:16:48 EDT
This archive was generated by hypermail 2.3.0.

Search:

Sort all by:

Date

Month

Thread

Author

Subject