virtualenv fails to create virtual environment from Homebrew-installed Python 3.4.3 #779

carloslbello · 2015-08-01T00:44:06Z

When I try to create a virtual environment with Python 3.4.3, virtualenv errors out:

Running virtualenv with interpreter /usr/local/bin/python3.4
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 23, in <module>
    import subprocess
  File "/usr/local/Cellar/python3/3.4.3_2/Frameworks/Python.framework/Versions/3.4/lib/python3.4/subprocess.py", line 405, in <module>
    import _posixsubprocess
ImportError: dlopen(/usr/local/lib/python2.7/site-packages/_posixsubprocess.so, 2): Symbol not found: _PyString_AsString
  Referenced from: /usr/local/lib/python2.7/site-packages/_posixsubprocess.so
  Expected in: flat namespace
 in /usr/local/lib/python2.7/site-packages/_posixsubprocess.so

I've found another reference to the exact same error on StackOverflow, with the only answer suggesting to add the --no-site-packages argument. Looking through virtualenv -h, I see that not only is it deprecated, it doesn't change the setting, as its functionality is currently the default. Predictably, this does not help.

The text was updated successfully, but these errors were encountered:

tdsmith · 2015-08-01T05:26:53Z

What's your PYTHONPATH look like? It looks like the problem is that your python 3 is loading modules built for python 2.7.

ionelmc · 2015-08-01T13:55:18Z

Seems similar to #705

carloslbello · 2015-08-01T20:46:13Z

Doing echo $PYTHONPATH resulted in a blank line.

This is needed to particularly when a new interpreter is used, via -p/--python. Re-execing the same `virtualenv.py` will generally lead to its path being added to the start of sys.path (as usual). And usually its path will be the site-packages of the previous interpreter. This will lead to issues if older backported packages are present in the old environment (which will then get preference being imported). Should fix pypa#779, pypa#774, pypa#763

Ivoz · 2015-10-02T11:07:32Z

@Aarzee would appreciate if you could check if above commit solves the issue

https://github.com/Ivoz/virtualenv/archive/early-syspath-removal.zip

This is needed to particularly when a new interpreter is used, via -p/--python. Re-execing the same `virtualenv.py` will generally lead to its path being added to the start of sys.path (as usual). And usually its path will be the site-packages of the previous interpreter. This will lead to issues if older backported packages are present in the old environment (which will then get preference being imported). Should fix pypa#779, pypa#774, pypa#763

carloslbello · 2015-10-02T14:01:34Z

Unfortunately, yesterday I upgraded to El Capitan, and pyenv is failing to install 3.4.3 (which is now unavailable via Homebrew). I can't reproduce the bug with current PyPI virtualenv when making a Python 3.5 environment.

This is needed particularly when a new interpreter is used, via -p/--python. Re-execing the same `virtualenv.py` will generally lead to its path being added to the start of sys.path (as usual). And usually its path will be the site-packages of the previous interpreter. This will lead to issues if older backported packages are present in the old environment (which will then get preference being imported). Should fix pypa#779, pypa#774, pypa#763

vmarquet · 2016-09-26T11:53:12Z

I'm having the exact same issue, can someone please reopen?

$ virtualenv -p /usr/local/bin/python3 test
Running virtualenv with interpreter /usr/local/bin/python3
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 27, in <module>
    import subprocess
  File "/usr/local/Cellar/python3/3.4.3_2/Frameworks/Python.framework/Versions/3.4/lib/python3.4/subprocess.py", line 405, in <module>
    import _posixsubprocess
ImportError: dlopen(/Library/Python/2.7/site-packages/_posixsubprocess.so, 2): Symbol not found: _PyString_AsString
  Referenced from: /Library/Python/2.7/site-packages/_posixsubprocess.so
  Expected in: flat namespace
 in /Library/Python/2.7/site-packages/_posixsubprocess.so

Other details:

Mac OS X, 10.11.6
$ echo $PYTHONPATH => /Library/Python/2.7/site-packages:
Python3 installed with brew:

$ brew info python3
python3: stable 3.5.2 (bottled), devel 3.6.0a3, HEAD
Interpreted, interactive, object-oriented programming language
https://www.python.org/
/usr/local/Cellar/python3/3.4.3_2 (4,773 files, 69.2M)
  Poured from bottle on 2015-08-11 at 17:58:19
From: https://github.com/Homebrew/homebrew-core/blob/master/Formula/python3.rb
==> Dependencies
Build: xz ✔, pkg-config ✔, sphinx-doc ✘
Required: openssl ✔
Recommended: readline ✔, sqlite ✔, gdbm ✔, xz ✔
Optional: homebrew/dupes/tcl-tk ✘, sphinx-doc ✘
==> Options
--universal
    Build a universal binary
--with-quicktest
    Run `make quicktest` after the build
--with-sphinx-doc
    Build HTML documentation
--with-tcl-tk
    Use Homebrew's Tk instead of OS X Tk (has optional Cocoa and threads support)
--without-gdbm
    Build without gdbm support
--without-readline
    Build without readline support
--without-sqlite
    Build without sqlite support
--without-xz
    Build without xz support
--devel
    Install development version 3.6.0a3
--HEAD
    Install HEAD version
==> Caveats
Pip, setuptools, and wheel have been installed. To update them
  pip3 install --upgrade pip setuptools wheel

You can install Python packages with
  pip3 install <package>

They will install into the site-package directory
  /usr/local/lib/python3.5/site-packages

See: https://github.com/Homebrew/brew/blob/master/share/doc/homebrew/Homebrew-and-Python.md

vmarquet · 2016-09-26T16:22:39Z

Problem solved, it was due to Homebrew. It was solved with the following commands:

$ brew unlink python3
$ brew link --overwrite python3
$ unset PYTHONPATH

After that, virtualenv worked as expected.

tdsmith · 2016-09-26T16:27:27Z

unset PYTHONPATH should have been sufficient; Homebrew didn't contribute
to the problem.

On Mon, Sep 26, 2016, 09:22 Vincent Marquet notifications@github.com
wrote:

Problem solved, it was due to Homebrew. It was solved with the following
commands:

$ brew unlink python3
$ brew link --overwrite python3
$ unset PYTHONPATH

After that, virtualenv worked as expected.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#779 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAKnQcXE4gPz_iaEFNHC14YX9thiZwosks5qt_FTgaJpZM4Fj2fP
.

vmarquet · 2016-09-26T17:23:12Z

No, I tried unset PYTHONPATH before and it didn't solved the problem. After unset PYTHONPATH, the error message was different, and related to homebrew problems.

BenjaminHCCarr · 2017-01-23T19:24:02Z

Sadly I am still getting this error, command I am firing off:
benc$ virtualenv --no-site-packages --distribute --relocatable -p /usr/local/bin/python3 --always-copy .env

Error:

benc$ virtualenv --no-site-packages --distribute --relocatable -p /usr/local/bin/python3 --always-copy .env
Running virtualenv with interpreter /usr/local/bin/python3
The environment doesn't have a file /Users/benc/Code/git/Mine/oh-data-google-fit/.env/bin/activate_this.py -- please re-run virtualenv on this environment to update it
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 2328, in <module>
    main()
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 700, in main
    make_environment_relocatable(home_dir)
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 1588, in make_environment_relocatable
    fixup_scripts(home_dir, bin_dir)
  File "/usr/local/lib/python2.7/site-packages/virtualenv.py", line 1610, in fixup_scripts
    for filename in os.listdir(bin_dir):
FileNotFoundError: [Errno 2] No such file or directory: '/Users/benc/Code/git/Mine/oh-data-google-fit/.env/bin'

I tried unset PYTHONPATH; no luck, then tried:

benc$ brew unlink python3
Unlinking /usr/local/Cellar/python3/3.6.0... 23 symlinks removed
tyr:~/Code/git/Mine/oh-data-google-fit benc$ brew link --overwrite python3
Linking /usr/local/Cellar/python3/3.6.0... 23 symlinks created
tyr:~/Code/git/Mine/oh-data-google-fit benc$ unset PYTHONPATH

Same error.

tyr:~/Code/git/Mine/oh-data-google-fit benc$ which python3
/usr/local/bin/python3
tyr:~/Code/git/Mine/oh-data-google-fit benc$ ls -l `!!`
ls -l `which python3`
lrwxr-xr-x  1 benc  admin  35 Jan 23 14:16 /usr/local/bin/python3 -> ../Cellar/python3/3.6.0/bin/python3

tyr:~/Code/git/Mine/oh-data-google-fit benc$ echo $PYTHONPATH

tyr:~/Code/git/Mine/oh-data-google-fit benc$

Thoughts?

BenjaminHCCarr · 2017-01-23T19:25:17Z

Okay, problem found, it was the --relocatable with Python3, maybe it was deprecated.

benc$ virtualenv --no-site-packages --distribute -p /usr/local/bin/python3 --always-copy .env_OH_GFit
Running virtualenv with interpreter /usr/local/bin/python3
Using base prefix '/usr/local/Cellar/python3/3.6.0/Frameworks/Python.framework/Versions/3.6'
New python executable in /Users/benc/Code/git/Mine/oh-data-google-fit/.env_OH_GFit/bin/python3.6
Also creating executable in /Users/benc/Code/git/Mine/oh-data-google-fit/.env_OH_GFit/bin/python
Installing setuptools, pip, wheel...done.

worked fine.

ghost · 2017-03-14T18:46:51Z

A different solution worked for me. I'm using Mac OS X 10.12.3 and python3.5 installed from a package obtained from python.org.

pip3 install virtualenv
export PATH="/Library/Frameworks/Python.framework/Versions/3.5/bin:$PATH"

carloslbello mentioned this issue Aug 12, 2015

compatibility with PyPy as well as Python < 3.3 benhoyt/scandir#53

Closed

Ivoz mentioned this issue Oct 2, 2015

Remove file's directory from sys.path ASAP #805

Merged

Ivoz closed this as completed in #805 Oct 17, 2015

pypa locked and limited conversation to collaborators Jan 14, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

virtualenv fails to create virtual environment from Homebrew-installed Python 3.4.3 #779

virtualenv fails to create virtual environment from Homebrew-installed Python 3.4.3 #779

carloslbello commented Aug 1, 2015

tdsmith commented Aug 1, 2015

ionelmc commented Aug 1, 2015

carloslbello commented Aug 1, 2015

Ivoz commented Oct 2, 2015

carloslbello commented Oct 2, 2015

vmarquet commented Sep 26, 2016 •

edited

Loading

vmarquet commented Sep 26, 2016 •

edited

Loading

tdsmith commented Sep 26, 2016

vmarquet commented Sep 26, 2016

BenjaminHCCarr commented Jan 23, 2017

BenjaminHCCarr commented Jan 23, 2017

ghost commented Mar 14, 2017

virtualenv fails to create virtual environment from Homebrew-installed Python 3.4.3 #779

virtualenv fails to create virtual environment from Homebrew-installed Python 3.4.3 #779

Comments

carloslbello commented Aug 1, 2015

tdsmith commented Aug 1, 2015

ionelmc commented Aug 1, 2015

carloslbello commented Aug 1, 2015

Ivoz commented Oct 2, 2015

carloslbello commented Oct 2, 2015

vmarquet commented Sep 26, 2016 • edited Loading

vmarquet commented Sep 26, 2016 • edited Loading

tdsmith commented Sep 26, 2016

vmarquet commented Sep 26, 2016

BenjaminHCCarr commented Jan 23, 2017

BenjaminHCCarr commented Jan 23, 2017

ghost commented Mar 14, 2017

vmarquet commented Sep 26, 2016 •

edited

Loading

vmarquet commented Sep 26, 2016 •

edited

Loading