vulture and pylint failing #73

hschilling · 2014-11-22T16:07:01Z

For a very large code base ( https://github.com/OpenMDAO/OpenMDAO-Framework ) , I get this in the output

.:
L-:- None: pylint - failure
Tool pylint failed to run (exception was raised)

.:
L-:- None: vulture - failure
Tool vulture failed to run (exception was raised)

There are no errors given by either tool as a result.

I tried using pylint and vulture with some smaller codes and it worked fine.

Great tool though!!!

jquast · 2014-12-04T23:42:19Z

@hschilling use the prospector argument --die-on-tool-error and it may help discover the root issue

hschilling · 2014-12-06T23:04:29Z

Hi Jeff,

Thanks for the suggestion. Maybe our project size is stretching the limits ? Thanks for the help

Traceback (most recent call last):
File "/usr/local/bin/prospector", line 9, in
File "/usr/local/lib/python2.7/site-packages/prospector/run.py", line 317, in main
File "/usr/local/lib/python2.7/site-packages/prospector/run.py", line 224, in execute
File "/usr/local/lib/python2.7/site-packages/prospector/tools/pylint/init.py", line 182, in run
File "/usr/local/lib/python2.7/site-packages/pylint/lint.py", line 585, in check
File "/usr/local/lib/python2.7/site-packages/pylint/lint.py", line 662, in check_astroid_module
File "/usr/local/lib/python2.7/site-packages/pylint/utils.py", line 804, in walk
File "/usr/local/lib/python2.7/site-packages/pylint/utils.py", line 801, in walk
File "/usr/local/lib/python2.7/site-packages/pylint/checkers/variables.py", line 756, in visit_import
File "/usr/local/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
File "/usr/local/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
File "/usr/local/lib/python2.7/site-packages/astroid/inference.py", line 212, in infer_import
File "/usr/local/lib/python2.7/site-packages/astroid/mixins.py", line 107, in do_import_module
File "/usr/local/lib/python2.7/site-packages/astroid/scoped_nodes.py", line 361, in import_module
File "/usr/local/lib/python2.7/site-packages/astroid/manager.py", line 125, in ast_from_module_name
OSError: [Errno 24] Too many open files

On Dec 4, 2014, at 6:42 PM, Jeff Quast <notifications@github.com mailto:notifications@github.com> wrote:

@hschillinghttps://github.com/hschilling use the prospector argument --die-on-tool-error and it may help discover the root issue

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/73#issuecomment-65724482.

Herb Schilling
Scientific Applications and Visualization Team
http://ocio.grc.nasa.gov/gvis
Office of the Chief Information Officer
NASA Glenn Research Center
hschilling@nasa.govmailto:hschilling@nasa.gov

jquast · 2014-12-06T23:34:26Z

Suggest this issue be closed, prospector can't help you much here.

However I filed a bug on your behalf with astroid: https://bitbucket.org/logilab/astroid/issue/65/oserror-errno-24-too-many-open-files you may watch this issue for any resolution or response.

In the meantime, I suggest finding a way to increase the number of open files for your user account.

hschilling · 2014-12-07T16:20:45Z

Hi,

I see. Thanks for filing that bug for me.

I did try ( I am using Mac OS X 10.8.5 )

sudo launchctl limit maxfiles 1000000 1000000

and got the same error.

I monitored the process using Activity Monitor's Open Files pane and I saw that it just kept growing as it opened up source files but it sure didn't look like 1000000 files in there !

On Dec 6, 2014, at 6:34 PM, Jeff Quast <notifications@github.com mailto:notifications@github.com>
wrote:

Suggest this issue be closed, prospector can't help you much here.

However I filed a bug on your behalf with astroid: https://bitbucket.org/logilab/astroid/issue/65/oserror-errno-24-too-many-open-files you may watch this issue for any resolution or response.

In the meantime, I suggest finding a way to increase the number of open files for your user account.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/73#issuecomment-65919466.

Herb Schilling
Scientific Applications and Visualization Team
http://ocio.grc.nasa.gov/gvis
Office of the Chief Information Officer
NASA Glenn Research Center
hschilling@nasa.govmailto:hschilling@nasa.gov

jquast · 2014-12-07T20:13:15Z

That doesn't work for some reason. Just type:

$ ulimit -n 16384

on your shell. 1000000 is also too high, 16384 is the actual upperbound limit?

jquast · 2014-12-15T16:51:34Z

This was fixed upstream, Pylint 1.4.1 should resolve the issue.

prospector is currently bound to pylint,<1.4 but I understand this should be resolved once prospector drops python2.6 support and removes this upperbound version. https://bitbucket.org/logilab/astroid/issue/65/oserror-errno-24-too-many-open-files

jquast · 2014-12-15T16:53:31Z

If you are interested, I have a cheap workaround for installing and running prospector using tox, removing the upperbound, and upgrading pylint and astroid:

tox.ini excerpt:

[testenv:prospector]
usedevelop = True
deps = -r{toxinidir}/requirements-analysis.txt
whitelist = pip gsed prospector
# cheap workaround until prospector's next release
# https://github.com/landscapeio/prospector/issues/75
commands = pip install --upgrade astroid pylint
           gsed -i 's|pylint>=1.3,<1.4|pylint>=1.3|g' {envsitepackagesdir}/prospector-0.7.4-py2.7.egg-info/requires.txt
           prospector \
               --die-on-tool-error \
               --test-warnings \
               --doc-warnings \
               {toxinidir}

requirements-analysis.txt

prospector[with_dodgy,with_frosted,with_mccabe,with_pep257,with_pep8,with_pylint,with_pyroma,with_vulture]

hschilling · 2014-12-16T23:00:31Z

Hi Jeff,

Thanks for this and also for letting me know about the fix to Pylint !

On Dec 15, 2014, at 11:53 AM, Jeff Quast <notifications@github.com mailto:notifications@github.com> wrote:

If you are interested, I have a cheap workaround for installing and running prospector using tox, removing the upperbound, and upgrading pylint and astroid:

tox.ini excerpt:

[testenv:prospector]
usedevelop = True
deps = -r{toxinidir}/requirements-analysis.txt
whitelist = pip gsed prospector

cheap workaround until prospector's next release

#75

commands = pip install --upgrade astroid pylint
gsed -i 's|pylint>=1.3,<1.4|pylint>=1.3|g' {envsitepackagesdir}/prospector-0.7.4-py2.7.egg-info/requires.txt
prospector
--die-on-tool-error
--test-warnings
--doc-warnings
{toxinidir}

requirements-analysis.txt

prospector[with_dodgy,with_frosted,with_mccabe,with_pep257,with_pep8,with_pylint,with_pyroma,with_vulture]

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/73#issuecomment-67025396.

Herb Schilling
Scientific Applications and Visualization Team
http://ocio.grc.nasa.gov/gvis
Office of the Chief Information Officer
NASA Glenn Research Center
hschilling@nasa.govmailto:hschilling@nasa.gov

carlio · 2015-01-02T14:52:04Z

Finally got around to making a 0.8 release, sorry about the delay. #10 and #74 turned out to be a bit more fiddly than expected.

Let me know if this fixes these issues - it should do as pylint>=1.4 is now the minimum requirement.

@jquast by the way you can use pip install prospector[with_everything] to avoid having to specify each dependency!

carlio · 2015-01-02T14:56:00Z

@hschilling if you upgrade to prospector 0.8, this should hopefully fix your issue.

hschilling · 2015-01-02T15:29:26Z

Thanks ! Will give it a try over the weekend

hschilling · 2015-01-03T21:29:25Z

I tried it. I did install everything using:

pip install prospector[with_everything]

When I just do

prospector

in a directory with a super simple Python script, it works.

If I do the same in our OpenMDAO project directory, I get this.

Traceback (most recent call last):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/bin/prospector", line 9, in
load_entry_point('prospector==0.8.1', 'console_scripts', 'prospector')()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/run.py", line 125, in main
config = ProspectorConfig()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/config/init.py", line 25, in init
self.libraries = self._find_used_libraries(self.config)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/config/init.py", line 140, in _find_used_libraries
for name, adaptor in autodetect_libraries(self.workdir):
ValueError: too many values to unpack

The value that gets returned from autodetect_libraries(self.workdir) is:

 set([u'django'])

Let me know if I should try something else.

Sorry!

@carlio

thanks @carlio prospector-dev/prospector#73 (comment)

jquast · 2015-01-04T03:37:50Z

I'm submitting a PR for this shortly, this broke for me too

jquast · 2015-01-04T03:39:29Z

submitted new issue #82 for tracking

jquast · 2015-01-04T05:45:28Z

Fixed in PR #85

carlio · 2015-01-04T09:46:02Z

Merged #85 and released 0.8.2 with this bugfix, thanks @jquast !

hschilling · 2015-01-04T15:27:29Z

Thanks! I tried it again and things are working much better. The only problem left is I see this in the output at the top of the output file. I ran this with --with-tool pyroma --with-tool vulture. There is nothing in the output that tells me more about the exception. I can seem to run pylint and pyroma without errors

Messages

.
Line: None
pylint: failure / Tool pylint failed to run (exception was raised)
pyroma: failure / Tool pyroma failed to run (exception was raised)

jquast · 2015-01-04T19:22:08Z

Don't forget, use argument --die-on-tool-error to see the exception that was raised.

carlio · 2015-01-04T19:25:13Z

@hschilling I tried this myself on the OpenMDAO-Framework repository and pylint worked fine, so if you could use --die-on-tool-error to show the stack trace that would be great.

Pyroma fails because one of the setup.py files in the project imports NumPY which wasn't available for me, so I created #93 to address that. It may not be the same as your issue though if you have numpy installed.

hschilling · 2015-01-04T19:42:43Z

Sorry, I DID forget about --die-on-tool-error :-)

Pylinit dies with "RuntimeError: maximum recursion depth exceeded" Here is most of the stack trace. I cut out the part where it has a LOT of these lines repeated over and over again.

File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:

Traceback (most recent call last):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/bin/prospector", line 9, in
load_entry_point('prospector==0.8.2', 'console_scripts', 'prospector')()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/run.py", line 136, in main
prospector.execute()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/run.py", line 51, in execute
messages += tool.run(found_files)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/tools/pylint/init.py", line 261, in run
self._linter.check(self._args)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/lint.py", line 687, in check
self._do_check(files_or_modules)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/lint.py", line 809, in _do_check
self.check_astroid_module(astroid, walker, rawcheckers, tokencheckers)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/lint.py", line 863, in check_astroid_module
rawcheckers, tokencheckers)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/lint.py", line 899, in _check_astroid_module
walker.walk(astroid)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/utils.py", line 866, in walk
self.walk(child)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/utils.py", line 866, in walk
self.walk(child)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/utils.py", line 866, in walk
self.walk(child)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/utils.py", line 866, in walk
self.walk(child)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/utils.py", line 863, in walk
cb(astroid)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/checkers/logging.py", line 161, in visit_callfunc
result, name = is_logger_class()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pylint/checkers/logging.py", line 146, in is_logger_class
for inferred in node.func.infer():
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 365, in wrapper
for node in func(_args, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/inference.py", line 245, in infer_getattr
for obj in owner.igetattr(self.attrname, context):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
....
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 365, in wrapper
for node in func(_args, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/inference.py", line 245, in infer_getattr
for obj in owner.igetattr(self.attrname, context):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 138, in _infer_stmts
for infered in stmt.infer(context, *_kw):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 110, in cache_generator
for result in generator:
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 341, in wrapped
for res in _func(node, context, *_kwargs):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/inference.py", line 167, in infer_name
frame, stmts = self.lookup(self.name)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/node_classes.py", line 124, in lookup
return self.scope().scope_lookup(self, name)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/scoped_nodes.py", line 638, in scope_lookup
return frame._scope_lookup(node, name, offset)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/scoped_nodes.py", line 145, in _scope_lookup
return pscope.scope_lookup(node, name)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/scoped_nodes.py", line 281, in scope_lookup
return self._scope_lookup(node, name, offset)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/scoped_nodes.py", line 134, in _scope_lookup
stmts = node._filter_stmts(self.locals[name], self, offset)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/node_classes.py", line 150, in _filter_stmts
myframe = self.frame()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 478, in frame
return self.parent.frame()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/astroid/bases.py", line 478, in frame
return self.parent.frame()
RuntimeError: maximum recursion depth exceeded

hschilling · 2015-01-04T19:47:20Z

BTW, the usage: output for prospector looks like it could be tweaked. Missing --die-on-tool-error and the alternate ways of using --with-tool,etc...

usage: prospector [-h] [-0] [-A] [-u USES] [-B] [--no-common-plugin] [-D] [-T]
[-8] [-F] [--max-line-length MAX_LINE_LENGTH] [-M] [-S]
[-o {emacs,grouped,json,pylint,text,yaml}]
[--absolute-paths] [-t TOOLS] [-w WITH_TOOLS]
[-W WITHOUT_TOOLS] [-P PROFILES]
[--profile-path PROFILE_PATH]
[-s {veryhigh,high,medium,low,verylow}] [-E]
[--pylint-config-file PYLINT_CONFIG_FILE] [-p PATH]
[-I IGNORE_PATTERNS] [-i IGNORE_PATHS] [-X]
[--loquacious-pylint] [--version]
[PATH [PATH ...]]

hschilling · 2015-01-04T19:58:22Z

I do have numpy installed. This is why pyroma dies for me. Looks like you just need to use

if '_setuptools' in data:

instead of

if data['_setuptools']:

In fact, if I make that code change, everything runs for me if I --without-tool pylint

Traceback (most recent call last):
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/bin/prospector", line 9, in
load_entry_point('prospector==0.8.2', 'console_scripts', 'prospector')()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/run.py", line 136, in main
prospector.execute()
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/run.py", line 51, in execute
messages += tool.run(found_files)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/prospector/tools/pyroma/init.py", line 59, in run
passed = test.test(data)
File "/Users/herbertschilling/Documents/OpenMDAO/dev/latest/devenv/lib/python2.7/site-packages/pyroma/ratings.py", line 199, in test
if data['_setuptools']:
KeyError: '_setuptools'

and data is equal to

(Pdb) data
{'ext_modules': [<numpy.distutils.extension.Extension instance at 0x106f48290>], 'description': 'AXOD - axial turbine off-design analysis.', 'license': 'public domain', 'distclass': <class numpy.distutils.numpy_distribution.NumpyDistribution at 0x106ab08d8>, 'install_requires': ['numpy'], 'zip_safe': False, '_setuptools': True, 'headers': [], 'version': '0.1.0', 'cmdclass': {'bdist_rpm': <class numpy.distutils.command.bdist_rpm.bdist_rpm at 0x106e0ef58>, 'sdist': <class numpy.distutils.command.sdist.sdist at 0x106e0e328>, 'build_src': <class numpy.distutils.command.build_src.build_src at 0x106e0e8d8>, 'config_fc': <class numpy.distutils.command.config_compiler.config_fc at 0x106ac0db8>, 'build_clib': <class numpy.distutils.command.build_clib.build_clib at 0x106e0e258>, 'build_scripts': <class numpy.distutils.command.build_scripts.build_scripts at 0x106e0e2c0>, 'build_ext': <class numpy.distutils.command.build_ext.build_ext at 0x106df7050>, 'develop': <class numpy.distutils.command.develop.develop at 0x106e23f58>, 'build_py': <class numpy.distutils.command.build_py.build_py at 0x106add390>, 'scons': <class numpy.distutils.command.scons.scons at 0x106e23c18>, 'install_clib': <class numpy.distutils.command.install_clib.install_clib at 0x106e0ec80>, 'egg_info': <class numpy.distutils.command.egg_info.egg_info at 0x106f46050>, 'install_headers': <class numpy.distutils.command.install_headers.install_headers at 0x106e0ec18>, 'install_data': <class numpy.distutils.command.install_data.install_data at 0x106e0ea10>, 'easy_install': <class setuptools.command.easy_install.easy_install at 0x106aa9c18>, 'bdist_egg': <class setuptools.command.bdist_egg.bdist_egg at 0x106aa9738>, 'install': <class numpy.distutils.command.install.install at 0x106e0ece8>, 'config_cc': <class numpy.distutils.command.config_compiler.config_cc at 0x106ac0e20>, 'config': <class numpy.distutils.command.config.config at 0x106ac0d50>, 'build': <class numpy.distutils.command.build.build at 0x106ac0f58>}, 'data_files': [('', ['AXOD_AAO.pdf', 'axod.pdf', 'README.txt']), ('src/', ['src/cpw.f', 'src/tempdata.f', 'src/Makefile', 'src/pratio.f', 'src/axodm.f', 'src/phim.f', 'src/besfit.f', 'src/input.f', 'src/ploter.f', 'src/flow2.f', 'src/sta1a.f', 'src/sta2.f', 'src/sta2a.f', 'src/gama.f', 'src/icommon.f', 'src/fit1.f', 'src/sta01.f', 'src/r.f', 'src/loss2.f', 'src/cpf.f', 'src/read_input.txt', 'src/inst2.f', 'src/etacf.f', 'src/ovrall.f', 'src/init.f', 'src/instg.f', 'src/cpa.f', 'src/loss1.f', 'src/axod.f', 'src/getdata.f', 'src/sta1.f', 'src/flow1.f', 'src/etapr.f', 'src/diagt.f', 'src/testaxod.py', 'src/loop.f', 'src/ReadMe.txt', 'src/fit2.f']), ('test/', ['test/one_stage.inp', 'test/axod_compn.py', 'test/test_axod_comp.py', 'test/axod.out2', 'test/eee_hpt.inp', 'test/datain.py', 'test/testaxodn.py', 'test/newtest1.py', 'test/testaxod.py', 'test/axod.out1', 'test/one_stageO.inp', 'test/read_input.txt', 'test/eee_hpt.inpO', 'test/one_stage.inpO', 'test/axod_comp.py'])], 'name': 'axod'}

carlio · 2015-01-04T20:31:03Z

@hschilling I've seen the recursion depth thing before but I think in an older version of astroid. Can you do a 'pip freeze' and show the versions of astroid, logilab-common and pylint?

For pyroma, it's the same stacktrace as the one I got, but the problem is in pyroma itself, so I'll need to make a PR on that.

hschilling · 2015-01-04T20:38:54Z

@carlio Thanks. Here is the output of pip freeze:

Cython==0.20.1
Fabric==0.9.3
Jinja2==2.4
PyYAML==3.11
Pyevolve==0.6
Pygments==1.3.1
SetupDocs==1.0.5
Sphinx==1.2.2
argparse==1.3.0
astroid==1.3.2
backports.ssl-match-hostname==3.4.0.2
boto==2.0rc1
bson==0.3.3
cobyla==1.0.1
conmin==1.0.1
decorator==3.2.0
docutils==0.12
dodgy==0.1.6
enum34==1.0.4
frosted==1.4.1
ipaddress==1.0.7
ipython==2.0.0
logilab-common==0.63.2
matplotlib==1.3.1
mccabe==0.3
mock==1.0.1
networkx==1.8.1
newsumt==1.1.0
nose==1.3.3
numpy==1.7.1
objgraph==1.8.0
openmdao.devtools==0.10.3.2
openmdao.examples.bar3simulation==0.10.3.2
openmdao.examples.expected-improvement==0.10.3.2
openmdao.examples.mdao==0.10.3.2
openmdao.examples.metamodel-tutorial==0.10.3.2
openmdao.examples.nozzle-geometry-doe==0.10.3.2
openmdao.examples.simple==0.10.3.2
openmdao.lib==0.10.3.2
openmdao.main==0.10.3.2
openmdao.test==0.10.3.2
openmdao.units==0.10.3.2
openmdao.util==0.10.3.2
ordereddict==1.1
paramiko==1.7.7.1
pep257==0.3.2
pep8==1.5.7
pep8-naming==0.2.2
pies==2.6.3
pies2overrides==2.6.3
prospector==0.8.2
pycrypto==2.3
pyflakes==0.8.1
pylint==1.4.0
pylint-celery==0.3
pylint-common==0.2.1
pylint-django==0.5.5
pylint-plugin-utils==0.2.2
pyparsing==1.5.7
pyroma==1.7
python-dateutil==2.2
pytz==2011k
pyzmq==14.1.1
readline==6.2.4.1
requests==2.2.1
requirements-detector==0.3
scipy==0.12.0
see==1.0.1
setoptconf==0.2.0
six==1.9.0
slsqp==1.0.1
stevedore==0.10
tornado==3.2
traits==4.3.0
virtualenv==1.9.1
virtualenv-clone==0.2.4
virtualenvwrapper==4.1.1
vulture==0.6
wsgiref==0.1.2
xdot==0.5
xtrace==0.4
zope.interface==3.6.1

carlio · 2015-01-04T21:00:14Z

@hschilling thanks, unfortunately those are exactly the versions I was using so that's not the issue.

I tried it again on my Mac this time, and I get a similar problem - I don't get a stacktrace but prospector is taking forever and when I Ctrl-C I see a very deep stacktrace at the same point you did. This doesn't happen on my Ubuntu machine. Very odd.

Out of interest, how long does it take to get the stacktrace?

hschilling · 2015-01-04T21:03:49Z

47 seconds

carlio · 2015-01-04T21:05:56Z

It just finished for me, and no stack trace or problem. I'm 100% baffled why it's not working for you.

carlio · 2015-01-04T21:06:35Z

Wait, ignore that! Of course, if I don't have all the dependencies installed, then the pylint inference will be less intense. I'll try installing everything and see what happens.

carlio · 2015-01-04T21:28:24Z

I installed as much as I could, but some things were not available - for example, Traits 4.3.0 is no longer available for download.

I think in general though that the problem is simply 'too much code'. Pylint builds up a map of all code in the project but also follows inference chains for libraries used, so there will be so much going on.

This is basically a limitation of pylint/astroid rather than a bug in prospector. I'm not sure exactly what could be done either, without severe restructuring to avoid recursing when inferring types.

The only solution I have would be to run prospector several times on different parts of the code.

hschilling · 2015-01-04T21:34:51Z

Makes sense to me. BTW, we are trying to get rid of Traits as a dependency. Good to know you can't even download it any more!

jquast · 2015-01-04T21:47:01Z

(i have a love/hate relationship with traits too)

the reason it doesn't find it is because enthought does a very poor job of publishing it, this is what pip sees: https://pypi.python.org/simple/traits/ -- as you see, 4.3.0 just redirects to a website where no download is found, you can probably safely upgrade to latest traits.

carlio · 2015-01-11T04:16:02Z

I'll close this as there's not much I can do to fix it and #93 covers what can be fixed.

hschilling · 2015-01-11T15:01:08Z

That's fine. Thanks for the help !

On Jan 10, 2015, at 11:16 PM, Carl Crowder <notifications@github.com mailto:notifications@github.com>
wrote:

I'll close this as there's not much I can do to fix it and #93 #93 covers what can be fixed.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/73#issuecomment-69483078.

Herb Schilling
Scientific Applications and Visualization Team
http://ocio.grc.nasa.gov/gvis
Office of the Chief Information Officer
NASA Glenn Research Center
hschilling@nasa.govmailto:hschilling@nasa.gov

Prospector already solves the issues in prospector-dev/prospector#73

Prospector solved the issues in prospector-dev/prospector#73

carlio mentioned this issue Jan 2, 2015

Allow tools to use exsting configuration if found or provided. #74

Closed

jquast added a commit to jquast/blessed that referenced this issue Jan 4, 2015

use 'with_everything'

583a305

thanks @carlio prospector-dev/prospector#73 (comment)

carlio closed this as completed Jan 11, 2015

heliomeiralins added a commit to heliomeiralins/django-react-boilerplate that referenced this issue Jan 22, 2018

Remove restriction on pylint and astroid versions.

7c4c92c

Prospector already solves the issues in prospector-dev/prospector#73

heliomeiralins added a commit to heliomeiralins/django-react-boilerplate that referenced this issue Jan 22, 2018

Remove restriction on pylint and astroid versions.

8ec432f

Prospector solved the issues in prospector-dev/prospector#73

heliomeiralins mentioned this issue Jan 22, 2018

Remove restriction on pylint and astroid versions. vintasoftware/django-react-boilerplate#177

Closed

8 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

vulture and pylint failing #73

vulture and pylint failing #73

hschilling commented Nov 22, 2014

jquast commented Dec 4, 2014

hschilling commented Dec 6, 2014

jquast commented Dec 6, 2014

hschilling commented Dec 7, 2014

jquast commented Dec 7, 2014

jquast commented Dec 15, 2014

jquast commented Dec 15, 2014

hschilling commented Dec 16, 2014

carlio commented Jan 2, 2015

carlio commented Jan 2, 2015

hschilling commented Jan 2, 2015

hschilling commented Jan 3, 2015

jquast commented Jan 4, 2015

jquast commented Jan 4, 2015

jquast commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

jquast commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

hschilling commented Jan 4, 2015

hschilling commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

carlio commented Jan 4, 2015

carlio commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

jquast commented Jan 4, 2015

carlio commented Jan 11, 2015

hschilling commented Jan 11, 2015

vulture and pylint failing #73

vulture and pylint failing #73

Comments

hschilling commented Nov 22, 2014

jquast commented Dec 4, 2014

hschilling commented Dec 6, 2014

jquast commented Dec 6, 2014

hschilling commented Dec 7, 2014

jquast commented Dec 7, 2014

jquast commented Dec 15, 2014

jquast commented Dec 15, 2014

hschilling commented Dec 16, 2014

cheap workaround until prospector's next release

#75

carlio commented Jan 2, 2015

carlio commented Jan 2, 2015

hschilling commented Jan 2, 2015

hschilling commented Jan 3, 2015

jquast commented Jan 4, 2015

jquast commented Jan 4, 2015

jquast commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

Messages

jquast commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

hschilling commented Jan 4, 2015

hschilling commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

carlio commented Jan 4, 2015

carlio commented Jan 4, 2015

carlio commented Jan 4, 2015

hschilling commented Jan 4, 2015

jquast commented Jan 4, 2015

carlio commented Jan 11, 2015

hschilling commented Jan 11, 2015