You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Dale Richardson (Jira)" <ji...@apache.org> on 2020/05/08 07:55:00 UTC
[jira] [Comment Edited] (LIVY-768) Livy Python API tests require dependency version pinning

    [ https://issues.apache.org/jira/browse/LIVY-768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102342#comment-17102342 ] 

Dale Richardson edited comment on LIVY-768 at 5/8/20, 7:54 AM:
---------------------------------------------------------------

{{Extract from the build:}}

{{*----* exec-maven-plugin:1.2.1:exec *(python-api test)* @ livy-python-api *--*}}

{{/usr/local/lib/python2.7/site-packages/setuptools/dist.py:481: UserWarning: The version specified ('0.8.0-incubating-SNAPSHOT') is an invalid version, this may not work as expected with newer versions of setuptools, pip, and PyPI. Please see PEP 440 for more details.}}

{{  "details." % self.metadata.version}}

{{running pytest}}

{{Searching for requests-kerberos>=0.11.0}}

{{Best match: requests-kerberos 0.12.0}}

{{Processing requests_kerberos-0.12.0-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/requests_kerberos-0.12.0-py2.7.egg}}

{{Searching for responses>=0.5.1}}

{{Best match: responses 0.10.14}}

{{Processing responses-0.10.14-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/responses-0.10.14-py2.7.egg}}

{{Searching for mock~=3.0.5}}

{{Best match: mock 3.0.5}}

{{Processing mock-3.0.5-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/mock-3.0.5-py2.7.egg}}

{{Searching for cloudpickle>=0.2.1}}

{{Best match: cloudpickle 1.4.1}}

{{Processing cloudpickle-1.4.1-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/cloudpickle-1.4.1-py2.7.egg}}

{{Searching for pykerberos<2.0.0,>=1.1.8}}

{{Best match: pykerberos 1.2.3.dev0}}

{{Processing pykerberos-1.2.3.dev0-py2.7-macosx-10.14-x86_64.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/pykerberos-1.2.3.dev0-py2.7-macosx-10.14-x86_64.egg}}

{{Searching for cookies}}

{{Best match: cookies 2.2.1}}

{{Processing cookies-2.2.1-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/cookies-2.2.1-py2.7.egg}}

{{Searching for pytest}}

{{Best match: pytest 5.4.1}}

{{Processing pytest-5.4.1-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest-5.4.1-py2.7.egg}}

{{running egg_info}}

{{writing requirements to src/main/python/livy_python_api.egg-info/requires.txt}}

{{writing src/main/python/livy_python_api.egg-info/PKG-INFO}}

{{writing top-level names to src/main/python/livy_python_api.egg-info/top_level.txt}}

{{writing dependency_links to src/main/python/livy_python_api.egg-info/dependency_links.txt}}

{{package init file 'src/test/python/livy-tests/__init__.py' not found (or not a regular file)}}

{{reading manifest file 'src/main/python/livy_python_api.egg-info/SOURCES.txt'}}

{{reading manifest template 'MANIFEST.in'}}

{{warning: no files found matching 'versioneer.py'}}

{{warning: no files found matching 'livy/_version.py'}}

{{warning: no files found matching 'src/main/python/livy/_version.py'}}

{{writing manifest file 'src/main/python/livy_python_api.egg-info/SOURCES.txt'}}

{{running build_ext}}

{{Traceback (most recent call last):}}

{{  File "setup.py", line 58, in <module>}}

{{    tests_require=['pytest']}}

{{  File "/usr/local/lib/python2.7/site-packages/setuptools/__init__.py", line 145, in setup}}

{{    return distutils.core.setup(**attrs)}}

{{  File "/usr/local/Cellar/python@2/2.7.16/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/core.py", line 151, in setup}}

{{    dist.run_commands()}}

{{  File "/usr/local/Cellar/python@2/2.7.16/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py", line 953, in run_commands}}

{{    self.run_command(cmd)}}

{{  File "/usr/local/Cellar/python@2/2.7.16/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py", line 972, in run_command}}

{{    cmd_obj.run()}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest_runner-5.2-py2.7.egg/ptr.py", line 209, in run}}

{{    return self.run_tests()}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest_runner-5.2-py2.7.egg/ptr.py", line 220, in run_tests}}

{{    result_code = __import__('pytest').main()}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest-5.4.1-py2.7.egg/pytest/__init__.py", line 6, in <module>}}

{{    from _pytest.assertion import register_assert_rewrite}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest-5.4.1-py2.7.egg/_pytest/assertion/__init__.py", line 45}}

{{    def register_assert_rewrite(*names) -> None:}}

                                                                                                ^

{{SyntaxError: invalid syntax}}

{{*------------------------------------------------------------------------*}}

{{*BUILD FAILURE*}}

{{*------------------------------------------------------------------------*}}

{{Total time:  5.817 s}}

{{Finished at: 2020-05-08T17:45:38+10:00}}

{{*------------------------------------------------------------------------*}}

{{*[ERROR]* Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec *(python-api test)* on project livy-python-api: *Command exec*}}

                                    ^


was (Author: tigerquoll):
{{Extract from the build:}}

{{*---* exec-maven-plugin:1.2.1:exec *(python-api test)* @ livy-python-api *---*}}

{{/usr/local/lib/python2.7/site-packages/setuptools/dist.py:481: UserWarning: The version specified ('0.8.0-incubating-SNAPSHOT') is an invalid version, this may not work as expected with newer versions of setuptools, pip, and PyPI. Please see PEP 440 for more details.}}

{{  "details." % self.metadata.version}}

{{running pytest}}

{{Searching for requests-kerberos>=0.11.0}}

{{Best match: requests-kerberos 0.12.0}}

{{Processing requests_kerberos-0.12.0-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/requests_kerberos-0.12.0-py2.7.egg}}

{{Searching for responses>=0.5.1}}

{{Best match: responses 0.10.14}}

{{Processing responses-0.10.14-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/responses-0.10.14-py2.7.egg}}

{{Searching for mock~=3.0.5}}

{{Best match: mock 3.0.5}}

{{Processing mock-3.0.5-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/mock-3.0.5-py2.7.egg}}

{{Searching for cloudpickle>=0.2.1}}

{{Best match: cloudpickle 1.4.1}}

{{Processing cloudpickle-1.4.1-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/cloudpickle-1.4.1-py2.7.egg}}

{{Searching for pykerberos<2.0.0,>=1.1.8}}

{{Best match: pykerberos 1.2.3.dev0}}

{{Processing pykerberos-1.2.3.dev0-py2.7-macosx-10.14-x86_64.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/pykerberos-1.2.3.dev0-py2.7-macosx-10.14-x86_64.egg}}

{{Searching for cookies}}

{{Best match: cookies 2.2.1}}

{{Processing cookies-2.2.1-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/cookies-2.2.1-py2.7.egg}}

{{Searching for pytest}}

{{Best match: pytest 5.4.1}}

{{Processing pytest-5.4.1-py2.7.egg}}

{{ }}

{{Using /Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest-5.4.1-py2.7.egg}}

{{running egg_info}}

{{writing requirements to src/main/python/livy_python_api.egg-info/requires.txt}}

{{writing src/main/python/livy_python_api.egg-info/PKG-INFO}}

{{writing top-level names to src/main/python/livy_python_api.egg-info/top_level.txt}}

{{writing dependency_links to src/main/python/livy_python_api.egg-info/dependency_links.txt}}

{{package init file 'src/test/python/livy-tests/__init__.py' not found (or not a regular file)}}

{{reading manifest file 'src/main/python/livy_python_api.egg-info/SOURCES.txt'}}

{{reading manifest template 'MANIFEST.in'}}

{{warning: no files found matching 'versioneer.py'}}

{{warning: no files found matching 'livy/_version.py'}}

{{warning: no files found matching 'src/main/python/livy/_version.py'}}

{{writing manifest file 'src/main/python/livy_python_api.egg-info/SOURCES.txt'}}

{{running build_ext}}

{{Traceback (most recent call last):}}

{{  File "setup.py", line 58, in <module>}}

{{    tests_require=['pytest']}}

{{  File "/usr/local/lib/python2.7/site-packages/setuptools/__init__.py", line 145, in setup}}

{{    return distutils.core.setup(**attrs)}}

{{  File "/usr/local/Cellar/python@2/2.7.16/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/core.py", line 151, in setup}}

{{    dist.run_commands()}}

{{  File "/usr/local/Cellar/python@2/2.7.16/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py", line 953, in run_commands}}

{{    self.run_command(cmd)}}

{{  File "/usr/local/Cellar/python@2/2.7.16/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py", line 972, in run_command}}

{{    cmd_obj.run()}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest_runner-5.2-py2.7.egg/ptr.py", line 209, in run}}

{{    return self.run_tests()}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest_runner-5.2-py2.7.egg/ptr.py", line 220, in run_tests}}

{{    result_code = __import__('pytest').main()}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest-5.4.1-py2.7.egg/pytest/__init__.py", line 6, in <module>}}

{{    from _pytest.assertion import register_assert_rewrite}}

{{  File "/Users/dale/work/apache/incubator-livy/python-api/.eggs/pytest-5.4.1-py2.7.egg/_pytest/assertion/__init__.py", line 45}}

{{    def register_assert_rewrite(*names) -> None:}}

                                        ^

> Livy Python API tests require dependency version pinning
> --------------------------------------------------------
>
>                 Key: LIVY-768
>                 URL: https://issues.apache.org/jira/browse/LIVY-768
>             Project: Livy
>          Issue Type: Bug
>          Components: Tests
>    Affects Versions: 0.7.0
>            Reporter: Dale Richardson
>            Priority: Minor
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Building Livy inside a brand new virtualenv with the latest version of the unpinned dependencies listed in 
> *python-api/setup.py*
> Causes a number of issues that prevents the tests from running cleanly.  Main culprits appear to be pytest (needs to be limited <5) and cloudpickle (needs to be limited to <1.3.0).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)