[jira] [Created] (LIVY-439) livy-python-api fails to build because of some Python dependencies

["Ivan Dzikovsky (JIRA)" <ji...@apache.org>]

Ivan Dzikovsky created LIVY-439:
-----------------------------------

             Summary: livy-python-api fails to build because of some Python dependencies
                 Key: LIVY-439
                 URL: https://issues.apache.org/jira/browse/LIVY-439
             Project: Livy
          Issue Type: Bug
    Affects Versions: 0.4.0, 0.5.0
            Reporter: Ivan Dzikovsky


Hi all!

I'm trying to build Livy inside of clean ubuntu:16.04 Docker image (with maven, default-jdk and python-setuptools installed from default Ubuntu repo), and got exception on livy-python-api module:
{code:java}
root@32eb90f4dee4:~/incubator-livy# mvn clean package -DskipTests -pl python-api
[INFO] Scanning for projects...
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] Building livy-python-api 0.6.0-incubating-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ livy-python-api ---
[INFO] Deleting /root/incubator-livy/python-api/target
[INFO] 
[INFO] --- maven-antrun-plugin:1.8:run (python-api clean) @ livy-python-api ---
[INFO] Executing tasks

main:
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ livy-python-api ---
[INFO] 
[INFO] --- jacoco-maven-plugin:0.7.7.201606060606:prepare-agent (default) @ livy-python-api ---
[INFO] Skipping JaCoCo execution because property jacoco.skip is set.
[INFO] argLine set to empty
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ livy-python-api ---
[INFO] 
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ livy-python-api ---
[INFO] No sources to compile
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:exec (python-api install) @ livy-python-api ---
Traceback (most recent call last):
File "setup.py", line 57, in <module>
tests_require=['pytest']
File "/usr/lib/python2.7/distutils/core.py", line 111, in setup
_setup_distribution = dist = klass(attrs)
File "/usr/lib/python2.7/dist-packages/setuptools/dist.py", line 269, in __init__
self.fetch_build_eggs(attrs['setup_requires'])
File "/usr/lib/python2.7/dist-packages/setuptools/dist.py", line 313, in fetch_build_eggs
replace_conflicting=True,
File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 826, in resolve
dist = best[req.key] = env.best_match(req, ws, installer)
File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 1085, in best_match
dist = working_set.find(req)
File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 695, in find
raise VersionConflict(dist, req)
pkg_resources.VersionConflict: (setuptools 20.7.0 (/usr/lib/python2.7/dist-packages), Requirement.parse('setuptools>=30'))
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.054 s
[INFO] Finished at: 2018-02-05T12:38:13+00:00
[INFO] Final Memory: 33M/612M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (python-api install) on project livy-python-api: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
{code}
 

I got this issue on Livy from master branch and on Livy from branch-0.4.

 

I did some investigation on this issue before, and found that it's caused by some incompatibilities in Python dependencies of livy-python-api module, and solved it by explicitly setting version of flake8 Python package.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)