You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2019/11/25 20:39:00 UTC
[jira] [Updated] (BEAM-8793) installGcpTest task flakes (python
setup.py egg_info fails)
[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kyle Weaver updated BEAM-8793:
------------------------------
Summary: installGcpTest task flakes (python setup.py egg_info fails) (was: installGcpTest task flakes)
> installGcpTest task flakes (python setup.py egg_info fails)
> -----------------------------------------------------------
>
> Key: BEAM-8793
> URL: https://issues.apache.org/jira/browse/BEAM-8793
> Project: Beam
> Issue Type: Improvement
> Components: test-failures
> Reporter: Kyle Weaver
> Priority: Major
>
> This seems to affect the installGcpTest task for all python versions. There are a few different failure modes, but they look like they might be related.
> == 1 ==
> 11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED
> 11:01:38 Obtaining file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python
> 11:01:38 ERROR: Command errored out with exit status 1:
> 11:01:38 command: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"'; __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
> 11:01:38 cwd: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/
> 11:01:38 Complete output (37 lines):
> 11:01:38 Traceback (most recent call last):
> 11:01:38 File "<string>", line 1, in <module>
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py", line 264, in <module>
> 11:01:38 'test': generate_protos_first(test),
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py", line 144, in setup
> 11:01:38 _install_setup_requires(attrs)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py", line 139, in _install_setup_requires
> 11:01:38 dist.fetch_build_eggs(dist.setup_requires)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py", line 720, in fetch_build_eggs
> 11:01:38 replace_conflicting=True,
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py", line 782, in resolve
> 11:01:38 replace_conflicting=replace_conflicting
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py", line 1065, in best_match
> 11:01:38 return self.obtain(req, installer)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py", line 1077, in obtain
> 11:01:38 return installer(requirement)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py", line 787, in fetch_build_egg
> 11:01:38 return cmd.easy_install(req)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 679, in easy_install
> 11:01:38 return self.install_item(spec, dist.location, tmpdir, deps)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 705, in install_item
> 11:01:38 dists = self.install_eggs(spec, download, tmpdir)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 855, in install_eggs
> 11:01:38 return [self.install_wheel(dist_filename, tmpdir)]
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", line 1073, in install_wheel
> 11:01:38 os.path.dirname(destination)
> 11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in execute
> 11:01:38 util.execute(func, args, msg, dry_run=self.dry_run)
> 11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in execute
> 11:01:38 func(*args)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", line 101, in install_as_egg
> 11:01:38 self._install_as_egg(destination_eggdir, zf)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", line 109, in _install_as_egg
> 11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info, egg_info)
> 11:01:38 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", line 154, in _convert_metadata
> 11:01:38 os.rename(dist_info, egg_info)
> 11:01:38 FileNotFoundError: [Errno 2] No such file or directory: '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info' -> '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO'
> 11:01:38 ----------------------------------------
> 11:01:38 ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
> Another error I saw was:
> == 2 ==
> 12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED
> 12:35:25 Obtaining file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python
> 12:35:25 ERROR: Command errored out with exit status 1:
> 12:35:25 command: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"'; __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
> 12:35:25 cwd: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/
> 12:35:25 Complete output (29 lines):
> 12:35:25 Traceback (most recent call last):
> 12:35:25 File "<string>", line 1, in <module>
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py", line 259, in <module>
> 12:35:25 'test': generate_protos_first(test),
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py", line 144, in setup
> 12:35:25 _install_setup_requires(attrs)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py", line 139, in _install_setup_requires
> 12:35:25 dist.fetch_build_eggs(dist.setup_requires)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py", line 720, in fetch_build_eggs
> 12:35:25 replace_conflicting=True,
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py", line 782, in resolve
> 12:35:25 replace_conflicting=replace_conflicting
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py", line 1065, in best_match
> 12:35:25 return self.obtain(req, installer)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py", line 1077, in obtain
> 12:35:25 return installer(requirement)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py", line 787, in fetch_build_egg
> 12:35:25 return cmd.easy_install(req)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 679, in easy_install
> 12:35:25 return self.install_item(spec, dist.location, tmpdir, deps)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 705, in install_item
> 12:35:25 dists = self.install_eggs(spec, download, tmpdir)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 855, in install_eggs
> 12:35:25 return [self.install_wheel(dist_filename, tmpdir)]
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 1079, in install_wheel
> 12:35:25 return self.egg_distribution(destination)
> 12:35:25 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 897, in egg_distribution
> 12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path))
> 12:35:25 zipimport.ZipImportError: not a Zip file
> 12:35:25 ----------------------------------------
> 12:35:25 ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
> == 3 ==
> 07:56:50 > Task :sdks:python:test-suites:portable:py2:installGcpTest FAILED
> ...
> 07:56:50 File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py", line 110, in _install_as_egg
> 07:56:50 self._convert_metadata(zf, destination_eggdir, dist_info, egg_info)
> 07:56:50 File "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py", line 131, in _convert_metadata
> 07:56:50 os.mkdir(destination_eggdir)
> 07:56:50 OSError: [Errno 17] File exists: '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg'
> 07:56:50 ----------------------------------------
> 07:56:50 ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)