Re: Build failed in Jenkins: beam_PostCommit_Python_Verify #4711

[Valentyn Tymofieiev <va...@google.com>]

 Created https://issues.apache.org/jira/browse/BEAM-4105
<https://issues.apache.org/jira/browse/BEAM-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel>
to
track down this breakage.

On Mon, Apr 16, 2018 at 5:18 PM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> See <https://builds.apache.org/job/beam_PostCommit_Python_Verify
> /4711/display/redirect?page=changes>
>
> Changes:
>
> [github] Update containers at master to newly released
> beam-master-20180413.
>
> ------------------------------------------
> Started by GitHub push by aaltay
> [EnvInject] - Loading node environment variables.
> Building remotely on beam1 (beam) in workspace <
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/>
>  > git rev-parse --is-inside-work-tree # timeout=10
> Fetching changes from the remote Git repository
>  > git config remote.origin.url https://github.com/apache/beam.git #
> timeout=10
> Fetching upstream changes from https://github.com/apache/beam.git
>  > git --version # timeout=10
>  > git fetch --tags --progress https://github.com/apache/beam.git
> +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:re
> fs/remotes/origin/pr/${ghprbPullId}/*
>  > git rev-parse origin/master^{commit} # timeout=10
> Checking out Revision e1c526d7f88add0aa44635a56223a4907b81e86b
> (origin/master)
>  > git config core.sparsecheckout # timeout=10
>  > git checkout -f e1c526d7f88add0aa44635a56223a4907b81e86b
> Commit message: "Merge pull request #5131 from tvalentyn/patch-7"
>  > git rev-list --no-walk e5a17db4f4ccf30548bb18c96277e7afe1b8ae56 #
> timeout=10
> Cleaning workspace
>  > git rev-parse --verify HEAD # timeout=10
> Resetting working tree
>  > git reset --hard # timeout=10
>  > git clean -fdx # timeout=10
> [EnvInject] - Executing scripts and injecting environment variables after
> the SCM step.
> [EnvInject] - Injecting as environment variables the properties content
> SPARK_LOCAL_IP=127.0.0.1
>
> [EnvInject] - Variables injected successfully.
> [beam_PostCommit_Python_Verify] $ /bin/bash -xe
> /tmp/jenkins1458079275236088013.sh
> + cd src
> + bash sdks/python/run_postcommit.sh
>
> # pip install --user installation location.
> LOCAL_PATH=$HOME/.local/bin/
>
> # Remove any tox cache from previous workspace
> # TODO(udim): Remove this line and add '-r' to tox invocation instead.
> rm -rf sdks/python/target/.tox
>
> # INFRA does not install these packages
> pip install --user --upgrade virtualenv tox
> /usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339:
> SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject
> Name Indication) extension to TLS is not available on this platform. This
> may cause the server to present an incorrect TLS certificate, which can
> cause validation failures. You can upgrade to a newer version of Python to
> solve this. For more information, see https://urllib3.readthedocs.io
> /en/latest/advanced-usage.html#ssl-warnings
>   SNIMissingWarning
> /usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137:
> InsecurePlatformWarning: A true SSLContext object is not available. This
> prevents urllib3 from configuring SSL appropriately and may cause certain
> SSL connections to fail. You can upgrade to a newer version of Python to
> solve this. For more information, see https://urllib3.readthedocs.io
> /en/latest/advanced-usage.html#ssl-warnings
>   InsecurePlatformWarning
> /usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137:
> InsecurePlatformWarning: A true SSLContext object is not available. This
> prevents urllib3 from configuring SSL appropriately and may cause certain
> SSL connections to fail. You can upgrade to a newer version of Python to
> solve this. For more information, see https://urllib3.readthedocs.io
> /en/latest/advanced-usage.html#ssl-warnings
>   InsecurePlatformWarning
> Requirement already up-to-date: virtualenv in
> /home/jenkins/.local/lib/python2.7/site-packages (15.2.0)
> /usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137:
> InsecurePlatformWarning: A true SSLContext object is not available. This
> prevents urllib3 from configuring SSL appropriately and may cause certain
> SSL connections to fail. You can upgrade to a newer version of Python to
> solve this. For more information, see https://urllib3.readthedocs.io
> /en/latest/advanced-usage.html#ssl-warnings
>   InsecurePlatformWarning
> Requirement already up-to-date: tox in /home/jenkins/.local/lib/python2.7/site-packages
> (3.0.0)
> Requirement not upgraded as not directly required: py>=1.4.17 in
> /home/jenkins/.local/lib/python2.7/site-packages (from tox) (1.5.3)
> Requirement not upgraded as not directly required: pluggy<1.0,>=0.3.0 in
> /home/jenkins/.local/lib/python2.7/site-packages (from tox) (0.6.0)
> Requirement not upgraded as not directly required: six in
> /home/jenkins/.local/lib/python2.7/site-packages (from tox) (1.11.0)
> cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
> apache-beam 2.5.0.dev0 requires hdfs<3.0.0,>=2.1.0, which is not installed.
> apache-beam 2.5.0.dev0 requires pytz>=2018.3, which is not installed.
> apache-beam 2.5.0.dev0 has requirement grpcio<2,>=1.8, but you'll have
> grpcio 1.4.0 which is incompatible.
>
> # Tox runs unit tests in a virtual environment
> ${LOCAL_PATH}/tox -e ALL -c sdks/python/tox.ini
> GLOB sdist-make: <https://builds.apache.org/job
> /beam_PostCommit_Python_Verify/ws/src/sdks/python/setup.py>
> ERROR: invocation failed (exit code 1), logfile: <
> https://builds.apache.org/job/beam_PostCommit_Python_Verify
> /ws/src/sdks/python/target/.tox/log/tox-0.log>
> ERROR: actionid: tox
> msg: packaging
> cmdargs: ['/usr/bin/python', local('<https://builds.apache.
> org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/setup.py'),>
> 'sdist', '--formats=zip', '--dist-dir', local('<https://builds.apache.
> org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/
> target/.tox/dist')]>
>
> /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397:
> UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
>   normalized_version,
> Regenerating common_urns module.
> running sdist
> <https://builds.apache.org/job/beam_PostCommit_Python_Verify
> /ws/src/sdks/python/gen_protos.py>:51: UserWarning: Installing
> grpcio-tools is recommended for development.
>   warnings.warn('Installing grpcio-tools is recommended for development.')
> WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job
> /beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/grpcio-wheels>
> Process Process-1:
> Traceback (most recent call last):
>   File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in
> _bootstrap
>     self.run()
>   File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
>     self._target(*self._args, **self._kwargs)
>   File "<https://builds.apache.org/job/beam_PostCommit_Python_Verif
> y/ws/src/sdks/python/gen_protos.py",> line 149, in
> _install_grpcio_tools_and_generate_proto_files
>     shutil.rmtree(build_path)
>   File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
>     onerror(os.listdir, path, sys.exc_info())
>   File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
>     names = os.listdir(path)
> OSError: [Errno 2] No such file or directory: '<
> https://builds.apache.org/job/beam_PostCommit_Python_Verif
> y/ws/src/sdks/python/.eggs/grpcio-wheels-build'>
> Traceback (most recent call last):
>   File "setup.py", line 235, in <module>
>     'test': generate_protos_first(test),
>   File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py",
> line 129, in setup
>     return distutils.core.setup(**attrs)
>   File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
>     dist.run_commands()
>   File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
>     self.run_command(cmd)
>   File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
>     cmd_obj.run()
>   File "setup.py", line 141, in run
>     gen_protos.generate_proto_files()
>   File "<https://builds.apache.org/job/beam_PostCommit_Python_Verif
> y/ws/src/sdks/python/gen_protos.py",> line 97, in generate_proto_files
>     raise ValueError("Proto generation failed (see log for details).")
> ValueError: Proto generation failed (see log for details).
>
> ERROR: FAIL could not package project - v = InvocationError('/usr/bin/python
> <https://builds.apache.org/job/beam_PostCommit_Python_Verify
> /ws/src/sdks/python/setup.py> sdist --formats=zip --dist-dir <
> https://builds.apache.org/job/beam_PostCommit_Python_Verify
> /ws/src/sdks/python/target/.tox/dist> (see <https://builds.apache.org/job
> /beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.
> tox/log/tox-0.log)',> 1)
> Build step 'Execute shell' marked build as failure
> Not sending mail to unregistered user github@alasdairhodge.co.uk
> Not sending mail to unregistered user swegner@google.com
> Not sending mail to unregistered user sidhom@google.com
>