You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/10/20 12:30:14 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Spark #1473

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/1473/display/redirect>

Changes:


------------------------------------------
[...truncated 446.77 KB...]

> Configure project :sdks:go
Found go 1.12 in /usr/bin/go, use it.

> Configure project :sdks:go:container
Found go 1.12 in /usr/bin/go, use it.

> Configure project :sdks:go:examples
Found go 1.12 in /usr/bin/go, use it.

> Configure project :sdks:go:test
Found go 1.12 in /usr/bin/go, use it.

> Configure project :sdks:python:container
Found go 1.12 in /usr/bin/go, use it.

> Task :sdks:java:container:generateLicenseReport

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD SUCCESSFUL in 20s
1 actionable task: 1 executed

Publishing build scan...
https://gradle.com/s/vquktvsbg3doi

Already using interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python3>
Not overwriting existing python script <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python> (you must use <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python3)>
Installing setuptools, pip, wheel...
done.
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Requirement already satisfied: beautifulsoup4<5.0,>=4.9.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) (4.9.3)
Requirement already satisfied: future<1.0.0,>=0.16.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 20)) (0.18.2)
Requirement already satisfied: pyyaml<6.0.0,>=3.12 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 21)) (5.3.1)
Requirement already satisfied: tenacity<6.0,>=5.0.2 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from -r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 22)) (5.1.5)
Requirement already satisfied: soupsieve>1.2; python_version >= "3.0" in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from beautifulsoup4<5.0,>=4.9.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 19)) (2.0.1)
Requirement already satisfied: six>=1.9.0 in ./sdks/java/container/build/virtualenv/lib/python3.5/site-packages (from tenacity<6.0,>=5.0.2->-r <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/requirement.txt> (line 22)) (1.15.0)
Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> 
INFO:root:Pulling license for 180 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 2.999722 seconds with 16 threads.
Copy licenses to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:python:container:py38:docker
Sending build context to Docker daemon  38.03MB
Step 1/23 : ARG py_version
Step 2/23 : FROM python:"${py_version}"-buster
3.8-buster: Pulling from library/python
Digest: sha256:8f4fc98cddde0c0618c6abccb54de52a25485b60bd5a3acc30c2c55ae732237f
Status: Downloaded newer image for python:3.8-buster
 ---> a52c041f5098
Step 3/23 : MAINTAINER "Apache Beam <de...@beam.apache.org>"
 ---> Running in 01a3f7dfe6a2
Removing intermediate container 01a3f7dfe6a2
 ---> f946aa78c5a4
Step 4/23 : ARG pull_licenses
 ---> Running in 1dfdde4498bc
Removing intermediate container 1dfdde4498bc
 ---> 7c97372e7cc3
Step 5/23 : RUN apt-get update &&     apt-get install -y        libsnappy-dev        libyaml-dev        ccache        &&     rm -rf /var/lib/apt/lists/*
 ---> Running in ba862d8a9b68
Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
Get:2 http://deb.debian.org/debian buster InRelease [121 kB]
Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
Get:4 http://security.debian.org/debian-security buster/updates/main amd64 Packages [239 kB]
Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7906 kB]
Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [7868 B]
Fetched 8392 kB in 2s (4012 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
libyaml-dev is already the newest version (0.2.1-1).
Suggested packages:
  distcc | icecc
The following NEW packages will be installed:
  ccache libsnappy-dev libsnappy1v5
0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded.
Need to get 203 kB of archives.
After this operation, 514 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB]
Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB]
Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 203 kB in 0s (2340 kB/s)
Selecting previously unselected package ccache.
(Reading database ... 
(Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%(Reading database ... 24603 files and directories currently installed.)
Preparing to unpack .../ccache_3.6-1_amd64.deb ...
Unpacking ccache (3.6-1) ...
Selecting previously unselected package libsnappy1v5:amd64.
Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ...
Unpacking libsnappy1v5:amd64 (1.1.7-1) ...
Selecting previously unselected package libsnappy-dev:amd64.
Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ...
Unpacking libsnappy-dev:amd64 (1.1.7-1) ...
Setting up ccache (3.6-1) ...
Updating symlinks in /usr/lib/ccache ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libsnappy-dev:amd64 (1.1.7-1) ...
Processing triggers for libc-bin (2.28-10) ...
Removing intermediate container ba862d8a9b68
 ---> 6082730ab2d4
Step 6/23 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
 ---> cc659b243d8b
Step 7/23 : RUN     pip install -r /tmp/base_image_requirements.txt &&     python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" &&     rm -rf /root/.cache/pip &&     rm -rf /tmp/base_image_requirements.txt
 ---> Running in 7cdb9e7d2ec2
Ignoring avro: markers 'python_version <= "2.7"' don't match your environment
Ignoring futures: markers 'python_version < "3.0"' don't match your environment
Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment
Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment
Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment
Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment
Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment
Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment
Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment
Collecting avro-python3==1.8.2
  Downloading avro-python3-1.8.2.tar.gz (36 kB)
Collecting fastavro==1.0.0.post1
  Downloading fastavro-1.0.0.post1-cp38-cp38-manylinux2014_x86_64.whl (1.7 MB)
Collecting crcmod==1.7
  Downloading crcmod-1.7.tar.gz (89 kB)

> Task :sdks:java:container:copyDockerfileDependencies UP-TO-DATE

> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go>

> Task :sdks:python:container:py38:docker
Collecting dill==0.3.1.1
  Downloading dill-0.3.1.1.tar.gz (151 kB)
Collecting future==0.18.2
  Downloading future-0.18.2.tar.gz (829 kB)
Collecting grpcio==1.29.0
  Downloading grpcio-1.29.0-cp38-cp38-manylinux2010_x86_64.whl (3.0 MB)
Collecting hdfs==2.5.8
  Downloading hdfs-2.5.8.tar.gz (41 kB)
Collecting httplib2==0.12.0
  Downloading httplib2-0.12.0.tar.gz (218 kB)
Collecting mock==2.0.0
  Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting oauth2client==4.1.3
  Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)

> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:java:container:goBuild

> Task :sdks:python:container:py38:docker
Collecting protobuf==3.12.2
  Downloading protobuf-3.12.2-cp38-cp38-manylinux1_x86_64.whl (1.3 MB)
Collecting pyarrow==0.16.0
  Downloading pyarrow-0.16.0-cp38-cp38-manylinux2014_x86_64.whl (63.2 MB)
Collecting pydot==1.4.1
  Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting pytz==2019.3
  Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB)
Collecting pyyaml==5.1
  Downloading PyYAML-5.1.tar.gz (274 kB)
Collecting typing-extensions==3.7.4.3
  Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting google-api-core==1.22.0
  Downloading google_api_core-1.22.0-py2.py3-none-any.whl (91 kB)
Collecting google-apitools==0.5.28
  Downloading google-apitools-0.5.28.tar.gz (172 kB)
Collecting google-cloud-pubsub==1.0.2
  Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery==1.26.1
  Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB)
Collecting google-cloud-bigtable==1.0.0
  Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-core==1.4.1
  Downloading google_cloud_core-1.4.1-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-datastore==1.7.4
  Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)

> Task :sdks:java:container:dockerPrepare

> Task :sdks:python:container:py38:docker FAILED
The command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt &&     python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" &&     rm -rf /root/.cache/pip &&     rm -rf /tmp/base_image_requirements.txt' returned a non-zero code: 2

> Task :sdks:java:container:docker
 ---> 158f65bbe04c
Step 8/17 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> 7570422efb69
Step 9/17 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> 1148efd92890
Step 10/17 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 5976a12b7dad
Step 11/17 : COPY target/LICENSE /opt/apache/beam/
 ---> daedcf6562f2
Step 12/17 : COPY target/NOTICE /opt/apache/beam/
 ---> d54c1687a1a8
Step 13/17 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
 ---> 6d2626c3854f
Step 14/17 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 97ba4f7023f0
Step 15/17 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 2b5ab442fb6f
Removing intermediate container 2b5ab442fb6f
 ---> 0d334df7eaf5
Step 16/17 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in ef440fa74028
Removing intermediate container ef440fa74028
 ---> 3c9f719dab97
Step 17/17 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in a6b54677043f
Removing intermediate container a6b54677043f
 ---> 03d57cf10592
Successfully built 03d57cf10592
Successfully tagged apache/beam_java8_sdk:2.26.0.dev

> Task :runners:spark:job-server:sparkJobServerCleanup
Stopping job server pid: 16984.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 2

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1m 7s
135 actionable tasks: 28 executed, 107 up-to-date

Publishing build scan...
https://gradle.com/s/dhegewue4nlao

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
No JDK named ‘JDK 1.8 (latest)’ found

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_Spark #1474

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/1474/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org