You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/11/14 02:57:22 UTC

Build failed in Jenkins: beam_PostCommit_Python2 #982

See <https://builds.apache.org/job/beam_PostCommit_Python2/982/display/redirect?page=changes>

Changes:

[github] [BEAM-7233, BEAM-6868] Create an implementation for a bundle finalizer


------------------------------------------
[...truncated 626.33 KB...]
real	1m58.766s
user	0m3.192s
sys	0m1.110s
+ docker-compose -p hdfs_IT-jenkins-beam_PostCommit_Python2-982 --no-ansi up --exit-code-from test --abort-on-container-exit --force-recreate

> Task :sdks:python:test-suites:portable:py2:postCommitPy2

> Task :sdks:python:test-suites:direct:py2:hdfsIntegrationTest
Creating network "hdfs_it-jenkins-beam_postcommit_python2-982_test_net" with the default driver
Pulling namenode (uhopper/hadoop-namenode:2.8.1)...
Pulling datanode (uhopper/hadoop-datanode:2.8.1)...
Creating hdfs_it-jenkins-beam_postcommit_python2-982_namenode_1 ... 
Creating hdfs_it-jenkins-beam_postcommit_python2-982_namenode_1 ... done
Creating hdfs_it-jenkins-beam_postcommit_python2-982_datanode_1 ... 
Creating hdfs_it-jenkins-beam_postcommit_python2-982_datanode_1 ... done
Creating hdfs_it-jenkins-beam_postcommit_python2-982_test_1     ... 
Creating hdfs_it-jenkins-beam_postcommit_python2-982_test_1     ... done
Stopping hdfs_it-jenkins-beam_postcommit_python2-982_datanode_1 ... 
Stopping hdfs_it-jenkins-beam_postcommit_python2-982_namenode_1 ... 
Stopping hdfs_it-jenkins-beam_postcommit_python2-982_datanode_1 ... done
Stopping hdfs_it-jenkins-beam_postcommit_python2-982_namenode_1 ... done

real	1m39.526s
user	0m1.226s
sys	0m0.175s
+ finally
+ docker-compose -p hdfs_IT-jenkins-beam_PostCommit_Python2-982 --no-ansi down
Removing hdfs_it-jenkins-beam_postcommit_python2-982_test_1     ... 
Removing hdfs_it-jenkins-beam_postcommit_python2-982_datanode_1 ... 
Removing hdfs_it-jenkins-beam_postcommit_python2-982_namenode_1 ... 
Removing hdfs_it-jenkins-beam_postcommit_python2-982_datanode_1 ... done
Removing hdfs_it-jenkins-beam_postcommit_python2-982_test_1     ... done
Removing hdfs_it-jenkins-beam_postcommit_python2-982_namenode_1 ... done
Removing network hdfs_it-jenkins-beam_postcommit_python2-982_test_net

real	0m0.987s
user	0m0.624s
sys	0m0.113s

> Task :sdks:python:test-suites:direct:py2:mongodbioIT
Using default tag: latest
latest: Pulling from library/mongo
7ddbc47eeb70: Pulling fs layer
c1bbdc448b72: Pulling fs layer
8c3b70e39044: Pulling fs layer
45d437916d57: Pulling fs layer
e119fb0e0a55: Pulling fs layer
91f0b9bae1ea: Pulling fs layer
53e7c2967f11: Pulling fs layer
69a945568374: Pulling fs layer
93333bc225a7: Pulling fs layer
b9c10bd6c9bd: Pulling fs layer
7f4e3538e99c: Pulling fs layer
53e7c2967f11: Waiting
1164b51d180a: Pulling fs layer
a715a7d71f27: Pulling fs layer
e119fb0e0a55: Waiting
91f0b9bae1ea: Waiting
7f4e3538e99c: Waiting
a715a7d71f27: Waiting
1164b51d180a: Waiting
69a945568374: Waiting
45d437916d57: Waiting
b9c10bd6c9bd: Waiting
93333bc225a7: Waiting
c1bbdc448b72: Verifying Checksum
c1bbdc448b72: Download complete
8c3b70e39044: Download complete
7ddbc47eeb70: Verifying Checksum
7ddbc47eeb70: Download complete
45d437916d57: Verifying Checksum
45d437916d57: Download complete
e119fb0e0a55: Verifying Checksum
e119fb0e0a55: Download complete
69a945568374: Download complete
91f0b9bae1ea: Verifying Checksum
91f0b9bae1ea: Download complete
53e7c2967f11: Download complete
93333bc225a7: Download complete
b9c10bd6c9bd: Verifying Checksum
b9c10bd6c9bd: Download complete
a715a7d71f27: Verifying Checksum
a715a7d71f27: Download complete
1164b51d180a: Download complete
7ddbc47eeb70: Pull complete
c1bbdc448b72: Pull complete
8c3b70e39044: Pull complete
45d437916d57: Pull complete
7f4e3538e99c: Verifying Checksum
7f4e3538e99c: Download complete
e119fb0e0a55: Pull complete
91f0b9bae1ea: Pull complete
53e7c2967f11: Pull complete
69a945568374: Pull complete
93333bc225a7: Pull complete
b9c10bd6c9bd: Pull complete
7f4e3538e99c: Pull complete
1164b51d180a: Pull complete
a715a7d71f27: Pull complete
Digest: sha256:2704b1f2ad53c0c5fb029fc112f99b5e9acdca3ab869095a3f8c6d14b2e3c0f3
Status: Downloaded newer image for mongo:latest
4e25381eec873dbccb2b2adffec954054a92bc73f47e89b89a9b513d1b24178c
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.7)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.3.1.1)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.21.24)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.25.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (2.5.8)
Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.12.0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (2.0.0)
Requirement already satisfied: numpy<2,>=1.14.3 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.16.5)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (3.9.0)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (3.10.0)
Requirement already satisfied: pydot<2,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.4.1)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (2019.3)
Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.9.1)
Requirement already satisfied: funcsigs<2,>=1.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.0.2)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (3.3.0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.6.8)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (3.6.6)
Requirement already satisfied: pyarrow<0.16.0,>=0.15.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.15.1)
Requirement already satisfied: nose>=1.3.7 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.3.7)
Requirement already satisfied: nose_xunitmp>=0.4.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.4.1)
Requirement already satisfied: pandas<0.25,>=0.23.4 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.24.2)
Requirement already satisfied: parameterized<0.7.0,>=0.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (0.6.3)
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.9.0)
Requirement already satisfied: pyyaml<6.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (5.1.2)
Requirement already satisfied: requests_mock<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.7.0)
Requirement already satisfied: tenacity<6.0,>=5.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (5.1.5)
Requirement already satisfied: pytest<5.0,>=4.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (4.6.6)
Requirement already satisfied: pytest-xdist<2,>=1.29.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from apache-beam==2.18.0.dev0) (1.30.0)
Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.18.0.dev0) (1.13.0)
Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.18.0.dev0) (1.1.6)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.18.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.18.0.dev0) (2.22.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.18.0.dev0) (5.4.3)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.18.0.dev0) (0.4.7)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.18.0.dev0) (0.2.7)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.18.0.dev0) (4.0)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.18.0.dev0) (41.6.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pydot<2,>=1.2.0->apache-beam==2.18.0.dev0) (2.4.5)
Requirement already satisfied: monotonic>=0.6; python_version == "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from tenacity<6.0,>=5.0.2->apache-beam==2.18.0.dev0) (1.5)
Requirement already satisfied: atomicwrites>=1.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (1.3.0)
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (19.2)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (0.1.7)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (0.23)
Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (1.8.0)
Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (2.3.5)
Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (0.13.0)
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (19.3.0)
Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (5.0.0)
Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.18.0.dev0) (1.1.3)
Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.18.0.dev0) (1.7.1)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.18.0.dev0) (1.25.7)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.18.0.dev0) (2019.9.11)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.18.0.dev0) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.18.0.dev0) (2.8)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (0.6.0)
Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (4.0.2)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.18.0.dev0) (1.10.0)
Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.18.0.dev0) (1.5)
Installing collected packages: apache-beam
  Found existing installation: apache-beam 2.18.0.dev0
    Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155>
    Can't uninstall 'apache-beam'. No files were found to uninstall.
  Running setup.py develop for apache-beam
Successfully installed apache-beam
<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
  'You are using Apache Beam with Python 2. '
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:root:Writing 100000 documents to mongodb
<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:68: FutureWarning: WriteToMongoDB is experimental.
  known_args.batch_size)
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7fc1be438140> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7fc1be438230> ====================
INFO:root:==================== <function lift_combiners at 0x7fc1be4382a8> ====================
INFO:root:==================== <function expand_sdf at 0x7fc1be438320> ====================
INFO:root:==================== <function expand_gbk at 0x7fc1be438398> ====================
INFO:root:==================== <function sink_flattens at 0x7fc1be438488> ====================
INFO:root:==================== <function greedily_fuse at 0x7fc1be438500> ====================
INFO:root:==================== <function read_to_impulse at 0x7fc1be438578> ====================
INFO:root:==================== <function impulse_to_input at 0x7fc1be4385f0> ====================
INFO:root:==================== <function inject_timer_pcollections at 0x7fc1be438758> ====================
INFO:root:==================== <function sort_stages at 0x7fc1be4387d0> ====================
INFO:root:==================== <function window_pcollection_coders at 0x7fc1be438848> ====================
INFO:root:Creating state cache with size 100
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.EmbeddedWorkerHandler object at 0x7fc1bf0de550> for environment urn: "beam:env:embedded_python:v1"

INFO:root:Running (ref_AppliedPTransform_Create documents/Read_3)+((ref_AppliedPTransform_WriteToMongoDB/ParDo(_GenerateObjectIdFn)_5)+((ref_AppliedPTransform_WriteToMongoDB/Reshuffle/AddRandomKeys_7)+((ref_AppliedPTransform_WriteToMongoDB/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9)+(WriteToMongoDB/Reshuffle/ReshufflePerKey/GroupByKey/Write))))
INFO:root:Running ((WriteToMongoDB/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_WriteToMongoDB/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_14))+((ref_AppliedPTransform_WriteToMongoDB/Reshuffle/RemoveRandomKeys_15)+(ref_AppliedPTransform_WriteToMongoDB/ParDo(_WriteMongoFn)_16))
INFO:root:Writing 100000 documents to mongodb finished in 53.573 seconds
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:root:Reading from mongodb beam_mongodbio_it_db:integration_test_1573700161
<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:83: FutureWarning: ReadFromMongoDB is experimental.
  | 'Map' >> beam.Map(lambda doc: doc['number'])
INFO:root:==================== <function annotate_downstream_side_inputs at 0x7fc1be438140> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7fc1be438230> ====================
INFO:root:==================== <function lift_combiners at 0x7fc1be4382a8> ====================
INFO:root:==================== <function expand_sdf at 0x7fc1be438320> ====================
INFO:root:==================== <function expand_gbk at 0x7fc1be438398> ====================
INFO:root:==================== <function sink_flattens at 0x7fc1be438488> ====================
INFO:root:==================== <function greedily_fuse at 0x7fc1be438500> ====================
INFO:root:==================== <function read_to_impulse at 0x7fc1be438578> ====================
INFO:root:==================== <function impulse_to_input at 0x7fc1be4385f0> ====================
INFO:root:==================== <function inject_timer_pcollections at 0x7fc1be438758> ====================
INFO:root:==================== <function sort_stages at 0x7fc1be4387d0> ====================
INFO:root:==================== <function window_pcollection_coders at 0x7fc1be438848> ====================
INFO:root:Creating state cache with size 100
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.EmbeddedWorkerHandler object at 0x7fc1b5f49690> for environment urn: "beam:env:embedded_python:v1"

INFO:root:Running ((ref_AppliedPTransform_assert_that/Create/Read_7)+((ref_AppliedPTransform_assert_that/Group/pair_with_0_11)+(assert_that/Group/Flatten/Transcode/0)))+(assert_that/Group/Flatten/Write/0)
INFO:root:Running ((ref_AppliedPTransform_ReadFromMongoDB/Read_3)+((ref_AppliedPTransform_Map_4)+((ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_8)+((ref_AppliedPTransform_assert_that/ToVoidKey_9)+((ref_AppliedPTransform_assert_that/Group/pair_with_1_12)+(assert_that/Group/Flatten/Transcode/1))))))+(assert_that/Group/Flatten/Write/1)
INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write)
INFO:root:Running (assert_that/Group/GroupByKey/Read)+((ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_18)+((ref_AppliedPTransform_assert_that/Unkey_19)+(ref_AppliedPTransform_assert_that/Match_20)))
INFO:root:Read 100000 documents from mongodb finished in 22.406 seconds
mongoioit27344
mongoioit27344

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/build.gradle'> line: 46

* What went wrong:
Execution failed for task ':sdks:python:sdist'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 41s
113 actionable tasks: 88 executed, 22 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/syn3xa74jsy5g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Python2 #984

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python2/984/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python2 #983

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python2/983/display/redirect>

Changes:


------------------------------------------
[...truncated 114.71 KB...]
53e7c2967f11: Download complete
69a945568374: Verifying Checksum
69a945568374: Download complete
7ddbc47eeb70: Verifying Checksum
7ddbc47eeb70: Download complete
93333bc225a7: Verifying Checksum
93333bc225a7: Download complete
b9c10bd6c9bd: Verifying Checksum
b9c10bd6c9bd: Download complete
1164b51d180a: Verifying Checksum
1164b51d180a: Download complete
a715a7d71f27: Verifying Checksum
a715a7d71f27: Download complete
7f4e3538e99c: Verifying Checksum
7f4e3538e99c: Download complete
7ddbc47eeb70: Pull complete
c1bbdc448b72: Pull complete
8c3b70e39044: Pull complete
45d437916d57: Pull complete
e119fb0e0a55: Pull complete
91f0b9bae1ea: Pull complete
53e7c2967f11: Pull complete
69a945568374: Pull complete
93333bc225a7: Pull complete
b9c10bd6c9bd: Pull complete
7f4e3538e99c: Pull complete
1164b51d180a: Pull complete
a715a7d71f27: Pull complete
Digest: sha256:2704b1f2ad53c0c5fb029fc112f99b5e9acdca3ab869095a3f8c6d14b2e3c0f3
Status: Downloaded newer image for mongo:latest

> Task :runners:flink:1.9:job-server-container:copyDockerfileDependencies
> Task :runners:flink:1.9:job-server-container:dockerPrepare

> Task :runners:flink:1.9:job-server-container:docker
Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [508 kB]
Get:7 http://deb.debian.org/debian stretch-updates/main amd64 Packages [27.9 kB]
Get:8 http://deb.debian.org/debian stretch/main amd64 Packages [7086 kB]

> Task :sdks:python:test-suites:direct:py2:mongodbioIT FAILED
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python>
    ERROR: Command errored out with exit status 1:
     command: <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/bin/python2.7> -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/setup.py'"'"';> __file__='"'"'<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/setup.py'"'"';f=getattr(tokenize,> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
         cwd: <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/>
    Complete output (27 lines):
    <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/setup.py>:198: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
      'You are using Apache Beam with Python 2. '
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/setup.py",> line 264, in <module>
        'test': generate_protos_first(test),
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/setuptools/__init__.py",> line 144, in setup
        _install_setup_requires(attrs)
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/setuptools/__init__.py",> line 139, in _install_setup_requires
        dist.fetch_build_eggs(dist.setup_requires)
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/setuptools/dist.py",> line 720, in fetch_build_eggs
        replace_conflicting=True,
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 794, in resolve
        new_requirements = dist.requires(req.extras)[::-1]
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 2736, in requires
        dm = self._dep_map
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 3023, in _dep_map
        self.__dep_map = self._compute_dependencies()
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 3032, in _compute_dependencies
        for req in self._parsed_pkg_info.get_all('Requires-Dist') or []:
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 3014, in _parsed_pkg_info
        metadata = self.get_metadata(self.PKG_INFO)
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 1420, in get_metadata
        value = self._get(path)
      File "<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/build/gradleenv/45127155/local/lib/python2.7/site-packages/pkg_resources/__init__.py",> line 1616, in _get
        with open(path, 'rb') as stream:
    IOError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg/pytest_runner-5.2.dist-info/METADATA'>
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

> Task :runners:flink:1.9:job-server-container:docker
Fetched 7927 kB in 2s (3806 kB/s)
Reading package lists...
Reading package lists...
> Task :runners:spark:job-server:shadowJar

> Task :runners:flink:1.9:job-server-container:docker

Building dependency tree...
Reading state information...
The following NEW packages will be installed:
  libltdl7
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 389 kB of archives.
After this operation, 427 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian stretch/main amd64 libltdl7 amd64 2.4.6-2 [389 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 389 kB in 0s (5481 kB/s)
Selecting previously unselected package libltdl7:amd64.
(Reading database ... 
(Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%(Reading database ... 12447 files and directories currently installed.)
Preparing to unpack .../libltdl7_2.4.6-2_amd64.deb ...
Unpacking libltdl7:amd64 (2.4.6-2) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
Setting up libltdl7:amd64 (2.4.6-2) ...
Processing triggers for libc-bin (2.24-11+deb9u4) ...
Removing intermediate container 80586e8755b0
 ---> 3ac9e82ffefc
Step 4/7 : ADD beam-runners-flink-job-server.jar /opt/apache/beam/jars/
 ---> d536931f8eb5
Step 5/7 : ADD flink-job-server.sh /opt/apache/beam/
 ---> 571a29a9e913
Step 6/7 : WORKDIR /opt/apache/beam
 ---> Running in 7419c3f74514
Removing intermediate container 7419c3f74514
 ---> 836428adcf65
Step 7/7 : ENTRYPOINT ["./flink-job-server.sh"]
 ---> Running in 2739667cdaf6
Removing intermediate container 2739667cdaf6
 ---> 92ef76598d2a
Successfully built 92ef76598d2a
Successfully tagged jenkins-docker-apache.bintray.io/beam/flink-job-server:latest

> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]

> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild

> Task :sdks:python:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/go>

> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/go>

> Task :sdks:python:container:installDependencies
> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:dockerPrepare
> Task :sdks:python:container:buildDarwinAmd64

> Task :sdks:java:container:docker
 ---> Running in 39bd0d66ca8a
Removing intermediate container 39bd0d66ca8a
 ---> e09d5b76f4b6
Step 3/9 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
 ---> 40fa92798c46
Step 4/9 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
 ---> 0d61c1914e15
Step 5/9 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/

> Task :sdks:python:container:buildLinuxAmd64
> Task :sdks:python:container:goBuild
> Task :sdks:python:container:py2:copyLauncherDependencies

> Task :sdks:java:container:docker
 ---> caf33ece9e76
Step 6/9 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> dfefa9f3e330
Step 7/9 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> 5a754442b604
Step 8/9 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 27a902b6129b
Step 9/9 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 28794429a5bc
Removing intermediate container 28794429a5bc
 ---> a213d4f81d35
Successfully built a213d4f81d35
Successfully tagged apachebeam/java_sdk:2.18.0-SNAPSHOT

FAILURE: Build completed with 5 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/build.gradle'> line: 46

* What went wrong:
Execution failed for task ':sdks:python:sdist'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py2:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

5: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/test-suites/direct/py2/build.gradle'> line: 107

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py2:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 50s
108 actionable tasks: 84 executed, 21 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/wxkg6a6nr6o4u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org