You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/11/22 22:23:40 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4876
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4876/display/redirect?page=changes>
Changes:
[sunjincheng121] [BEAM-8619] Move reusable information to BundleProcessor.
[sunjincheng121] [BEAM-8619] Extract tearDown functions into BundleProcessor.
[sunjincheng121] [BEAM-8619] Reuse the BundleProcessor between bundles for the same
[sunjincheng121] [BEAM-8619] Teardown the DoFns when upon control service termination for
------------------------------------------
[...truncated 593.58 KB...]
Downloading https://files.pythonhosted.org/packages/ad/e7/371d64fc6c6fce53c490fc38816a77fe8c75ff608edc0807170ff3c62bf2/timeloop-1.0.2-py2-none-any.whl#sha256=70cb69eeef39968ea0e6dd68a3a3a51257d5f4aa27b177ab1b19ca86ff525946
Best match: timeloop 1.0.2
Processing timeloop-1.0.2-py2-none-any.whl
Installing timeloop-1.0.2-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/timeloop-1.0.2-py2.7.egg>
Searching for ipython<6,>=5.8.0
Reading https://pypi.org/simple/ipython/
Downloading https://files.pythonhosted.org/packages/b0/88/d996ab8be22cea1eaa18baee3678a11265e18cf09974728d683c51102148/ipython-5.8.0-py2-none-any.whl#sha256=37101b8cbe072fe17bff100bc03d096404e4a9a0357097aeb5b61677c042cab1
Best match: ipython 5.8.0
Processing ipython-5.8.0-py2-none-any.whl
Installing ipython-5.8.0-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython-5.8.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython-5.8.0-py2.7.egg>
Searching for facets-overview<2,>=1.0.0
Reading https://pypi.org/simple/facets-overview/
Downloading https://files.pythonhosted.org/packages/df/8a/0042de5450dbd9e7e0773de93fe84c999b5b078b1f60b4c19ac76b5dd889/facets_overview-1.0.0-py2.py3-none-any.whl#sha256=bda7e7b68ff68f5757af87b9cf8b76994ab15db08db2155e15e4eae58695f4ae
Best match: facets-overview 1.0.0
Processing facets_overview-1.0.0-py2.py3-none-any.whl
Installing facets_overview-1.0.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/facets_overview-1.0.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/facets_overview-1.0.0-py2.7.egg>
Searching for traitlets>=4.2
Reading https://pypi.org/simple/traitlets/
Downloading https://files.pythonhosted.org/packages/ca/ab/872a23e29cec3cf2594af7e857f18b687ad21039c1f9b922fac5b9b142d5/traitlets-4.3.3-py2.py3-none-any.whl#sha256=70b4c6a1d9019d7b4f6846832288f86998aa3b9207c6821f3578a6a6a467fe44
Best match: traitlets 4.3.3
Processing traitlets-4.3.3-py2.py3-none-any.whl
Installing traitlets-4.3.3-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/traitlets-4.3.3-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/traitlets-4.3.3-py2.7.egg>
Searching for simplegeneric>0.8
Reading https://pypi.org/simple/simplegeneric/
Downloading https://files.pythonhosted.org/packages/3d/57/4d9c9e3ae9a255cd4e1106bb57e24056d3d0709fc01b2e3e345898e49d5b/simplegeneric-0.8.1.zip#sha256=dc972e06094b9af5b855b3df4a646395e43d1c9d0d39ed345b7393560d0b9173
Best match: simplegeneric 0.8.1
Processing simplegeneric-0.8.1.zip
Writing /tmp/easy_install-h6MWnM/simplegeneric-0.8.1/setup.cfg
Running simplegeneric-0.8.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-h6MWnM/simplegeneric-0.8.1/egg-dist-tmp-b5c36j
zip_safe flag not set; analyzing archive contents...
Moving simplegeneric-0.8.1-py2.7.egg to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/simplegeneric-0.8.1-py2.7.egg>
Searching for pygments
Reading https://pypi.org/simple/pygments/
Downloading https://files.pythonhosted.org/packages/5c/73/1dfa428150e3ccb0fa3e68db406e5be48698f2a979ccbcec795f28f44048/Pygments-2.4.2-py2.py3-none-any.whl#sha256=71e430bc85c88a430f000ac1d9b331d2407f681d6f6aec95e8bcfbc3df5b0127
Best match: Pygments 2.4.2
Processing Pygments-2.4.2-py2.py3-none-any.whl
Installing Pygments-2.4.2-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/Pygments-2.4.2-py2.7.egg>
Searching for prompt-toolkit<2.0.0,>=1.0.4
Reading https://pypi.org/simple/prompt-toolkit/
Downloading https://files.pythonhosted.org/packages/9d/d2/2f099b5cd62dab819ce7a9f1431c09a9032fbfbb6474f442722e88935376/prompt_toolkit-1.0.18-py2-none-any.whl#sha256=f7eec66105baf40eda9ab026cd8b2e251337eea8d111196695d82e0c5f0af852
Best match: prompt-toolkit 1.0.18
Processing prompt_toolkit-1.0.18-py2-none-any.whl
Installing prompt_toolkit-1.0.18-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/prompt_toolkit-1.0.18-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/prompt_toolkit-1.0.18-py2.7.egg>
Searching for pickleshare
Reading https://pypi.org/simple/pickleshare/
Downloading https://files.pythonhosted.org/packages/9a/41/220f49aaea88bc6fa6cba8d05ecf24676326156c23b991e80b3f2fc24c77/pickleshare-0.7.5-py2.py3-none-any.whl#sha256=9649af414d74d4df115d5d718f82acb59c9d418196b7b4290ed47a12ce62df56
Best match: pickleshare 0.7.5
Processing pickleshare-0.7.5-py2.py3-none-any.whl
Installing pickleshare-0.7.5-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pickleshare-0.7.5-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pickleshare-0.7.5-py2.7.egg>
Searching for pexpect
Reading https://pypi.org/simple/pexpect/
Downloading https://files.pythonhosted.org/packages/0e/3e/377007e3f36ec42f1b84ec322ee12141a9e10d808312e5738f52f80a232c/pexpect-4.7.0-py2.py3-none-any.whl#sha256=2094eefdfcf37a1fdbfb9aa090862c1a4878e5c7e0e7e7088bdb511c558e5cd1
Best match: pexpect 4.7.0
Processing pexpect-4.7.0-py2.py3-none-any.whl
Installing pexpect-4.7.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pexpect-4.7.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pexpect-4.7.0-py2.7.egg>
Searching for decorator
Reading https://pypi.org/simple/decorator/
Downloading https://files.pythonhosted.org/packages/8f/b7/f329cfdc75f3d28d12c65980e4469e2fa373f1953f5df6e370e84ea2e875/decorator-4.4.1-py2.py3-none-any.whl#sha256=5d19b92a3c8f7f101c8dd86afd86b0f061a8ce4540ab8cd401fa2542756bce6d
Best match: decorator 4.4.1
Processing decorator-4.4.1-py2.py3-none-any.whl
Installing decorator-4.4.1-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/decorator-4.4.1-py2.7.egg>
Searching for backports.shutil-get-terminal-size
Reading https://pypi.org/simple/backports.shutil-get-terminal-size/
Downloading https://files.pythonhosted.org/packages/7d/cd/1750d6c35fe86d35f8562091737907f234b78fdffab42b29c72b1dd861f4/backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl#sha256=0975ba55054c15e346944b38956a4c9cbee9009391e41b86c68990effb8c1f64
Best match: backports.shutil-get-terminal-size 1.0.0
Processing backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl
Installing backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/backports.shutil_get_terminal_size-1.0.0-py2.7.egg>
Searching for ipython-genutils
Reading https://pypi.org/simple/ipython-genutils/
Downloading https://files.pythonhosted.org/packages/fa/bc/9bd3b5c2b4774d5f33b2d544f1460be9df7df2fe42f352135381c347c69a/ipython_genutils-0.2.0-py2.py3-none-any.whl#sha256=72dd37233799e619666c9f639a9da83c34013a73e8bbc79a7a6348d93c61fab8
Best match: ipython-genutils 0.2.0
Processing ipython_genutils-0.2.0-py2.py3-none-any.whl
Installing ipython_genutils-0.2.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython_genutils-0.2.0-py2.7.egg>
Searching for ptyprocess>=0.5
Reading https://pypi.org/simple/ptyprocess/
Downloading https://files.pythonhosted.org/packages/d1/29/605c2cc68a9992d18dada28206eeada56ea4bd07a239669da41674648b6f/ptyprocess-0.6.0-py2.py3-none-any.whl#sha256=d7cc528d76e76342423ca640335bd3633420dc1366f258cb31d05e865ef5ca1f
Best match: ptyprocess 0.6.0
Processing ptyprocess-0.6.0-py2.py3-none-any.whl
Installing ptyprocess-0.6.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ptyprocess-0.6.0-py2.7.egg>
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:517: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ERROR
======================================================================
ERROR: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 56, in test_metrics_fnapi_it
result = self.run_pipeline(experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 44, in run_pipeline
return dataflow_exercise_metrics_pipeline.apply_and_run(p)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py",> line 180, in apply_and_run
result = pipeline.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 416, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 429, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1442, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction -483: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 136, in _execute
response = task()
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 154, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 286, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 306, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in get
self.fns[bundle_descriptor_id],
KeyError: u'-473'
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57)
at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.finish(RegisterAndProcessBundleOperation.java:330)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:85)
at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:125)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:411)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:380)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:305)
at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:195)
at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:123)
Suppressed: java.lang.IllegalStateException: Already closed.
at org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver.close(BeamFnDataBufferingOutboundObserver.java:93)
at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:220)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:91)
... 6 more
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction -483: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 136, in _execute
response = task()
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 154, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 286, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 306, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in get
self.fns[bundle_descriptor_id],
KeyError: u'-473'
at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:157)
at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:140)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:249)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:297)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:738)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-11-22_14_18_32-4852454999301232565?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 691.213s
FAILED (errors=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191122-220501
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:7ee0784b25fce6fb1432d7e2fbd6f372062fa451a6ada7809f35c34a1fa2e6d3
Deleted: sha256:93daf5d27a1a14f5274f3b34dc0f64eb8f1ad75250404531fce2cf155c6135c4
Deleted: sha256:a8c487597fe60681384d6b3d0f6e9c8844cc71471129dd468a02b20efafce4c6
Deleted: sha256:5d835180e9caec389d17c787391d888a129a4c77c79165a621bffd26ca41dc7b
Deleted: sha256:712f674d6d544384a3d62b7602b98234423fbfc6892297a0d65439b236ea66fe
Deleted: sha256:5d7bb2616ab9e834359887c5ccd9da95959c20a2f9b01f75ee86856cffa7e3a7
Deleted: sha256:f02d8ac81309b129aa2834c40b7579c1b4b7e83288ff5501da16a87e12e42e0a
Deleted: sha256:3e3486b9dc9b69f0ba4fd5f2e65dff0ec15e7f850c4f9b3c747811fde9c22066
Deleted: sha256:ce7d853fd3e0d8c3ca74330141ef2706f32c3da03d5185f2716840580b1154b2
Deleted: sha256:8358140ac248c90dfe62eb54f69581dc5ae5967b87da04a643d956ae12e77fbb
Deleted: sha256:44fd0b4f030aab1086ef8575ec7b592c74dbbacaaad41cec94e18a0da40c74d7
Deleted: sha256:fabedcd4bd2e20ad88cfc5f4873fff8ddb431380a8258c58eb7535844711f56a
Deleted: sha256:3a171aee20caa574ae52f1e959b6d92c9442ddbc0fbca15ec518d2fa12b2700f
Deleted: sha256:bedad7f9bbcb5b483d246c30e24e8b7ff0981e5c0c6c840700cbea30728b2e23
Deleted: sha256:623100bfc19eceff77a48986e4c0e896b3cfcb1b172dc4ba27c50c81f093e75d
Deleted: sha256:ca5ac569ac788f637d3fd171767220a5a90300fc5adf02f7e5cb42f7f55877b1
Deleted: sha256:65d9466706bc5016f7b0d189be341be8e412edde6ba8a53db794963123d5938c
Deleted: sha256:4f90be841c31a8376d9829972d13408586645ffd55c644a7f33b15d4710b9112
Deleted: sha256:74953ead12dc70fda3f780aa5f655510422941d079cb10c0a4384d171ab6fcf2
Deleted: sha256:44d0a66df7c6c8ca641bbdc5a3dc5e95be0ae5a34d31b01af8d6945945dbc659
Deleted: sha256:574f2b667b82551c48f0fd50b28f657cd752a05c2baeb1d9a005e9be79936ac8
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:7ee0784b25fce6fb1432d7e2fbd6f372062fa451a6ada7809f35c34a1fa2e6d3
Associated tags:
- 20191122-220501
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191122-220501
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191122-220501].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:7ee0784b25fce6fb1432d7e2fbd6f372062fa451a6ada7809f35c34a1fa2e6d3].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont #4879
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4879/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4878
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4878/display/redirect>
Changes:
------------------------------------------
[...truncated 593.62 KB...]
Downloading https://files.pythonhosted.org/packages/ad/e7/371d64fc6c6fce53c490fc38816a77fe8c75ff608edc0807170ff3c62bf2/timeloop-1.0.2-py2-none-any.whl#sha256=70cb69eeef39968ea0e6dd68a3a3a51257d5f4aa27b177ab1b19ca86ff525946
Best match: timeloop 1.0.2
Processing timeloop-1.0.2-py2-none-any.whl
Installing timeloop-1.0.2-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/timeloop-1.0.2-py2.7.egg>
Searching for ipython<6,>=5.8.0
Reading https://pypi.org/simple/ipython/
Downloading https://files.pythonhosted.org/packages/b0/88/d996ab8be22cea1eaa18baee3678a11265e18cf09974728d683c51102148/ipython-5.8.0-py2-none-any.whl#sha256=37101b8cbe072fe17bff100bc03d096404e4a9a0357097aeb5b61677c042cab1
Best match: ipython 5.8.0
Processing ipython-5.8.0-py2-none-any.whl
Installing ipython-5.8.0-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython-5.8.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython-5.8.0-py2.7.egg>
Searching for facets-overview<2,>=1.0.0
Reading https://pypi.org/simple/facets-overview/
Downloading https://files.pythonhosted.org/packages/df/8a/0042de5450dbd9e7e0773de93fe84c999b5b078b1f60b4c19ac76b5dd889/facets_overview-1.0.0-py2.py3-none-any.whl#sha256=bda7e7b68ff68f5757af87b9cf8b76994ab15db08db2155e15e4eae58695f4ae
Best match: facets-overview 1.0.0
Processing facets_overview-1.0.0-py2.py3-none-any.whl
Installing facets_overview-1.0.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/facets_overview-1.0.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/facets_overview-1.0.0-py2.7.egg>
Searching for traitlets>=4.2
Reading https://pypi.org/simple/traitlets/
Downloading https://files.pythonhosted.org/packages/ca/ab/872a23e29cec3cf2594af7e857f18b687ad21039c1f9b922fac5b9b142d5/traitlets-4.3.3-py2.py3-none-any.whl#sha256=70b4c6a1d9019d7b4f6846832288f86998aa3b9207c6821f3578a6a6a467fe44
Best match: traitlets 4.3.3
Processing traitlets-4.3.3-py2.py3-none-any.whl
Installing traitlets-4.3.3-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/traitlets-4.3.3-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/traitlets-4.3.3-py2.7.egg>
Searching for simplegeneric>0.8
Reading https://pypi.org/simple/simplegeneric/
Downloading https://files.pythonhosted.org/packages/3d/57/4d9c9e3ae9a255cd4e1106bb57e24056d3d0709fc01b2e3e345898e49d5b/simplegeneric-0.8.1.zip#sha256=dc972e06094b9af5b855b3df4a646395e43d1c9d0d39ed345b7393560d0b9173
Best match: simplegeneric 0.8.1
Processing simplegeneric-0.8.1.zip
Writing /tmp/easy_install-GLzOrH/simplegeneric-0.8.1/setup.cfg
Running simplegeneric-0.8.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-GLzOrH/simplegeneric-0.8.1/egg-dist-tmp-KBzOkL
zip_safe flag not set; analyzing archive contents...
Moving simplegeneric-0.8.1-py2.7.egg to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/simplegeneric-0.8.1-py2.7.egg>
Searching for pygments
Reading https://pypi.org/simple/pygments/
Downloading https://files.pythonhosted.org/packages/5c/73/1dfa428150e3ccb0fa3e68db406e5be48698f2a979ccbcec795f28f44048/Pygments-2.4.2-py2.py3-none-any.whl#sha256=71e430bc85c88a430f000ac1d9b331d2407f681d6f6aec95e8bcfbc3df5b0127
Best match: Pygments 2.4.2
Processing Pygments-2.4.2-py2.py3-none-any.whl
Installing Pygments-2.4.2-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/Pygments-2.4.2-py2.7.egg>
Searching for prompt-toolkit<2.0.0,>=1.0.4
Reading https://pypi.org/simple/prompt-toolkit/
Downloading https://files.pythonhosted.org/packages/9d/d2/2f099b5cd62dab819ce7a9f1431c09a9032fbfbb6474f442722e88935376/prompt_toolkit-1.0.18-py2-none-any.whl#sha256=f7eec66105baf40eda9ab026cd8b2e251337eea8d111196695d82e0c5f0af852
Best match: prompt-toolkit 1.0.18
Processing prompt_toolkit-1.0.18-py2-none-any.whl
Installing prompt_toolkit-1.0.18-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/prompt_toolkit-1.0.18-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/prompt_toolkit-1.0.18-py2.7.egg>
Searching for pickleshare
Reading https://pypi.org/simple/pickleshare/
Downloading https://files.pythonhosted.org/packages/9a/41/220f49aaea88bc6fa6cba8d05ecf24676326156c23b991e80b3f2fc24c77/pickleshare-0.7.5-py2.py3-none-any.whl#sha256=9649af414d74d4df115d5d718f82acb59c9d418196b7b4290ed47a12ce62df56
Best match: pickleshare 0.7.5
Processing pickleshare-0.7.5-py2.py3-none-any.whl
Installing pickleshare-0.7.5-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pickleshare-0.7.5-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pickleshare-0.7.5-py2.7.egg>
Searching for pexpect
Reading https://pypi.org/simple/pexpect/
Downloading https://files.pythonhosted.org/packages/0e/3e/377007e3f36ec42f1b84ec322ee12141a9e10d808312e5738f52f80a232c/pexpect-4.7.0-py2.py3-none-any.whl#sha256=2094eefdfcf37a1fdbfb9aa090862c1a4878e5c7e0e7e7088bdb511c558e5cd1
Best match: pexpect 4.7.0
Processing pexpect-4.7.0-py2.py3-none-any.whl
Installing pexpect-4.7.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pexpect-4.7.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pexpect-4.7.0-py2.7.egg>
Searching for decorator
Reading https://pypi.org/simple/decorator/
Downloading https://files.pythonhosted.org/packages/8f/b7/f329cfdc75f3d28d12c65980e4469e2fa373f1953f5df6e370e84ea2e875/decorator-4.4.1-py2.py3-none-any.whl#sha256=5d19b92a3c8f7f101c8dd86afd86b0f061a8ce4540ab8cd401fa2542756bce6d
Best match: decorator 4.4.1
Processing decorator-4.4.1-py2.py3-none-any.whl
Installing decorator-4.4.1-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/decorator-4.4.1-py2.7.egg>
Searching for backports.shutil-get-terminal-size
Reading https://pypi.org/simple/backports.shutil-get-terminal-size/
Downloading https://files.pythonhosted.org/packages/7d/cd/1750d6c35fe86d35f8562091737907f234b78fdffab42b29c72b1dd861f4/backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl#sha256=0975ba55054c15e346944b38956a4c9cbee9009391e41b86c68990effb8c1f64
Best match: backports.shutil-get-terminal-size 1.0.0
Processing backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl
Installing backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/backports.shutil_get_terminal_size-1.0.0-py2.7.egg>
Searching for ipython-genutils
Reading https://pypi.org/simple/ipython-genutils/
Downloading https://files.pythonhosted.org/packages/fa/bc/9bd3b5c2b4774d5f33b2d544f1460be9df7df2fe42f352135381c347c69a/ipython_genutils-0.2.0-py2.py3-none-any.whl#sha256=72dd37233799e619666c9f639a9da83c34013a73e8bbc79a7a6348d93c61fab8
Best match: ipython-genutils 0.2.0
Processing ipython_genutils-0.2.0-py2.py3-none-any.whl
Installing ipython_genutils-0.2.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython_genutils-0.2.0-py2.7.egg>
Searching for ptyprocess>=0.5
Reading https://pypi.org/simple/ptyprocess/
Downloading https://files.pythonhosted.org/packages/d1/29/605c2cc68a9992d18dada28206eeada56ea4bd07a239669da41674648b6f/ptyprocess-0.6.0-py2.py3-none-any.whl#sha256=d7cc528d76e76342423ca640335bd3633420dc1366f258cb31d05e865ef5ca1f
Best match: ptyprocess 0.6.0
Processing ptyprocess-0.6.0-py2.py3-none-any.whl
Installing ptyprocess-0.6.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ptyprocess-0.6.0-py2.7.egg>
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:517: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
======================================================================
ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 85, in _run_wordcount_it
save_main_session=False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 117, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 416, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 429, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1442, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction -668: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 136, in _execute
response = task()
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 154, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 286, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 306, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in get
self.fns[bundle_descriptor_id],
KeyError: u'-642'
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57)
at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.finish(RegisterAndProcessBundleOperation.java:330)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:85)
at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:125)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:411)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:380)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:305)
at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:195)
at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:123)
Suppressed: java.lang.IllegalStateException: Already closed.
at org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver.close(BeamFnDataBufferingOutboundObserver.java:93)
at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:220)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:91)
... 6 more
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction -668: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 136, in _execute
response = task()
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 154, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 286, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 306, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in get
self.fns[bundle_descriptor_id],
KeyError: u'-642'
at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:157)
at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:140)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:249)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:297)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:738)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-11-22_16_13_44-9418021027817703738?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 715.588s
FAILED (errors=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191123-000555
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:0fc6246b005d8817931a972642e8ab35703c7a07101ebef40f1e495669152fd2
Deleted: sha256:914c46bfd12706756a43810f666d4f7dcb957ad87ee0e952d644b94621a9f01d
Deleted: sha256:4f2923e2b53ba5f4c953ea1c0811595eacd1ce576bfc34df448520d2857b298e
Deleted: sha256:ea0b3b07d9e75dd19a07135d05ac0e8de1ab112fc7719b18cae226e3a18a9074
Deleted: sha256:a129459e76e72d818c04d2a9553e90e0853dc2e0292698ff7f970e93caf6da22
Deleted: sha256:3fb563fd50eab9ac2917b5028100c2ff6de767d0e0d77903613e04ceebc7d5df
Deleted: sha256:bd344d2fe38fdc9ad2ea2e68a2f19c8feca71495a09d0c495158feeb1dec1c7c
Deleted: sha256:4331a79d97c8be95d7341fb9e5fa0e1a06a09ac3a8dac12a7e89cd38abbd20ab
Deleted: sha256:3130e8f3aa7112ba1f2ac2192a4ec3b67e1b70e77821043e51c5473947ce5055
Deleted: sha256:82013533364297a893ae4f96da105046fb8f2fbff3c3fd43b8e89c3cfd98f6ef
Deleted: sha256:f722e18839e1b7456fcdebc3f6d1ebbc58ef838f9aad00756860ab82f1684bdd
Deleted: sha256:bdd2555335d574e3e65c891bc47eabba7e9a7121f9dcb4d35c34043b63cf0171
Deleted: sha256:84dcbf4afba18b5a7364203c59b2e2159e386f675978cad8c7f201f4f6b83f4d
Deleted: sha256:b1302f49a18033e0e92b3d9b6e4311208536999a96e09a13f7c3c59b1c7d1729
Deleted: sha256:b15f38641ac42b4fe2d54e13cb678ed27d73f6dcaa195942fee1f068cb2800da
Deleted: sha256:00e073677f6cbe2e6c667d89f99c9c01c2dc64501b115736ecbbeb2a94b36013
Deleted: sha256:11d32ce0b2b0f5f439b970dadd28d5cf209442e7f2061035a24222603bfe4c70
Deleted: sha256:1e8e26c9a3fa609fce8861714dc113067de082b9b57be88f81936360c0c503ef
Deleted: sha256:d858d925bdbdc6f162ac5f25ca27bcdb6b15e2717b0b3ab23248885abb1a7c21
Deleted: sha256:7a43cae07d9527f486253b66fc635e80436ef1eb0eaba31329f8f98de8694a3d
Deleted: sha256:6bdab11b433d876c168a2429a0e1b7f8870b7164a11c7bfa6cc9b35c6951e437
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:0fc6246b005d8817931a972642e8ab35703c7a07101ebef40f1e495669152fd2
Associated tags:
- 20191123-000555
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191123-000555
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191123-000555].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:0fc6246b005d8817931a972642e8ab35703c7a07101ebef40f1e495669152fd2].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4877
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4877/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-8805] Remove obsolete worker_threads experiment in tests
------------------------------------------
[...truncated 595.09 KB...]
Downloading https://files.pythonhosted.org/packages/ad/e7/371d64fc6c6fce53c490fc38816a77fe8c75ff608edc0807170ff3c62bf2/timeloop-1.0.2-py2-none-any.whl#sha256=70cb69eeef39968ea0e6dd68a3a3a51257d5f4aa27b177ab1b19ca86ff525946
Best match: timeloop 1.0.2
Processing timeloop-1.0.2-py2-none-any.whl
Installing timeloop-1.0.2-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/timeloop-1.0.2-py2.7.egg>
Searching for ipython<6,>=5.8.0
Reading https://pypi.org/simple/ipython/
Downloading https://files.pythonhosted.org/packages/b0/88/d996ab8be22cea1eaa18baee3678a11265e18cf09974728d683c51102148/ipython-5.8.0-py2-none-any.whl#sha256=37101b8cbe072fe17bff100bc03d096404e4a9a0357097aeb5b61677c042cab1
Best match: ipython 5.8.0
Processing ipython-5.8.0-py2-none-any.whl
Installing ipython-5.8.0-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython-5.8.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython-5.8.0-py2.7.egg>
Searching for facets-overview<2,>=1.0.0
Reading https://pypi.org/simple/facets-overview/
Downloading https://files.pythonhosted.org/packages/df/8a/0042de5450dbd9e7e0773de93fe84c999b5b078b1f60b4c19ac76b5dd889/facets_overview-1.0.0-py2.py3-none-any.whl#sha256=bda7e7b68ff68f5757af87b9cf8b76994ab15db08db2155e15e4eae58695f4ae
Best match: facets-overview 1.0.0
Processing facets_overview-1.0.0-py2.py3-none-any.whl
Installing facets_overview-1.0.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/facets_overview-1.0.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/facets_overview-1.0.0-py2.7.egg>
Searching for traitlets>=4.2
Reading https://pypi.org/simple/traitlets/
Downloading https://files.pythonhosted.org/packages/ca/ab/872a23e29cec3cf2594af7e857f18b687ad21039c1f9b922fac5b9b142d5/traitlets-4.3.3-py2.py3-none-any.whl#sha256=70b4c6a1d9019d7b4f6846832288f86998aa3b9207c6821f3578a6a6a467fe44
Best match: traitlets 4.3.3
Processing traitlets-4.3.3-py2.py3-none-any.whl
Installing traitlets-4.3.3-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/traitlets-4.3.3-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/traitlets-4.3.3-py2.7.egg>
Searching for simplegeneric>0.8
Reading https://pypi.org/simple/simplegeneric/
Downloading https://files.pythonhosted.org/packages/3d/57/4d9c9e3ae9a255cd4e1106bb57e24056d3d0709fc01b2e3e345898e49d5b/simplegeneric-0.8.1.zip#sha256=dc972e06094b9af5b855b3df4a646395e43d1c9d0d39ed345b7393560d0b9173
Best match: simplegeneric 0.8.1
Processing simplegeneric-0.8.1.zip
Writing /tmp/easy_install-xveejF/simplegeneric-0.8.1/setup.cfg
Running simplegeneric-0.8.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-xveejF/simplegeneric-0.8.1/egg-dist-tmp-CoQqzG
zip_safe flag not set; analyzing archive contents...
Moving simplegeneric-0.8.1-py2.7.egg to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/simplegeneric-0.8.1-py2.7.egg>
Searching for pygments
Reading https://pypi.org/simple/pygments/
Downloading https://files.pythonhosted.org/packages/5c/73/1dfa428150e3ccb0fa3e68db406e5be48698f2a979ccbcec795f28f44048/Pygments-2.4.2-py2.py3-none-any.whl#sha256=71e430bc85c88a430f000ac1d9b331d2407f681d6f6aec95e8bcfbc3df5b0127
Best match: Pygments 2.4.2
Processing Pygments-2.4.2-py2.py3-none-any.whl
Installing Pygments-2.4.2-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/Pygments-2.4.2-py2.7.egg>
Searching for prompt-toolkit<2.0.0,>=1.0.4
Reading https://pypi.org/simple/prompt-toolkit/
Downloading https://files.pythonhosted.org/packages/9d/d2/2f099b5cd62dab819ce7a9f1431c09a9032fbfbb6474f442722e88935376/prompt_toolkit-1.0.18-py2-none-any.whl#sha256=f7eec66105baf40eda9ab026cd8b2e251337eea8d111196695d82e0c5f0af852
Best match: prompt-toolkit 1.0.18
Processing prompt_toolkit-1.0.18-py2-none-any.whl
Installing prompt_toolkit-1.0.18-py2-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/prompt_toolkit-1.0.18-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/prompt_toolkit-1.0.18-py2.7.egg>
Searching for pickleshare
Reading https://pypi.org/simple/pickleshare/
Downloading https://files.pythonhosted.org/packages/9a/41/220f49aaea88bc6fa6cba8d05ecf24676326156c23b991e80b3f2fc24c77/pickleshare-0.7.5-py2.py3-none-any.whl#sha256=9649af414d74d4df115d5d718f82acb59c9d418196b7b4290ed47a12ce62df56
Best match: pickleshare 0.7.5
Processing pickleshare-0.7.5-py2.py3-none-any.whl
Installing pickleshare-0.7.5-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pickleshare-0.7.5-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pickleshare-0.7.5-py2.7.egg>
Searching for pexpect
Reading https://pypi.org/simple/pexpect/
Downloading https://files.pythonhosted.org/packages/0e/3e/377007e3f36ec42f1b84ec322ee12141a9e10d808312e5738f52f80a232c/pexpect-4.7.0-py2.py3-none-any.whl#sha256=2094eefdfcf37a1fdbfb9aa090862c1a4878e5c7e0e7e7088bdb511c558e5cd1
Best match: pexpect 4.7.0
Processing pexpect-4.7.0-py2.py3-none-any.whl
Installing pexpect-4.7.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
writing requirements to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pexpect-4.7.0-py2.7.egg/EGG-INFO/requires.txt>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/pexpect-4.7.0-py2.7.egg>
Searching for decorator
Reading https://pypi.org/simple/decorator/
Downloading https://files.pythonhosted.org/packages/8f/b7/f329cfdc75f3d28d12c65980e4469e2fa373f1953f5df6e370e84ea2e875/decorator-4.4.1-py2.py3-none-any.whl#sha256=5d19b92a3c8f7f101c8dd86afd86b0f061a8ce4540ab8cd401fa2542756bce6d
Best match: decorator 4.4.1
Processing decorator-4.4.1-py2.py3-none-any.whl
Installing decorator-4.4.1-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/decorator-4.4.1-py2.7.egg>
Searching for backports.shutil-get-terminal-size
Reading https://pypi.org/simple/backports.shutil-get-terminal-size/
Downloading https://files.pythonhosted.org/packages/7d/cd/1750d6c35fe86d35f8562091737907f234b78fdffab42b29c72b1dd861f4/backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl#sha256=0975ba55054c15e346944b38956a4c9cbee9009391e41b86c68990effb8c1f64
Best match: backports.shutil-get-terminal-size 1.0.0
Processing backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl
Installing backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/backports.shutil_get_terminal_size-1.0.0-py2.7.egg>
Searching for ipython-genutils
Reading https://pypi.org/simple/ipython-genutils/
Downloading https://files.pythonhosted.org/packages/fa/bc/9bd3b5c2b4774d5f33b2d544f1460be9df7df2fe42f352135381c347c69a/ipython_genutils-0.2.0-py2.py3-none-any.whl#sha256=72dd37233799e619666c9f639a9da83c34013a73e8bbc79a7a6348d93c61fab8
Best match: ipython-genutils 0.2.0
Processing ipython_genutils-0.2.0-py2.py3-none-any.whl
Installing ipython_genutils-0.2.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ipython_genutils-0.2.0-py2.7.egg>
Searching for ptyprocess>=0.5
Reading https://pypi.org/simple/ptyprocess/
Downloading https://files.pythonhosted.org/packages/d1/29/605c2cc68a9992d18dada28206eeada56ea4bd07a239669da41674648b6f/ptyprocess-0.6.0-py2.py3-none-any.whl#sha256=d7cc528d76e76342423ca640335bd3633420dc1366f258cb31d05e865ef5ca1f
Best match: ptyprocess 0.6.0
Processing ptyprocess-0.6.0-py2.py3-none-any.whl
Installing ptyprocess-0.6.0-py2.py3-none-any.whl to <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs>
Installed <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/.eggs/ptyprocess-0.6.0-py2.7.egg>
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:517: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ERROR
======================================================================
ERROR: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 56, in test_metrics_fnapi_it
result = self.run_pipeline(experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 44, in run_pipeline
return dataflow_exercise_metrics_pipeline.apply_and_run(p)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py",> line 180, in apply_and_run
result = pipeline.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 416, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 429, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1442, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction -447: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 136, in _execute
response = task()
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 154, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 286, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 306, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in get
self.fns[bundle_descriptor_id],
KeyError: u'-437'
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
at org.apache.beam.sdk.util.MoreFutures.get(MoreFutures.java:57)
at org.apache.beam.runners.dataflow.worker.fn.control.RegisterAndProcessBundleOperation.finish(RegisterAndProcessBundleOperation.java:330)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:85)
at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:125)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:411)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:380)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:305)
at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:195)
at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:123)
Suppressed: java.lang.IllegalStateException: Already closed.
at org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver.close(BeamFnDataBufferingOutboundObserver.java:93)
at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.abort(RemoteGrpcPortWriteOperation.java:220)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:91)
... 6 more
Caused by: java.lang.RuntimeException: Error received from SDK harness for instruction -447: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 136, in _execute
response = task()
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 154, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 286, in do_instruction
request.instruction_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 306, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py", line 239, in get
self.fns[bundle_descriptor_id],
KeyError: u'-437'
at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:157)
at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:140)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:249)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:297)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:738)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at org.apache.beam.vendor.grpc.v1p21p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-11-22_15_07_08-4016645281526463723?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 696.701s
FAILED (errors=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191122-225237
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:915aad6596b41b22ddc92a071e8557e19d79ab7c1152c3cb0967ef49b0ec6a88
Deleted: sha256:0605044ee6d91e4e96b799bf63448086a91056d01328a30cedce3ef45ee5f22a
Deleted: sha256:1a9d6aa49a9a6eed51ebe600c6b1f8a73d26016bd4589a29112f729c1cbf558b
Deleted: sha256:b4bbd2ae8dd440ef2aadc72910ec1ba2f2a09d66554e851547d095b52b144f09
Deleted: sha256:60f33ce10b789fb6021ff82bd3e33daa8b505cf7279aef40e8583fbceb1f676f
Deleted: sha256:687b8cce48028fbdd11583afa3e0cd2b212adadd751ad1ea809afe8aae51eb6c
Deleted: sha256:0384a6e7b08b900f2bec4ed459b8438656377b4d04b7977e05c377164e9873d2
Deleted: sha256:dc85505dd450c85ae7a93196e32562ca6f7dd4f7e4da6bf0cee7d76a0721b264
Deleted: sha256:7240c3b3292fd42415064a245327ee05f2497f8a3bc63cfcdf489756aba81295
Deleted: sha256:7723649836ccd5816657ab15e6f2e3842adc3020a2ee0fcd9ce26e31b4fc15a1
Deleted: sha256:156bf0e86d3efab3cf9da6551217468255ce22a787bb3384e649290bbdf9d5d0
Deleted: sha256:9260af49006c95d9af314d340a4d5295dde63c2959fe13426755d2720257c220
Deleted: sha256:508303e0b792d046c970038a51b878e33f42f6292a3cf3825b4467739e8d9c7a
Deleted: sha256:ae64fd7cd1f8f3ad7e79444583a2f57309e31b20b36d618f6875c892ba500874
Deleted: sha256:6c80873511c9c55a46eb904a6fa32c239fd79dd1b3856d115f4f87e11bcf8cc4
Deleted: sha256:f06431b087cf7eb1c8f54f9d7b22fa757ca17e82c0ededed499ff54ab66dd8d8
Deleted: sha256:ae8ab05fc14e1905c2a195243b20bd1b5a4e54c88227f044a37ecfd6617f1a7f
Deleted: sha256:8ea810f5f8cd3a1911080c8523a97d742d756e7d5e1a39ad6f2bffa4a708fe7a
Deleted: sha256:3c7fac3fd4528ea4de7b18eb29a296e25916f78fcee5c5631f7b9858ca6569fb
Deleted: sha256:028dbd36d34c7c224b3aa0af59d39abfbb7a08cddfbc046062401081c0134a4e
Deleted: sha256:d51c9d452ca4b4a6c56cf8b59f299da7a1b55c1b68f4a218e71879ded9b95673
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:915aad6596b41b22ddc92a071e8557e19d79ab7c1152c3cb0967ef49b0ec6a88
Associated tags:
- 20191122-225237
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191122-225237
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191122-225237].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:915aad6596b41b22ddc92a071e8557e19d79ab7c1152c3cb0967ef49b0ec6a88].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org