You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/12/10 01:11:59 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4996
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4996/display/redirect?page=changes>
Changes:
[kcweaver] Version Flink job server container images
[kcweaver] [BEAM-8337] publish Flink job server container images
[ningk] [BEAM-7926] Data-centric Interactive Part1
[kcweaver] Get Flink version numbers from subdirectories
[kcweaver] Warn if Flink versions can't be listed.
------------------------------------------
[...truncated 1.12 MB...]
copying apache_beam/testing/benchmarks/nexmark/models/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/models/nexmark_model.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/queries/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query0.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query1.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query2.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.19.0.dev0/apache_beam/testing/data
copying apache_beam/testing/load_tests/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/co_group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/combine_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test_metrics_utils.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/pardo_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
Writing apache-beam-2.19.0.dev0/setup.cfg
Creating tar archive
removing 'apache-beam-2.19.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
running nosetests
running egg_info
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.19.0.dev' to '2.19.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:58: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/gcp/datastore/v1/datastoreio.py>:62: UserWarning: Datastore IO will support Python 3 after replacing googledatastore by google-cloud-datastore, see: BEAM-4543.
warnings.warn('Datastore IO will support Python 3 after replacing '
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/vcfio.py>:47: UserWarning: VCF IO will support Python 3 after migration to Nucleus, see: BEAM-5628.
warnings.warn("VCF IO will support Python 3 after migration to Nucleus, "
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.5 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:520: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... FAIL
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... FAIL
======================================================================
FAIL: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 85, in _run_wordcount_it
save_main_session=False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 117, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 417, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 430, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 70, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
AssertionError:
Expected: (Test pipeline expected terminated in state: DONE and Expected checksum is 33535a832b7db6d78389759577d4ff495980b9c0)
but: Test pipeline expected terminated in state: DONE Test pipeline job terminated in state: FAILED
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_17_11_29-4856174748223217177?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
======================================================================
FAIL: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 60, in test_metrics_fnapi_it
self.assertFalse(errors, str(errors))
AssertionError: "Unable to match metrics for matcher namespace: 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn' name: 'total_values' step: 'metrics' attempted: <100> committed: <100>Unable to match metrics for matcher name: 'ExecutionTime_StartBundle' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ExecutionTime_ProcessElement' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ExecutionTime_FinishBundle' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher namespace: 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn' name: 'distribution_values' step: 'metrics' attempted: sum_value: <100> count_value: <4> min_value: <0> max_value: <100> committed: sum_value: <100> count_value: <4> min_value: <0> max_value: <100>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'metrics-out0'). (label_key: 'original_name' label_value: 'metrics-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'metrics-out0'). (label_key: 'original_name' label_value: 'metrics-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'map_to_common_key-out0'). (label_key: 'original_name' label_value: 'map_to_common_key-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'map_to_common_key-out0'). (label_key: 'original_name' label_value: 'map_to_common_key-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'original_name' label_value: 'GroupByKey/GroupByWindow-out0-ElementCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'original_name' label_value: 'GroupByKey/GroupByWindow-out0-MeanByteCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-ElementCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-MeanByteCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>\nActual MetricResults:\n" is not false : Unable to match metrics for matcher namespace: 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn' name: 'total_values' step: 'metrics' attempted: <100> committed: <100>Unable to match metrics for matcher name: 'ExecutionTime_StartBundle' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ExecutionTime_ProcessElement' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ExecutionTime_FinishBundle' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher namespace: 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn' name: 'distribution_values' step: 'metrics' attempted: sum_value: <100> count_value: <4> min_value: <0> max_value: <100> committed: sum_value: <100> count_value: <4> min_value: <0> max_value: <100>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'metrics-out0'). (label_key: 'original_name' label_value: 'metrics-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'metrics-out0'). (label_key: 'original_name' label_value: 'metrics-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'map_to_common_key-out0'). (label_key: 'original_name' label_value: 'map_to_common_key-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'map_to_common_key-out0'). (label_key: 'original_name' label_value: 'map_to_common_key-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'original_name' label_value: 'GroupByKey/GroupByWindow-out0-ElementCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'original_name' label_value: 'GroupByKey/GroupByWindow-out0-MeanByteCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-ElementCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-MeanByteCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>
Actual MetricResults:
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_17_11_43-14319220273595477865?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python3.5_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 33.274s
FAILED (failures=2)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-010513
Untagged: us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a2743e8992ff9d5d67d58338fe11676b9a42727b19a5f53652413fc92c410015
Deleted: sha256:06e18c5a6d009b6d180e0456d7228a7a7472707ff25ecd60d045f52da39b45b1
Deleted: sha256:005c6ed6c804e53c2d230b6d61c59ac8d9b18ca263a025878a7dc1d9bcf13750
Deleted: sha256:a59d2cfa15502f4cfb234b7574fa2fcfb52eeaf496d5979aa52eb9ad98b15c2e
Deleted: sha256:254857887edfad182d5c52d151b7b7f144425253233cf9f67a98a031478e2b15
Deleted: sha256:10a293794a0c26aafd08b7135067a3ea14e594f279c131172a0bd3449e9fb99a
Deleted: sha256:8a6231421f995d2cd37a49996b1ae959d924f0e65d6675a49ed17a3cd17c5b29
Deleted: sha256:047b42adeca2b87ba9e2bf1be09637c7bf93f09a121fda91c63dfcf7abde2497
Deleted: sha256:6686bc3615c14802d22f2e396a3901a85670bcd12842f611af449e774163cbd7
Deleted: sha256:7256922d2d4ae72126446cefcd5d14dc23762391c4c4c4d6942d1ca39e463f5d
Deleted: sha256:cb3a329ac81a513957fecd9d6ef156186af3bd05b1e87b970de7c0fe732536a0
Deleted: sha256:6f6844437444d174afbd1a24b9d94c068feb3ae374cc7cd171de107ccc330f23
Deleted: sha256:7f9cbc30a90701233903a2c1ec6a4d03f66cdd24b4c0042302fd22a6635792ea
Deleted: sha256:b9868c870657e07b41aa9d5429b7bfe426171ba22344f34f4eb38abfc2fd9f22
Deleted: sha256:d3f1da7f76e61291bd58e47c19ea1f12ccbdfe8aa28c572c4ee063ca9558de72
Deleted: sha256:fb7822680b34870762c74d60cbc911ca889d6e5f6967aed8436aa332e8d4b177
Deleted: sha256:10b5e5f7bc26695101cdd7cfd81a40cc14f6b6d8474a41781f304dd1278603e9
Deleted: sha256:33ee4aac11114d9c88150499b59bf489db031df2f97be3b626cdb68b70028e39
Deleted: sha256:c88b8e34261a5e0b84f9ab2093ec29529c5bbdfed0fdc1e7ca71efed60f29b64
Deleted: sha256:da3b898b07d82719f524e4ead58d3bea6b53cec22ca2c3e3a527ce1df4711077
Deleted: sha256:e7b1bd97547affc0602636072191d79bffcbbf0d890c2b990e1d15574a8ebd2e
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a2743e8992ff9d5d67d58338fe11676b9a42727b19a5f53652413fc92c410015
Associated tags:
- 20191210-010513
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-010513
Deleted [us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-010513].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a2743e8992ff9d5d67d58338fe11676b9a42727b19a5f53652413fc92c410015].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont #5001
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/5001/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #5000
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/5000/display/redirect>
Changes:
------------------------------------------
[...truncated 589.42 KB...]
copying apache_beam/testing/benchmarks/nexmark/queries/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query0.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query1.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query2.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.19.0.dev0/apache_beam/testing/data
copying apache_beam/testing/load_tests/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/co_group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/combine_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test_metrics_utils.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/pardo_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
Writing apache-beam-2.19.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.19.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
setup.py:198: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.19.0.dev' to '2.19.0.dev0'
normalized_version,
running nosetests
running egg_info
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:58: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:520: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... FAIL
======================================================================
ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 85, in _run_wordcount_it
save_main_session=False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 117, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 417, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 430, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1448, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Workflow failed.
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-10_04_08_46-7466925334909030702?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
======================================================================
FAIL: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 60, in test_metrics_fnapi_it
self.assertFalse(errors, str(errors))
AssertionError: Unable to match metrics for matcher namespace: 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn' name: 'total_values' step: 'metrics' attempted: <100> committed: <100>Unable to match metrics for matcher name: 'ExecutionTime_StartBundle' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ExecutionTime_ProcessElement' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ExecutionTime_FinishBundle' step: 'metrics' attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher namespace: 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn' name: 'distribution_values' step: 'metrics' attempted: sum_value: <100> count_value: <4> min_value: <0> max_value: <100> committed: sum_value: <100> count_value: <4> min_value: <0> max_value: <100>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'original_name' label_value: 'metrics-out0-ElementCount'). (label_key: 'output_user_name' label_value: 'metrics-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'metrics-out0'). (label_key: 'original_name' label_value: 'metrics-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-MeanByteCount'). (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'original_name' label_value: 'map_to_common_key-out0-ElementCount'). (label_key: 'output_user_name' label_value: 'map_to_common_key-out0'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'map_to_common_key-out0'). (label_key: 'original_name' label_value: 'map_to_common_key-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). (label_key: 'original_name' label_value: 'GroupByKey/GroupByWindow-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). (label_key: 'original_name' label_value: 'GroupByKey/GroupByWindow-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Read-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Read-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0> committed: a value greater than <0>Unable to match metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0> committed: a value greater than <0>
Actual MetricResults:
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-10_04_10_31-17033351358079579581?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 123.930s
FAILED (errors=1, failures=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-120022
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:d4d11425ed2526643c7fabb13aa01659d27dd81ee1c24aed04e061724b4cce10
Deleted: sha256:1f2d80591747007b0052765aca74df2a7a379c4583549363fef5740b9e75b4b3
Deleted: sha256:7fe2209cc60da3b68b2078fb2fd303547105c7c214d8d3a579ecf1d0e44f45b8
Deleted: sha256:d75fbbe876e2e4ec811d4894cafb904fab369ea52c9eb6daa825645c8a090e3a
Deleted: sha256:1dc9ffb4228524f2312792b2687a65580ba6319bf0f310f43ef09984bfafdccf
Deleted: sha256:76a2452b1ef8ef672dd089235111c93b6e892e1986416c3b9050d893e9d228ad
Deleted: sha256:7e3b5095f0db512b0268e0f0121555ae04de329fa50c95818fbfd995716bff2c
Deleted: sha256:9cece831bae3b35188fb554ac8d18230e09a51042dc880d4369fb65cb23a48bb
Deleted: sha256:291c3322c39a13b79c988caea78c1a44f9e1e60eb3e1a167b5041e5cec34c532
Deleted: sha256:e5a19d60ce60af315ab18b14e524646deb10d095da92181fd2a0246aac13593b
Deleted: sha256:3973343cc2e2fed9a24f4fc5a63a77ba0f2020db38c5374ce3808aad3c79819f
Deleted: sha256:6d139d6b33228fe734ab8675946988cca12760f7b31ab8826d0e29ebdba33a5a
Deleted: sha256:de1ef49222e207434e8112a558b007633663da8f1e9bf205011c1360ae330e44
Deleted: sha256:ef0e3d7f723610192b65167d859e7f94da5f8ea50b9154fb2a4a60e9ac78b7ab
Deleted: sha256:a888ff94c2c7f14cbf4500f316b5f5dafacb001bf52b5e1856dbafc954bd7c56
Deleted: sha256:e506108897298ce49a048dcb7f69773a62baad3bc1283eeca0bfdd19ce437cda
Deleted: sha256:2f55421126b852aff9c67ebf5064b6a0b4d0e77068258fd9b247c588b71d4ad2
Deleted: sha256:bef8d1e6dcd09c0b68eb77d2406ef391b616669dade7e12be8d605284eff3b4b
Deleted: sha256:c3ecf01989a077f509150010145db2d4f61916a65958da09773fa05cc7618a4e
Deleted: sha256:1a0e0720d35d13d878d68161e91f0dc9e773deee26386ae5bcea12b38884c627
Deleted: sha256:bbb01c0e10d61ca65cc607bda7dd45f3a4796cba5a9652f24bf1b6188ec02092
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:d4d11425ed2526643c7fabb13aa01659d27dd81ee1c24aed04e061724b4cce10
Associated tags:
- 20191210-120022
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-120022
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-120022].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:d4d11425ed2526643c7fabb13aa01659d27dd81ee1c24aed04e061724b4cce10].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4999
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4999/display/redirect?page=changes>
Changes:
[github] Changing _BatchSizeEstimator defaults to match BatchElements defaults
------------------------------------------
[...truncated 1.12 MB...]
copying apache_beam/testing/util_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing
copying apache_beam/testing/benchmarks/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks
copying apache_beam/testing/benchmarks/chicago_taxi/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/preprocess.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/process_tfma.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/setup.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/tfdv_analyze_and_validate.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/model.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/task.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/taxi.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/nexmark/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark
copying apache_beam/testing/benchmarks/nexmark/nexmark_launcher.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark
copying apache_beam/testing/benchmarks/nexmark/nexmark_util.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark
copying apache_beam/testing/benchmarks/nexmark/models/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/models/nexmark_model.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/queries/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query0.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query1.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query2.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.19.0.dev0/apache_beam/testing/data
copying apache_beam/testing/load_tests/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/co_group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/combine_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test_metrics_utils.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/pardo_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
Writing apache-beam-2.19.0.dev0/setup.cfg
Creating tar archive
removing 'apache-beam-2.19.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
running nosetests
running egg_info
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing requirements to apache_beam.egg-info/requires.txt
writing entry points to apache_beam.egg-info/entry_points.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.19.0.dev' to '2.19.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:58: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/gcp/datastore/v1/datastoreio.py>:62: UserWarning: Datastore IO will support Python 3 after replacing googledatastore by google-cloud-datastore, see: BEAM-4543.
warnings.warn('Datastore IO will support Python 3 after replacing '
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/vcfio.py>:47: UserWarning: VCF IO will support Python 3 after migration to Nucleus, see: BEAM-5628.
warnings.warn("VCF IO will support Python 3 after migration to Nucleus, "
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.5 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:520: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ERROR
======================================================================
ERROR: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 56, in test_metrics_fnapi_it
result = self.run_pipeline(experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 44, in run_pipeline
return dataflow_exercise_metrics_pipeline.apply_and_run(p)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py",> line 180, in apply_and_run
result = pipeline.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 417, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 430, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1448, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Workflow failed.
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_23_28_13-13995721381943133559?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python3.5_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 554.882s
FAILED (errors=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-071456
Untagged: us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a79b3ab4a324db5de313093713a7915459cba8d916bf84328af92d5536eb3b35
Deleted: sha256:ae89ed052b43ec2939599f0bb29875ffc337afe9d78614810aa01f05fc34b4cd
Deleted: sha256:ce0a618e127e4ad950a4417a52b2e74213a9c9df24da3abff97adb8013c803d2
Deleted: sha256:e058643f0b7f31af01e39cb388aed1f02d096387170de7db31b8a7678136b606
Deleted: sha256:6fc0bd3e3ad6b90ebfd4b7038b55baa7b55f915af2e76c79e162d561cc32f112
Deleted: sha256:e0482cb045c4b6f87f1e81276900cc797c9ff6773eb8895169ce9efb5e477302
Deleted: sha256:bdf6d930996f4cefc343ff302a1900c7c7628c364165b7abd981c45ff7b04edf
Deleted: sha256:2245b9902fa009c26bcb58c0503e7a89ceb055703e915d672fb2f9728fdf7b32
Deleted: sha256:d0e2afa2ee5e273a7255135d3f2b55cc3c4bb975aadc36a649e3e30e9d808f51
Deleted: sha256:414c24b451898dd8faad50fe609f8adcc8c78e0227bfd9ee0a210aa09d079693
Deleted: sha256:7602e2073bc7f64031c6875d014a077c21bd835145aaff52fc041f3afc4fd48d
Deleted: sha256:f44c17205194e28799078e3edd6633f07d39027cac487f0378dd4191b1264cf6
Deleted: sha256:639855c663afb2dc0fc5e0cf54d3bf514f639e47c904a94205267d933f254b58
Deleted: sha256:5d2390f0915397854871c51bbb7aa689a27d88c2065dc73f6e284723b1d69a23
Deleted: sha256:6f0a0b4a775ffa923c61fa8817ed8883b05f5c24c470e0da5e846320398cb47b
Deleted: sha256:2a438404113d276e35b09711a7c24c3156f6ba16d57a090240548faa02a14c7e
Deleted: sha256:548804e1cd436c01ce36b2a8a23115a42eb2332b17ac3be5881f7a48468e6270
Deleted: sha256:0ad6a4d27269ead716f044fc2935292746d9dbd67ae4fad78b873cd1e77c5433
Deleted: sha256:63356e9ca528d085fea954d6960f781021710b0c25cb9be3f20364a25a9db0aa
Deleted: sha256:e5dda22763ca7c2c7218ca8bdcd541d035e0a672a9ace8cbcfaaf3ce1bf6734f
Deleted: sha256:9ba10a3128c9732695bab0ca44a9ba42996c6e5d0b9ddd3529a2b4fcf1e473cf
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a79b3ab4a324db5de313093713a7915459cba8d916bf84328af92d5536eb3b35
Associated tags:
- 20191210-071456
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-071456
Deleted [us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-071456].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a79b3ab4a324db5de313093713a7915459cba8d916bf84328af92d5536eb3b35].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4998
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4998/display/redirect>
Changes:
------------------------------------------
[...truncated 587.43 KB...]
copying apache_beam/testing/benchmarks/chicago_taxi/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/preprocess.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/process_tfma.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/setup.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/tfdv_analyze_and_validate.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/model.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/task.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/chicago_taxi/trainer/taxi.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/chicago_taxi/trainer
copying apache_beam/testing/benchmarks/nexmark/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark
copying apache_beam/testing/benchmarks/nexmark/nexmark_launcher.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark
copying apache_beam/testing/benchmarks/nexmark/nexmark_util.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark
copying apache_beam/testing/benchmarks/nexmark/models/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/models/nexmark_model.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/queries/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query0.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query1.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query2.py -> apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.19.0.dev0/apache_beam/testing/data
copying apache_beam/testing/load_tests/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/co_group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/combine_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/group_by_key_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test_metrics_utils.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/pardo_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
Writing apache-beam-2.19.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.19.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
setup.py:198: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.19.0.dev' to '2.19.0.dev0'
normalized_version,
running nosetests
running egg_info
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:58: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:520: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
======================================================================
ERROR: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 85, in _run_wordcount_it
save_main_session=False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 117, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 417, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 430, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1448, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Workflow failed.
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_22_08_37-15351093588935171062?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 440.445s
FAILED (errors=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-060021
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:7639560e8b818cd6f061d2e468b3b966b95cfcc539f739ebc430678e508e9fea
Deleted: sha256:9a2899ebb66e0893c0a1cb72b52ce660b9e4d4bd8b280f875b3ce0a090d555ab
Deleted: sha256:0a71ddd88f25030ebfc960596572b935da35821fc12b3e29c3b9907e70b21a1d
Deleted: sha256:9e21b122e80a4a8dc84ca55da1cf0edd103ab4cae7d6db36a4e419acdeecebae
Deleted: sha256:271e28d3c8284e46e92aa591e5652cbf0a85da95ee6cd5aebdbe20633d7f18ca
Deleted: sha256:8ae68df7815080b224e66bc1ee4228e4af6d7a9af1bcd6cfea17b65c8f349456
Deleted: sha256:68183195d79e29e021691c03875fddf2dccca2aeabbd1ef97c958708944706d3
Deleted: sha256:9ef1588997e268b3027735b385aa02dc841df389991f752ece4ec96341af42e7
Deleted: sha256:83bd25433ac2663574c5aca8ca8f6615fe80ef79985e7a72228106c959a51884
Deleted: sha256:c7a1dbea0e924df93f4ac1967926c7b2252085c5be308edf92f66f3ee4853a2b
Deleted: sha256:dcef8397ea2ee86a987453d292ea3ee87ca2307224153e9271e75f9b769f46b9
Deleted: sha256:7c69157ffd5a253fb9b89f0f0a4b1039aac58b62552dc3bb79f7ff986838cbe5
Deleted: sha256:70fddf6a8d54ff9dce48e620a73d6316442ac28ab5afba302bda069b11dc4437
Deleted: sha256:b0dcf7bb1cf5c0537831a2ed4469f11f59f6b21653ed18d305a6b89aed8cf00b
Deleted: sha256:5a9f9569dfe70683d8762d935dcf9489d8279e8b082d6f2e3d512d83d09bdb17
Deleted: sha256:1a1d8e49f8c0108f811f2d3dadcfbe35d13712a9f0353e760e3689ec18b567f6
Deleted: sha256:f6cab95155af6d82bea68d6284bc5a498977c56124b21c04e91d33abee541816
Deleted: sha256:ad3654e7c2875e3bf0fcedb4aaaea268e0395ec4af64b3f12ae6db22504cfd25
Deleted: sha256:0440ab25c3dfeef3f99858d3e928f34e9f7a62fb25d6f12ffe4ac57110571caf
Deleted: sha256:03d7463fd2d26e6fe4f4ed3db6d18416baf328b2f2624e0aaf4cf44815c2b71d
Deleted: sha256:5c33de149829fa5ea271a13a93aa705c3588c4b0e9342fa5ea1082638090de5e
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:7639560e8b818cd6f061d2e468b3b966b95cfcc539f739ebc430678e508e9fea
Associated tags:
- 20191210-060021
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-060021
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-060021].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:7639560e8b818cd6f061d2e468b3b966b95cfcc539f739ebc430678e508e9fea].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #4997
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4997/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-8870] Skip test_sdf_with_watermark_tracking for Spark
[kcweaver] [BEAM-8870] Cache environment in spark_runner_test.
[kcweaver] Don't override default for environment_cache_millis
[ehudm] [BEAM-3713] pytest migration: py27-gcp-pytest
------------------------------------------
[...truncated 590.15 KB...]
copying apache_beam/testing/load_tests/pardo_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py -> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.19.0.dev0/apache_beam/utils
Writing apache-beam-2.19.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.19.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
setup.py:198: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.19.0.dev' to '2.19.0.dev0'
normalized_version,
running nosetests
running egg_info
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:58: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
No handlers could be found for logger "apache_beam.io.gcp.datastore.v1.datastoreio"
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:520: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... FAIL
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to us-central1. Future releases of Beam will require the user to set --region explicitly, or else have a default set via the gcloud tool. https://cloud.google.com/compute/docs/regions-zones
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ERROR
======================================================================
ERROR: test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 56, in test_metrics_fnapi_it
result = self.run_pipeline(experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py",> line 44, in run_pipeline
return dataflow_exercise_metrics_pipeline.apply_and_run(p)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py",> line 180, in apply_and_run
result = pipeline.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 417, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 430, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 66, in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1448, in wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Workflow failed.
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_18_28_25-12458742824028164329?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
======================================================================
FAIL: test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 85, in _run_wordcount_it
save_main_session=False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 117, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 417, in run
self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py",> line 430, in run
return self.runner.run_pipeline(self, self._options)
File "<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 70, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
AssertionError:
Expected: (Test pipeline expected terminated in state: DONE and Expected checksum is 33535a832b7db6d78389759577d4ff495980b9c0)
but: Test pipeline expected terminated in state: DONE Test pipeline job terminated in state: FAILED
-------------------- >> begin captured stdout << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_18_28_11-11478910797186811546?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 99.451s
FAILED (errors=1, failures=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-021911
Untagged: us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:605e9104d05a3b46567f11967ab4c5aef903cdad041afa2e96af6dcf4774ff67
Deleted: sha256:24c1a129532cf6f6468315fc82c4b0089cea89284eec325776a1b5ae686b1dd8
Deleted: sha256:c02e3464061d468be8385c4a94df91ad48ef146bf3a3286f8f72f068b12a1a5b
Deleted: sha256:f9fb403a4a4bfb2a09a3f00df30bfbcebbabb57f0f6e4539a45e9701b84a3317
Deleted: sha256:20e1af6f7336c7e065f51e2c1d93a89852a093f0a6d9cbb5995f82c6baac605e
Deleted: sha256:a0bc04a0d516c27bf4a13efe687cca276c78614b10aeccb47d9e749d5a3c6996
Deleted: sha256:5d9a1bb6486310100e237d23f3766cbe45e543ff11e939832de3225b37dcfa59
Deleted: sha256:0f36d3fd21def69314bdf54ba7a3bc07cdb1ff671fe562a2644583c7acc1d0c6
Deleted: sha256:6944cdd67b88bed0055c883b7fe4669de35a325301f0b10b3fab29796a2de69d
Deleted: sha256:6fa4f6bc217f01744cced349a5616d41636af80a161471cb485dffc565e732a0
Deleted: sha256:92a57909db41352f7a6ed8ad26f72ff649afbadf4f8187398330d0fef0038795
Deleted: sha256:a6c98ad018958632e61c198b9121c1aebab79209b65fb170997ef9ae997f8ffa
Deleted: sha256:b276cbd7248ea5e64e1fc5415e42726d157731233683338223c9f96490ad841e
Deleted: sha256:39d4546bae2acbc5820d72c9c52a0a76a1c1033915b57ecfb4d35b33eee495f7
Deleted: sha256:620617b076c76cc0c1afd5176bd9664abbaceed04bb0b10de247a581ef55f34d
Deleted: sha256:bea828c3fea1223ab179c2fe2401ab20856eecd757d4efaa19e911ca9390162a
Deleted: sha256:e75e3b7dbf20f33adf664f608ceafe1b5e19c631f19ac216a1d1e3a6d1f1f099
Deleted: sha256:76f3d0cfa74f3be8dff47191ab7997ffb0fa337cafba3ea9944a46b81958b8b3
Deleted: sha256:186aaf14aec6898d030cca56f09c19cfbfff5d1e99150b9f4c532689d77b088f
Deleted: sha256:fcc7fb7310efd7a8a1a337196cab48ba0e38d9e035d2125a493cf94aa038b351
Deleted: sha256:ec52dd41d2af153c7d3ef6b80e872a86566658d26985fa33638c866c7679e16f
Digests:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:605e9104d05a3b46567f11967ab4c5aef903cdad041afa2e96af6dcf4774ff67
Associated tags:
- 20191210-021911
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-021911
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk:20191210-021911].
Deleted [us.gcr.io/apache-beam-testing/jenkins/python2.7_sdk@sha256:605e9104d05a3b46567f11967ab4c5aef903cdad041afa2e96af6dcf4774ff67].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org