You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/04/22 21:58:05 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark #723
See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/723/display/redirect?page=changes>
Changes:
[github] Force output names to be unicode-compatible on Python 2. (#11485)
------------------------------------------
[...truncated 915.76 KB...]
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 195, in consume_request_iterator
request = next(request_iterator)
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py",> line 316, in __next__
raise self._queue.get()
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService"
debug_error_string = "{"created":"@1587592555.207802305","description":"Error received from peer ipv4:127.0.0.1:18090","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}"
>
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_flatten (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f2d2c29e0c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:29 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_col1/Impulse_3\n col1/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/FlatMap(<lambda at core.py:2714>)_4\n col1/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/MaybeReshuffle/Reshuffle/AddRandomKeys_7\n col1/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9\n col1/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_10\n col1/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_14\n col1/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/MaybeReshuffle/Reshuffle/RemoveRandomKeys_15\n col1/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col1/Map(decode)_16\n col1/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/Impulse_18\n col2/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/FlatMap(<lambda at core.py:2714>)_19\n col2/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/MaybeReshuffle/Reshuffle/AddRandomKeys_22\n col2/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_24\n col2/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_25\n col2/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_29\n col2/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/MaybeReshuffle/Reshuffle/RemoveRandomKeys_30\n col2/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_col2/Map(decode)_31\n col2/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_6_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:flatten)/Flatten_3\n ExternalTransform(beam:transforms:xlang:test:flatten)/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_35\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2714>)_36\n assert_that/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_38\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_39\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_40\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_42\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_43\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_44\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_45\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_49\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_50\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_51\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>']
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'dataflow_kms_key' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'enable_streaming_engine' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'project' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_region' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_name' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'runner' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'temp_location' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'streaming' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'experiments' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'flink_master' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'pubsub_root_url' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'environment_cache_millis' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'files_to_stage' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_endpoint' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'output_executable_path' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'sdk_worker_parallelism' was already added
ERROR:grpc._channel:Exception iterating requests!
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 195, in consume_request_iterator
request = next(request_iterator)
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py",> line 316, in __next__
raise self._queue.get()
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService"
debug_error_string = "{"created":"@1587592575.279824564","description":"Error received from peer ipv4:127.0.0.1:18090","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}"
>
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_group_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f2d2c29e0c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:17 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create/Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2714>)_4\n Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/Map(decode)_6\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_7_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:gbk)/TestLabel_3\n ExternalTransform(beam:transforms:xlang:test:gbk)/TestLabel:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Map(<lambda at validate_runner_xlang_test.py:81>)_8\n Map(<lambda at validate_runner_xlang_test.py:81>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_11\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2714>)_12\n assert_that/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_14\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_15\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_16\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_18\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_19\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_20\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_21\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_25\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_26\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_27\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>']
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'dataflow_kms_key' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'enable_streaming_engine' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'project' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_region' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_name' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'runner' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'temp_location' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'streaming' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'experiments' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'flink_master' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'pubsub_root_url' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'environment_cache_millis' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'files_to_stage' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_endpoint' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'output_executable_path' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'sdk_worker_parallelism' was already added
ERROR:grpc._channel:Exception iterating requests!
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 195, in consume_request_iterator
request = next(request_iterator)
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py",> line 316, in __next__
raise self._queue.get()
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService"
debug_error_string = "{"created":"@1587592595.162473831","description":"Error received from peer ipv4:127.0.0.1:18090","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}"
>
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_multi_input_output_with_sideinput (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f2d2c29e0c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:36 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Main1/Impulse_3\n Main1/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1/FlatMap(<lambda at core.py:2714>)_4\n Main1/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1/Map(decode)_6\n Main1/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2/Impulse_8\n Main2/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2/FlatMap(<lambda at core.py:2714>)_9\n Main2/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2/Map(decode)_11\n Main2/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side/Impulse_13\n Side/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side/FlatMap(<lambda at core.py:2714>)_14\n Side/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side/Map(decode)_16\n Side/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:multi)/Flatten_3\n ExternalTransform(beam:transforms:xlang:test:multi)/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:multi)/Map(<lambda at expansion_service_test.py:115>)_4\n ExternalTransform(beam:transforms:xlang:test:multi)/Map(<lambda at expansion_service_test.py:115>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:multi)/Map(<lambda at expansion_service_test.py:118>)_5\n ExternalTransform(beam:transforms:xlang:test:multi)/Map(<lambda at expansion_service_test.py:118>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_20\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2714>)_21\n assert_that/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_23\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_24\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_25\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_27\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_28\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_29\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_30\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_34\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_35\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_36\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Create/Impulse_39\n CheckSide/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Create/FlatMap(<lambda at core.py:2714>)_40\n CheckSide/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Create/Map(decode)_42\n CheckSide/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/WindowInto(WindowIntoFn)_43\n CheckSide/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/ToVoidKey_44\n CheckSide/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Group/pair_with_0_46\n CheckSide/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Group/pair_with_1_47\n CheckSide/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Group/Flatten_48\n CheckSide/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Group/GroupByKey_49\n CheckSide/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Group/Map(_merge_tagged_vals_under_key)_53\n CheckSide/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Unkey_54\n CheckSide/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide/Match_55\n CheckSide/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>']
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'dataflow_kms_key' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'enable_streaming_engine' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'project' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_region' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_name' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'runner' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'temp_location' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'streaming' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'experiments' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'flink_master' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'pubsub_root_url' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'environment_cache_millis' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'files_to_stage' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_endpoint' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'output_executable_path' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'sdk_worker_parallelism' was already added
ERROR:grpc._channel:Exception iterating requests!
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 195, in consume_request_iterator
request = next(request_iterator)
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py",> line 316, in __next__
raise self._queue.get()
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService"
debug_error_string = "{"created":"@1587592610.905760813","description":"Error received from peer ipv4:127.0.0.1:18090","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}"
>
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_partition (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f2d2c29e0c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:35 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create/Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2714>)_4\n Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_14\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_15\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/Map(decode)_16\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:partition)/Partition(CallableWrapperPartitionFn)/ParDo(ApplyPartitionFnFn)/ParDo(ApplyPartitionFnFn)_5\n ExternalTransform(beam:transforms:xlang:test:partition)/Partition(CallableWrapperPartitionFn)/ParDo(ApplyPartitionFnFn)/ParDo(ApplyPartitionFnFn):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:partition)/Map(<lambda at expansion_service_test.py:216>)_6\n ExternalTransform(beam:transforms:xlang:test:partition)/Map(<lambda at expansion_service_test.py:216>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:partition)/Map(<lambda at expansion_service_test.py:217>)_7\n ExternalTransform(beam:transforms:xlang:test:partition)/Map(<lambda at expansion_service_test.py:217>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Create/Impulse_20\n check_even/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Create/FlatMap(<lambda at core.py:2714>)_21\n check_even/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Create/Map(decode)_23\n check_even/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/WindowInto(WindowIntoFn)_24\n check_even/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/ToVoidKey_25\n check_even/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Group/pair_with_0_27\n check_even/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Group/pair_with_1_28\n check_even/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Group/Flatten_29\n check_even/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Group/GroupByKey_30\n check_even/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Group/Map(_merge_tagged_vals_under_key)_34\n check_even/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Unkey_35\n check_even/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even/Match_36\n check_even/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Create/Impulse_39\n check_odd/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Create/FlatMap(<lambda at core.py:2714>)_40\n check_odd/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Create/Map(decode)_42\n check_odd/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/WindowInto(WindowIntoFn)_43\n check_odd/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/ToVoidKey_44\n check_odd/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Group/pair_with_0_46\n check_odd/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Group/pair_with_1_47\n check_odd/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Group/Flatten_48\n check_odd/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Group/GroupByKey_49\n check_odd/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Group/Map(_merge_tagged_vals_under_key)_53\n check_odd/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Unkey_54\n check_odd/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd/Match_55\n check_odd/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>']
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'dataflow_kms_key' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'enable_streaming_engine' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'project' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_region' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_name' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'runner' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'temp_location' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'streaming' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'experiments' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'flink_master' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'pubsub_root_url' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'environment_cache_millis' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'files_to_stage' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_endpoint' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'output_executable_path' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'sdk_worker_parallelism' was already added
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
test_prefix (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f2d2c29e0c8> ====================
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:21 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create/Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2714>)_4\n Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)_14\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys_15\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create/Map(decode)_16\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_10_AppliedPTransform_ExternalTransform(beam:transforms:xlang:test:prefix)/TestLabel_3\n ExternalTransform(beam:transforms:xlang:test:prefix)/TestLabel:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Impulse_20\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2714>)_21\n assert_that/Create/FlatMap(<lambda at core.py:2714>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Create/Map(decode)_23\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_24\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/ToVoidKey_25\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_0_27\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/pair_with_1_28\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Flatten_29\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/GroupByKey_30\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_34\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Unkey_35\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that/Match_36\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>']
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'dataflow_kms_key' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'enable_streaming_engine' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'project' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_region' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'worker_zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'zone' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_name' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'runner' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'temp_location' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'streaming' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'experiments' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'flink_master' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'pubsub_root_url' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'environment_cache_millis' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'files_to_stage' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'job_endpoint' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'output_executable_path' was already added
DEBUG:apache_beam.runners.portability.portable_runner:Runner option 'sdk_worker_parallelism' was already added
ERROR:grpc._channel:Exception iterating requests!
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 195, in consume_request_iterator
request = next(request_iterator)
File "<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/runners/portability/artifact_service.py",> line 316, in __next__
raise self._queue.get()
_MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService"
debug_error_string = "{"created":"@1587592661.895243770","description":"Error received from peer ipv4:127.0.0.1:18090","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}"
>
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
ok
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 10 tests in 176.468s
OK
> Task :runners:spark:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3932.
Stopping expansion service pid: 3933.
> Task :runners:spark:job-server:sparkJobServerCleanup
Stopping job server pid: 16234.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 26m 36s
107 actionable tasks: 82 executed, 23 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hxoa552vyc3ra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark #725
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/725/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #724
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/724/display/redirect?page=changes>
Changes:
[github] Make license_script.sh tolerate directory already existing (#11501)
[github] [BEAM-9778] remove temp directory & add docker-pull-licenses to release
------------------------------------------
[...truncated 328.02 KB...]
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for annotations-13.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for kotlin-stdlib-jdk8-1.3.21 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for kotlin-stdlib-jdk7-1.3.21 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/javassist/javassist/3.20.0-GA/javassist-3.20.0-GA.jar for javassist-3.20.0-GA is accessable.
Confirmed that https://repo1.maven.org/maven2/org/javassist/javassist/3.19.0-GA/javassist-3.19.0-GA.jar for javassist-3.19.0-GA is accessable.
Confirmed that https://www.apache.org/licenses/LICENSE-2.0.txt for annotations-17.0.0 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/jboss/modules/jboss-modules/1.1.0.Beta1/jboss-modules-1.1.0.Beta1-sources.jar for jboss-modules-1.1.0.Beta1 is accessable.
License/notice for jsoup-1.13.1 were pulled automatically.
License/notice for lmdbjava-0.6.1 were pulled automatically.
License/notice for stax-ex-1.8.1 were pulled automatically.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for json4s-ast_2.11-3.5.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for json4s-core_2.11-3.5.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for json4s-scalap_2.11-3.5.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for json4s-jackson_2.11-3.5.3 is accessable.
License/notice for mockito-core-3.0.0 were pulled automatically.
Confirmed that https://repo1.maven.org/maven2/org/jboss/modules/jboss-modules/1.1.0.Beta1/jboss-modules-1.1.0.Beta1.jar for jboss-modules-1.1.0.Beta1 is accessable.
Confirmed that http://www.json.org/license.html for json-20090211 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for lz4-java-1.4 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for lz4-java-1.4.0 is accessable.
Confirmed that http://www.eclipse.org/org/documents/epl-v10.php for jetty-6.1.26 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for lz4-java-1.5.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for mongo-java-driver-3.9.1 is accessable.
Confirmed that http://www.eclipse.org/org/documents/epl-v10.php for jetty-sslengine-6.1.26 is accessable.
License/notice for objenesis-2.1 were pulled automatically.
License/notice for objenesis-2.5.1 were pulled automatically.
License/notice for objenesis-2.6 were pulled automatically.
License/notice for objenesis-3.0.1 were pulled automatically.
Confirmed that https://raw.githubusercontent.com/javaee/glassfish/master/LICENSE for jsp-2.1-6.1.14 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for jsp-api-2.1-6.1.14 is accessable.
Confirmed that http://www.eclipse.org/org/documents/epl-v10.php for jetty-util-6.1.26 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for servlet-api-2.5-20081211 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for noggit-0.6 is accessable.
Confirmed that https://raw.githubusercontent.com/opengeospatial/geoapi/master/LICENSE.txt for geoapi-3.0.1 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jcodings-1.0.8 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for joni-2.1.2 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-4.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-5.0.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-5.0.4 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-7.3.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-7.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-6.2.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-all-5.0.2 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-analysis-5.0.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-analysis-6.2.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-analysis-7.0 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14-sources.jar for jsp-2.1-6.1.14 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-commons-5.0.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-commons-5.0.4 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-commons-6.2.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-commons-7.0 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar for jsp-2.1-6.1.14 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-tree-5.0.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-util-5.0.3 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-tree-7.0 is accessable.
License/notice for postgresql-42.2.2 were pulled automatically.
License/notice for powermock-api-mockito2-2.0.2 were pulled automatically.
License/notice for powermock-api-support-2.0.2 were pulled automatically.
License/notice for powermock-core-2.0.2 were pulled automatically.
License/notice for powermock-module-junit4-2.0.2 were pulled automatically.
License/notice for powermock-module-junit4-common-2.0.2 were pulled automatically.
License/notice for powermock-reflect-2.0.2 were pulled automatically.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-tree-6.2.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for asm-util-7.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.html for pentaho-aggdesigner-algorithm-5.1.5-jhyde is accessable.
Confirmed that https://raw.githubusercontent.com/reactive-streams/reactive-streams-jvm/master/LICENSE for reactive-streams-1.0.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for quartz-2.3.2 is accessable.
Confirmed that https://raw.githubusercontent.com/reactive-streams/reactive-streams-jvm/master/LICENSE for reactive-streams-1.0.3 is accessable.
Confirmed that https://raw.githubusercontent.com/reactive-streams/reactive-streams-jvm/master/LICENSE for reactive-streams-1.0.2 is accessable.
Confirmed that https://opensource.org/licenses/MIT for plume-util-1.0.6 is accessable.
Confirmed that https://www.oracle.com/downloads/licenses/javase-license1.html for servlet-api-2.5-6.1.14 is accessable.
Confirmed that https://opensource.org/licenses/MIT for require-javadoc-0.1.0 is accessable.
Confirmed that https://opensource.org/licenses/MIT for reflection-util-0.0.2 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for pcollections-2.1.2 is accessable.
Confirmed that http://opensource.org/licenses/MIT for duct-tape-1.0.7 is accessable.
Confirmed that http://opensource.org/licenses/MIT for visible-assertions-2.1.2 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14-sources.jar for servlet-api-2.5-6.1.14 is accessable.
Confirmed that http://opensource.org/licenses/MIT for tcp-unix-socket-proxy-1.0.2 is accessable.
Confirmed that http://www.opensource.org/licenses/lgpl-3.0 for org.restlet.ext.servlet-2.3.0 is accessable.
Confirmed that http://www.opensource.org/licenses/lgpl-3.0 for org.restlet-2.3.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for shims-0.7.45 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar for servlet-api-2.5-6.1.14 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for roaringbitmap-0.7.45 is accessable.
Confirmed that http://www.mindrot.org/files/jBCrypt/LICENSE for jbcrypt-0.3m is accessable.
Confirmed that http://www.gnu.org/licenses/gpl-2.0.html for rocksdbjni-5.7.3 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-async_2.12-0.9.7 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-java8-compat_2.11-0.7.0 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-java8-compat_2.12-0.8.0 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-parser-combinators_2.11-1.0.4 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-parser-combinators_2.12-1.1.0 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-parser-combinators_2.11-1.1.0 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-parser-combinators_2.11-1.1.1 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-parser-combinators_2.12-1.1.1 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-xml_2.11-1.0.6 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for scala-xml_2.12-1.1.0 is accessable.
Confirmed that https://repo.spring.io/plugins-release/org/restlet/jee/org.restlet/2.3.0/org.restlet-2.3.0-sources.jar for org.restlet-2.3.0 is accessable.
Confirmed that https://repo.spring.io/plugins-release/org/restlet/jee/org.restlet.ext.servlet/2.3.0/org.restlet.ext.servlet-2.3.0-sources.jar for org.restlet.ext.servlet-2.3.0 is accessable.
Confirmed that https://repo.spring.io/plugins-release/org/restlet/jee/org.restlet/2.3.0/org.restlet-2.3.0.jar for org.restlet-2.3.0 is accessable.
Confirmed that https://repo.spring.io/plugins-release/org/restlet/jee/org.restlet.ext.servlet/2.3.0/org.restlet.ext.servlet-2.3.0.jar for org.restlet.ext.servlet-2.3.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for scalate-core_2.11-1.8.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for scalate-util_2.11-1.8.0 is accessable.
Confirmed that https://github.com/nbronson/scala-stm/blob/master/LICENSE.txt for scala-stm_2.12-0.8 is accessable.
Confirmed that http://github.com/scalatra/scalatra/raw/HEAD/LICENSE for scalatra-common_2.11-2.5.0 is accessable.
Confirmed that http://github.com/scalatra/scalatra/raw/HEAD/LICENSE for scalatra-scalate_2.11-2.5.0 is accessable.
Confirmed that https://raw.githubusercontent.com/scijava/native-lib-loader/master/LICENSE.txt for native-lib-loader-2.0.2 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for jsonassert-1.5.0 is accessable.
Confirmed that http://github.com/scalatra/scalatra/raw/HEAD/LICENSE for scalatra_2.11-2.5.0 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-compiler-2.11.8 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-library-2.11.11 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jcl-over-slf4j-1.7.16 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-library-2.11.12 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-library-2.12.6 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-library-2.12.7 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-reflect-2.11.8 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-reflect-2.11.12 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jcl-over-slf4j-1.7.25 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-reflect-2.12.4 is accessable.
Confirmed that http://www.scala-lang.org/license.html for scala-reflect-2.12.7 is accessable.
License/notice for cglib-2.2.1-v20090111 were pulled automatically.
License/notice for spring-core-4.3.18.RELEASE were pulled automatically.
License/notice for spring-expression-4.3.18.RELEASE were pulled automatically.
License/notice for xmpcore-shaded-6.1.10 were pulled automatically.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jcl-over-slf4j-1.7.28 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jcl-over-slf4j-1.7.7 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jul-to-slf4j-1.7.16 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for unused-1.0.0 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for jul-to-slf4j-1.7.28 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for log4j-over-slf4j-1.7.7 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for metadata-extractor-2.13.0 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for slf4j-api-1.7.21 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for slf4j-api-1.7.25 is accessable.
License/notice for threetenbp-1.4.1 were pulled automatically.
Confirmed that https://www.apache.org/licenses/LICENSE-2.0.txt for model-builder-1.3 is accessable.
Confirmed that http://www.linfo.org/bsdlicense.html for jmatio-1.5 is accessable.
License/notice for snappy-java-1.1.4 were pulled automatically.
Confirmed that http://www.opensource.org/licenses/mit-license.php for slf4j-api-1.7.26 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for slf4j-jdk14-1.7.25 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for slf4j-log4j12-1.7.25 is accessable.
Confirmed that http://www.opensource.org/licenses/mit-license.php for slf4j-simple-1.7.25 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for snakeyaml-1.17 is accessable.
License/notice for oro-2.0.8 were pulled automatically.
Confirmed that http://opensource.org/licenses/MIT for clickhouse-1.10.5 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for snakeyaml-1.23 is accessable.
Confirmed that http://opensource.org/licenses/MIT for database-commons-1.10.5 is accessable.
Confirmed that http://opensource.org/licenses/MIT for jdbc-1.10.5 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for snakeyaml-1.24 is accessable.
Confirmed that http://opensource.org/licenses/MIT for localstack-1.11.2 is accessable.
Confirmed that http://opensource.org/licenses/MIT for testcontainers-1.11.2 is accessable.
Confirmed that http://opensource.org/licenses/MIT for testcontainers-1.10.5 is accessable.
Confirmed that https://bitbucket.org/asomov/snakeyaml/raw/3d49667ece57d564668b9a155c55ccfe26aaca00/LICENSE.txt for snakeyaml-1.15 is accessable.
Confirmed that ht
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild
> Task :sdks:java:container:generateThirdPartyLicenses FAILED
Traceback (most recent call last):
tps://bitbucket.org/asomov/snakeyaml/raw/3d49667ece57d564668b9a155c55ccfe26aaca00/LICENSE.txt for snakeyaml-1.12 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0 for clickhouse-jdbc-0.1.47 is accessable.
File "sdks/java/container/license_scripts/pull_licenses_java.py", line 323, in <module>
Confirmed that http://opensource.org/licenses/MIT for testcontainers-1.11.3 is accessable.
error_msg)
Confirmed that https://raw.githubusercontent.com/xvik/generics-resolver/master/LICENSE for generics-resolver-2.0.1 is accessable.
Confirmed that http://github.com/xetorthio/jedis/raw/master/LICENSE.txt for jedis-3.0.1 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for apache-client-2.10.61 is accessable.
RuntimeError: ('2 error(s) occurred.', ['**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to sdks/java/container/license_scripts/dep_urls_java.yaml for each missing license. Dependency List: [zetasql-client-2020.04.1,zetasql-jni-channel-2020.04.1,zetasql-jni-channel-darwin-2020.04.1,zetasql-jni-channel-linux-2020.04.1,zetasql-types-2020.04.1]', '**************************************** License type of some dependencies were not identified. The license type is used to decide whether the source code of the dependency should be pulled or not. Please add "type" field to sdks/java/container/license_scripts/dep_urls_java.yaml for each dependency. Dependency List: [zetasql-client-2020.04.1,zetasql-jni-channel-2020.04.1,zetasql-jni-channel-darwin-2020.04.1,zetasql-jni-channel-linux-2020.04.1,zetasql-types-2020.04.1]'])
Confirmed that https://aws.amazon.com/apache2.0 for annotations-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for cloudwatch-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for aws-query-protocol-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for netty-nio-client-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for aws-core-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for auth-2.10.61 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for ion-java-1.0.2 is accessable.
Confirmed that https://git.tukaani.org/?p=xz-java.git;a=blob_plain;f=COPYING;h=c1d404dc7a6f06a0437bf1055fedaa4a4c89d728;hb=HEAD for xz-1.8 is accessable.
Confirmed that https://git.tukaani.org/?p=xz-java.git;a=blob_plain;f=COPYING;h=c1d404dc7a6f06a0437bf1055fedaa4a4c89d728;hb=HEAD for xz-1.5 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for profiles-2.10.61 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for stax-api-1.0.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for jasper-compiler-5.5.23 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for jasper-runtime-5.5.23 is accessable.
License/notice for xml-apis-1.3.04 were pulled automatically.
License/notice for xml-apis-1.4.01 were pulled automatically.
Confirmed that https://aws.amazon.com/apache2.0 for regions-2.10.61 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for xercesimpl-2.12.0 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for xercesimpl-2.9.1 is accessable.
Confirmed that http://www.apache.org/licenses/LICENSE-2.0.txt for xml-resolver-1.2 is accessable.
Confirmed that http://opensource.org/licenses/BSD-3-Clause for sqlline-1.4.0 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for sns-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for http-client-spi-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for protocol-core-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for sqs-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for dynamodb-2.10.61 is accessable.
Confirmed that http://www.opensource.org/licenses/bsd-license.php for xmlenc-0.52 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for utils-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for sdk-core-2.10.61 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for eventstream-1.0.1 is accessable.
Confirmed that https://aws.amazon.com/apache2.0 for aws-json-protocol-2.10.61 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1-sources.jar for osgi-resource-locator-1.0.1 is accessable.
Confirmed that https://repo1.maven.org/maven2/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar for osgi-resource-locator-1.0.1 is accessable.
[u'zetasql-jni-channel-darwin-2020.04.1', u'zetasql-jni-channel-2020.04.1', u'zetasql-client-2020.04.1', u'zetasql-jni-channel-linux-2020.04.1', u'zetasql-types-2020.04.1']
pull_licenses_java.py failed. It took 15.957281 seconds with 16 threads.
> Task :sdks:python:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go>
> Task :sdks:java:container:copyDockerfileDependencies
> Task :sdks:java:container:dockerClean UP-TO-DATE
> Task :sdks:java:container:goPrepare
Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/.gogradle/project_gopath>
> Task :sdks:python:container:installDependencies
> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go>
> Task :sdks:java:container:installDependencies
> Task :sdks:python:container:buildDarwinAmd64
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:python:container:buildLinuxAmd64
> Task :sdks:python:container:goBuild
> Task :sdks:python:container:py2:copyLauncherDependencies
> Task :sdks:python:container:py2:dockerPrepare
> Task :sdks:python:container:py2:docker
> Task :runners:spark:job-server:sparkJobServerCleanup
Stopping job server pid: 26295.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:generateThirdPartyLicenses'.
> Process 'command './sdks/java/container/license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 19s
98 actionable tasks: 73 executed, 23 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3ltljktsvxrp2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org