You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/26 13:23:36 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1119
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1119/display/redirect?page=changes>
Changes:
[Ankur Goenka] Update Beam website to release 2.32.0
[noreply] Update website/www/site/content/en/get-started/downloads.md
------------------------------------------
[...truncated 635.46 KB...]
@pytest.mark.xlang_transforms
def test_cogroup_by_key(self, test_pipeline=None):
CrossLanguageTestPipelines().run_cogroup_by_key(
> test_pipeline or self.create_pipeline())
apache_beam/transforms/validate_runner_xlang_test.py:269:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/validate_runner_xlang_test.py:164: in run_cogroup_by_key
assert_that(res, equal_to(['0:1,2,4', '1:3,5,6']))
apache_beam/pipeline.py:586: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:565: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/dataflow/test_dataflow_runner.py:65: in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <DataflowPipelineResult <Job
createTime: '2021-08-26T12:20:03.471769Z'
currentState: CurrentStateValueValuesEnum(JOB...021-08-26T12:20:03.471769Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f177aeccdd8>
duration = None
def wait_until_finish(self, duration=None):
if not self.is_in_terminal_state():
if not self.has_job:
raise IOError('Failed to get the Dataflow job id.')
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
time.sleep(5.0)
# TODO: Merge the termination code in poll_for_job_completion and
# is_in_terminal_state.
terminated = self.is_in_terminal_state()
assert duration or terminated, (
'Job did not reach to a terminal state after waiting indefinitely.')
if terminated and self.state != PipelineState.DONE:
# TODO(BEAM-1290): Consider converting this to an error log based on
# theresolution of the issue.
raise DataflowRuntimeException(
'Dataflow pipeline failed. State: %s, Error:\n%s' %
(self.state, getattr(self._runner, 'last_error_msg', None)),
> self)
E apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
E The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. Please check the worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
apache_beam/runners/dataflow/dataflow_runner.py:1635: DataflowRuntimeException
------------------------------ Captured log call -------------------------------
INFO apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.6_sdk:2.34.0.dev
INFO root:environments.py:296 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python36-fnapi:beam-master-20210809
INFO root:environments.py:304 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python36-fnapi:beam-master-20210809" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:650 ==================== <function pack_combiners at 0x7f177cf3dc80> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:650 ==================== <function sort_stages at 0x7f177cf3f488> ====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:452 Defaulting to the temp_location as staging_location: gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/beam-sdks-java-testing-expansion-service-testExpansionService-2.34.0-SNAPSHOT-MnKX91fhkQ_i_cL0hpTjCN4rl2aiLmFXWzIhyh1bM6A.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/beam-sdks-java-testing-expansion-service-testExpansionService-2.34.0-SNAPSHOT-MnKX91fhkQ_i_cL0hpTjCN4rl2aiLmFXWzIhyh1bM6A.jar in 5 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/dataflow_python_sdk.tar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/dataflow_python_sdk.tar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0826121955-429586.1629980395.430439/pipeline.pb in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:798 Create job: <Job
createTime: '2021-08-26T12:20:03.471769Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2021-08-26_05_20_02-1533130050858143870'
location: 'us-central1'
name: 'beamapp-jenkins-0826121955-429586'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2021-08-26T12:20:03.471769Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:800 Created job with id: [2021-08-26_05_20_02-1533130050858143870]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:801 Submitted job: 2021-08-26_05_20_02-1533130050858143870
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:807 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-26_05_20_02-1533130050858143870?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-08-26_05_20_02-1533130050858143870 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:16.162Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-08-26_05_20_02-1533130050858143870. The number of workers will be between 1 and 1000.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:16.230Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-08-26_05_20_02-1533130050858143870.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:17.945Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-a.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.608Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.655Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.715Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.746Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step assert_that/Group/_CoGBKImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.784Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.818Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.850Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.883Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.911Z: JOB_MESSAGE_DEBUG: Inserted coder converter after flatten ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_26
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.945Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_26 for input ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Tag-0-_24.None
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:18.979Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/_CoGBKImpl/Flatten/OutputIdentity, through flatten assert_that/Group/_CoGBKImpl/Flatten, into producer assert_that/Group/_CoGBKImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.020Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/_CoGBKImpl/MapTuple(collect_values) into assert_that/Group/_CoGBKImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.034Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/RestoreTags into assert_that/Group/_CoGBKImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.059Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.084Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.110Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_26-u16 for input ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_26.None-c14
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.135Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/_CoGBKImpl/GroupByKey/Write, through flatten assert_that/Group/_CoGBKImpl/Flatten/Unzipped-1, into producer assert_that/Group/_CoGBKImpl/Flatten/OutputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.172Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/_CoGBKImpl/Flatten/OutputIdentity into assert_that/Group/_CoGBKImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.210Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/_CoGBKImpl/GroupByKey/Write into assert_that/Group/_CoGBKImpl/Flatten/OutputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.265Z: JOB_MESSAGE_DETAILED: Unzipping flatten external_1ExternalTransform-beam-transforms-xlang-test-cgbk--CoGroupByKey-Flatten for input external_1ExternalTransform-beam-transforms-xlang-test-cgbk--CoGroupByKey-MakeUnionTable0-ParMultiDo-Construct.output
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.305Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Write, through flatten ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/Flatten, into producer ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.332Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.364Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:cgbk)/ParDo(Anonymous)/ParMultiDo(Anonymous) into ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.388Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at validate_runner_xlang_test.py:163>) into ExternalTransform(beam:transforms:xlang:test:cgbk)/ParDo(Anonymous)/ParMultiDo(Anonymous)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.422Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into Map(<lambda at validate_runner_xlang_test.py:163>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.447Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.480Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/_CoGBKImpl/Tag[1] into assert_that/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.507Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Write into ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.542Z: JOB_MESSAGE_DETAILED: Fusing consumer create_col2/FlatMap(<lambda at core.py:2965>) into create_col2/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.574Z: JOB_MESSAGE_DETAILED: Fusing consumer create_col2/Map(decode) into create_col2/FlatMap(<lambda at core.py:2965>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.611Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into create_col2/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.644Z: JOB_MESSAGE_DETAILED: Fusing consumer create_col1/FlatMap(<lambda at core.py:2965>) into create_col1/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.678Z: JOB_MESSAGE_DETAILED: Fusing consumer create_col1/Map(decode) into create_col1/FlatMap(<lambda at core.py:2965>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.700Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into create_col1/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.722Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/FlatMap(<lambda at core.py:2965>) into assert_that/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.758Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/Map(decode) into assert_that/Create/FlatMap(<lambda at core.py:2965>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.791Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/_CoGBKImpl/Tag[0] into assert_that/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.838Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.860Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.891Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:19.929Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.069Z: JOB_MESSAGE_DEBUG: Executing wait step start28
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.124Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.147Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/_CoGBKImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.171Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.193Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.259Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.273Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/_CoGBKImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.327Z: JOB_MESSAGE_DEBUG: Value "ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.359Z: JOB_MESSAGE_DEBUG: Value "assert_that/Group/_CoGBKImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.396Z: JOB_MESSAGE_BASIC: Executing operation create_col1/Impulse+create_col1/FlatMap(<lambda at core.py:2965>)+create_col1/Map(decode)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.425Z: JOB_MESSAGE_BASIC: Executing operation create_col2/Impulse+create_col2/FlatMap(<lambda at core.py:2965>)+create_col2/Map(decode)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:20.450Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2965>)+assert_that/Create/Map(decode)+assert_that/Group/_CoGBKImpl/Tag[0]+assert_that/Group/_CoGBKImpl/Flatten/OutputIdentity+assert_that/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:20:27.217Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:21:00.691Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:21:14.930Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T12:21:14.956Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO oauth2client.transport:transport.py:185 Refreshing due to a 401 (attempt 1/2)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:20.506Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. Please check the worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:20.562Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2021-08-26_05_20_02-1533130050858143870.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:20.581Z: JOB_MESSAGE_ERROR: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. Please check the worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:20.582Z: JOB_MESSAGE_BASIC: Finished operation create_col1/Impulse+create_col1/FlatMap(<lambda at core.py:2965>)+create_col1/Map(decode)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:20.582Z: JOB_MESSAGE_BASIC: Finished operation create_col2/Impulse+create_col2/FlatMap(<lambda at core.py:2965>)+create_col2/Map(decode)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)+ExternalTransform(beam:transforms:xlang:test:cgbk)/CoGroupByKey/GBK/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:20.582Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at core.py:2965>)+assert_that/Create/Map(decode)+assert_that/Group/_CoGBKImpl/Tag[0]+assert_that/Group/_CoGBKImpl/Flatten/OutputIdentity+assert_that/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:21.224Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:21.288Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:20:21.321Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:22:39.623Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:22:39.679Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-08-26T13:22:39.705Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-08-26_05_20_02-1533130050858143870 is in state JOB_STATE_FAILED
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============== 7 failed, 1 passed, 8 warnings in 3840.95 seconds ===============
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 13581.
Stopping expansion service pid: 13585.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210826120119
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:20f14439fbae1d7c1a2ad9b9ec380c4320481254389dca34f92d977ac58a1c28
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210826120119]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 22m 57s
105 actionable tasks: 76 executed, 25 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/3jsmsaxhiscnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Dataflow
#1121
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1121/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1120
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1120/display/redirect>
Changes:
------------------------------------------
[...truncated 92.51 KB...]
apache_beam/runners/dataflow/dataflow_runner.py:141: in apply
return super(DataflowRunner, self).apply(transform, input, options)
apache_beam/runners/runner.py:185: in apply
return m(transform, input, options)
apache_beam/runners/runner.py:215: in apply_PTransform
return transform.expand(input)
apache_beam/transforms/external.py:295: in expand
response = service.Expand(request)
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__
return _end_unary_response_blocking(state, call, False, None)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7f4fa7a28ba8>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f4fa7a20c48>
with_call = False, deadline = None
def _end_unary_response_blocking(state, call, with_call, deadline):
if state.code is grpc.StatusCode.OK:
if with_call:
rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
return state.response, rendezvous
else:
return state.response
else:
> raise _InactiveRpcError(state)
E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.UNIMPLEMENTED
E details = "Method not found!"
E debug_error_string = "{"created":"@1630001902.865811756","description":"Error received from peer ipv4:127.0.0.1:39425","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Method not found!","grpc_status":12}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError
_____________________ ValidateRunnerXlangTest.test_prefix ______________________
[gw7] linux -- Python 3.6.8 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/bin/python3.6>
self = <apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest testMethod=test_prefix>
test_pipeline = None
@pytest.mark.xlang_transforms
def test_prefix(self, test_pipeline=None):
CrossLanguageTestPipelines().run_prefix(
> test_pipeline or self.create_pipeline())
apache_beam/transforms/validate_runner_xlang_test.py:254:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/validate_runner_xlang_test.py:98: in run_prefix
self.expansion_service))
apache_beam/pvalue.py:137: in __or__
return self.pipeline.apply(ptransform, self)
apache_beam/pipeline.py:698: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/dataflow/dataflow_runner.py:141: in apply
return super(DataflowRunner, self).apply(transform, input, options)
apache_beam/runners/runner.py:185: in apply
return m(transform, input, options)
apache_beam/runners/runner.py:215: in apply_PTransform
return transform.expand(input)
apache_beam/transforms/external.py:295: in expand
response = service.Expand(request)
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__
return _end_unary_response_blocking(state, call, False, None)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7f9d00cf8b38>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f9d00ce9b08>
with_call = False, deadline = None
def _end_unary_response_blocking(state, call, with_call, deadline):
if state.code is grpc.StatusCode.OK:
if with_call:
rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
return state.response, rendezvous
else:
return state.response
else:
> raise _InactiveRpcError(state)
E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.UNIMPLEMENTED
E details = "Method not found!"
E debug_error_string = "{"created":"@1630001902.796074309","description":"Error received from peer ipv4:127.0.0.1:39425","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Method not found!","grpc_status":12}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError
________ ValidateRunnerXlangTest.test_multi_input_output_with_sideinput ________
[gw6] linux -- Python 3.6.8 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/bin/python3.6>
self = <apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest testMethod=test_multi_input_output_with_sideinput>
test_pipeline = None
@pytest.mark.xlang_transforms
def test_multi_input_output_with_sideinput(self, test_pipeline=None):
CrossLanguageTestPipelines().run_multi_input_output_with_sideinput(
> test_pipeline or self.create_pipeline())
apache_beam/transforms/validate_runner_xlang_test.py:259:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/validate_runner_xlang_test.py:119: in run_multi_input_output_with_sideinput
TEST_MULTI_URN, None, self.expansion_service)
apache_beam/transforms/ptransform.py:615: in __ror__
result = p.apply(self, pvalueish, label)
apache_beam/pipeline.py:698: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/dataflow/dataflow_runner.py:141: in apply
return super(DataflowRunner, self).apply(transform, input, options)
apache_beam/runners/runner.py:185: in apply
return m(transform, input, options)
apache_beam/runners/runner.py:215: in apply_PTransform
return transform.expand(input)
apache_beam/transforms/external.py:295: in expand
response = service.Expand(request)
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__
return _end_unary_response_blocking(state, call, False, None)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7f812a57fe10>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f812a583b08>
with_call = False, deadline = None
def _end_unary_response_blocking(state, call, with_call, deadline):
if state.code is grpc.StatusCode.OK:
if with_call:
rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
return state.response, rendezvous
else:
return state.response
else:
> raise _InactiveRpcError(state)
E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.UNIMPLEMENTED
E details = "Method not found!"
E debug_error_string = "{"created":"@1630001902.749345484","description":"Error received from peer ipv4:127.0.0.1:39425","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Method not found!","grpc_status":12}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError
_________________ ValidateRunnerXlangTest.test_cogroup_by_key __________________
[gw4] linux -- Python 3.6.8 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/bin/python3.6>
self = <apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest testMethod=test_cogroup_by_key>
test_pipeline = None
@pytest.mark.xlang_transforms
def test_cogroup_by_key(self, test_pipeline=None):
CrossLanguageTestPipelines().run_cogroup_by_key(
> test_pipeline or self.create_pipeline())
apache_beam/transforms/validate_runner_xlang_test.py:269:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/transforms/validate_runner_xlang_test.py:163: in run_cogroup_by_key
| beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1])))))
apache_beam/transforms/ptransform.py:615: in __ror__
result = p.apply(self, pvalueish, label)
apache_beam/pipeline.py:698: in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
apache_beam/runners/dataflow/dataflow_runner.py:141: in apply
return super(DataflowRunner, self).apply(transform, input, options)
apache_beam/runners/runner.py:185: in apply
return m(transform, input, options)
apache_beam/runners/runner.py:215: in apply_PTransform
return transform.expand(input)
apache_beam/transforms/external.py:295: in expand
response = service.Expand(request)
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__
return _end_unary_response_blocking(state, call, False, None)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7f2c87a500f0>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f2c87a61588>
with_call = False, deadline = None
def _end_unary_response_blocking(state, call, with_call, deadline):
if state.code is grpc.StatusCode.OK:
if with_call:
rendezvous = _MultiThreadedRendezvous(state, call, None, deadline)
return state.response, rendezvous
else:
return state.response
else:
> raise _InactiveRpcError(state)
E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E status = StatusCode.UNIMPLEMENTED
E details = "Method not found!"
E debug_error_string = "{"created":"@1630001902.864727871","description":"Error received from peer ipv4:127.0.0.1:39425","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Method not found!","grpc_status":12}"
E >
../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
==================== 8 failed, 2 warnings in 52.55 seconds =====================
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Skipping invalid pid: 20307.
Stopping expansion service pid: 20315.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Error: No such image: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210826180113
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210826180113]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 59s
105 actionable tasks: 76 executed, 25 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/ucgavpf2zw22q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org