You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/02/21 19:51:01 UTC
Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJava_Dataflow #99
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/99/display/redirect>
Changes:
------------------------------------------
[...truncated 931.45 KB...]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:706 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:722 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:706 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:722 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:706 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:722 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:706 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/beam-sdks-java-testing-expansion-service-testExpansionService-2.38.0-SNAPSHOT-5WZIZWkf728cJIIyAlSeVpaoRey9aupu7IH1Qh_dtbc.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:722 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/beam-sdks-java-testing-expansion-service-testExpansionService-2.38.0-SNAPSHOT-5WZIZWkf728cJIIyAlSeVpaoRey9aupu7IH1Qh_dtbc.jar in 4 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:706 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/dataflow_python_sdk.tar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:722 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/dataflow_python_sdk.tar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:706 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:722 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0221194123-318296-f9kotkri.1645472483.318602/pipeline.pb in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:886 Create job: <Job
clientRequestId: '20220221194123319371-1790'
createTime: '2022-02-21T19:41:29.348248Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2022-02-21_11_41_28-13529930377293279110'
location: 'us-central1'
name: 'beamapp-jenkins-0221194123-318296-f9kotkri'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2022-02-21T19:41:29.348248Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:888 Created job with id: [2022-02-21_11_41_28-13529930377293279110]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:889 Submitted job: 2022-02-21_11_41_28-13529930377293279110
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:890 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-21_11_41_28-13529930377293279110?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2022-02-21_11_41_28-13529930377293279110 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:30.924Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2022-02-21_11_41_28-13529930377293279110. The number of workers will be between 1 and 1000.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:31.046Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2022-02-21_11_41_28-13529930377293279110.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:32.714Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.218Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.245Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.311Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.349Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step check_odd/Group/CoGroupByKeyImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.381Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step check_even/Group/CoGroupByKeyImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.412Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.450Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.480Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.514Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.550Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Flatten_27
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.585Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Flatten_27
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.622Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Flatten_45
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.655Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Flatten_45
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.680Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Flatten_27 for input ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Tag-0-_25.None-post19
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.711Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_even/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten check_even/Group/CoGroupByKeyImpl/Flatten, into producer check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.750Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/MapTuple(collect_values) into check_even/Group/CoGroupByKeyImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.770Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/RestoreTags into check_even/Group/CoGroupByKeyImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.807Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Unkey into check_even/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.831Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Match into check_even/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.863Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Flatten_45 for input ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Tag-0-_43.None-post23
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.889Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten check_odd/Group/CoGroupByKeyImpl/Flatten, into producer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.920Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/MapTuple(collect_values) into check_odd/Group/CoGroupByKeyImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:33.953Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/RestoreTags into check_odd/Group/CoGroupByKeyImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.003Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Unkey into check_odd/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.024Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Match into check_odd/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.048Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/GroupByKey/Write into check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.077Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write into check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.098Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/FlatMap(<lambda at core.py:3229>) into Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.131Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/AddRandomKeys into Create/FlatMap(<lambda at core.py:3229>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.164Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps) into Create/MaybeReshuffle/Reshuffle/AddRandomKeys
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.197Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.229Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.251Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.286Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps) into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.307Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.339Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/Map(decode) into Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.364Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition) into Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.399Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/WindowInto(WindowIntoFn) into ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.431Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/WindowInto(WindowIntoFn) into ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.465Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Create/FlatMap(<lambda at core.py:3229>) into check_even/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.497Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Create/Map(decode) into check_even/Create/FlatMap(<lambda at core.py:3229>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.530Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Tag[0] into check_even/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.583Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_even/Group/CoGroupByKeyImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.605Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/ToVoidKey into check_even/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.632Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Tag[1] into check_even/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.655Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_even/Group/CoGroupByKeyImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.688Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Create/FlatMap(<lambda at core.py:3229>) into check_odd/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.712Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Create/Map(decode) into check_odd/Create/FlatMap(<lambda at core.py:3229>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.736Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Tag[0] into check_odd/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.769Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_odd/Group/CoGroupByKeyImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.809Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/ToVoidKey into check_odd/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.833Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Tag[1] into check_odd/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.856Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_odd/Group/CoGroupByKeyImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.885Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.917Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.947Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:34.995Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.118Z: JOB_MESSAGE_DEBUG: Executing wait step start39
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.186Z: JOB_MESSAGE_BASIC: Executing operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.209Z: JOB_MESSAGE_BASIC: Executing operation check_even/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.222Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.231Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.252Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.296Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.310Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.310Z: JOB_MESSAGE_BASIC: Finished operation check_even/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.377Z: JOB_MESSAGE_DEBUG: Value "check_even/Group/CoGroupByKeyImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.403Z: JOB_MESSAGE_DEBUG: Value "check_odd/Group/CoGroupByKeyImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.426Z: JOB_MESSAGE_DEBUG: Value "Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.450Z: JOB_MESSAGE_BASIC: Executing operation check_even/Create/Impulse+check_even/Create/FlatMap(<lambda at core.py:3229>)+check_even/Create/Map(decode)+check_even/Group/CoGroupByKeyImpl/Tag[0]+check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_even/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.473Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Create/Impulse+check_odd/Create/FlatMap(<lambda at core.py:3229>)+check_odd/Create/Map(decode)+check_odd/Group/CoGroupByKeyImpl/Tag[0]+check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:41:35.497Z: JOB_MESSAGE_BASIC: Executing operation Create/Impulse+Create/FlatMap(<lambda at core.py:3229>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:42:05.614Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:42:15.831Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:43:04.320Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928 not found: manifest unknown: Failed to fetch "20220221191928" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20220221191928".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:43:18.891Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:44:15.514Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928 not found: manifest unknown: Failed to fetch "20220221191928" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20220221191928".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:44:41.807Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:45:31.833Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928 not found: manifest unknown: Failed to fetch "20220221191928" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20220221191928".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:45:56.352Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:46:43.161Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928 not found: manifest unknown: Failed to fetch "20220221191928" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20220221191928".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:09.568Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:57.855Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928 not found: manifest unknown: Failed to fetch "20220221191928" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20220221191928".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:57.884Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928 not found: manifest unknown: Failed to fetch "20220221191928" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20220221191928".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image..
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:57.946Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Create/Impulse+check_odd/Create/FlatMap(<lambda at core.py:3229>)+check_odd/Create/Map(decode)+check_odd/Group/CoGroupByKeyImpl/Tag[0]+check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:57.946Z: JOB_MESSAGE_BASIC: Finished operation check_even/Create/Impulse+check_even/Create/FlatMap(<lambda at core.py:3229>)+check_even/Create/Map(decode)+check_even/Group/CoGroupByKeyImpl/Tag[0]+check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_even/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:57.946Z: JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at core.py:3229>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:58.023Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:58.081Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:58.121Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:47:58.388Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:48:51.088Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2022-02-21T19:48:51.119Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2022-02-21_11_41_28-13529930377293279110 is in state JOB_STATE_FAILED
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54: DeprecationWarning: invalid escape sequence \c
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62: DeprecationWarning: invalid escape sequence \d
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============== 2 failed, 8 passed, 32 warnings in 1218.86 seconds ==============
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 373124.
Stopping expansion service pid: 373125.
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220221191928
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9712edebb4e5162db3875f57ffc6192236a0be2a59f97aa0073bf8bb0f231ae9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220221191928]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9712edebb4e5162db3875f57ffc6192236a0be2a59f97aa0073bf8bb0f231ae9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220221191928] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9712edebb4e5162db3875f57ffc6192236a0be2a59f97aa0073bf8bb0f231ae9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9712edebb4e5162db3875f57ffc6192236a0be2a59f97aa0073bf8bb0f231ae9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9712edebb4e5162db3875f57ffc6192236a0be2a59f97aa0073bf8bb0f231ae9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:9712edebb4e5162db3875f57ffc6192236a0be2a59f97aa0073bf8bb0f231ae9].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:91ff8b4536f55006bd8e1515611e8a76008c904d8d15bc33119db60f3ef31b85
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220221191928]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 294
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 30m 13s
103 actionable tasks: 25 executed, 78 up-to-date
Publishing build scan...
https://gradle.com/s/f46wbr3phlfqm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJava_Dataflow #100
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/100/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org