You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/12/16 00:54:15 UTC
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow #304
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/304/display/redirect>
------------------------------------------
[...truncated 8.09 MB...]
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/GroupGlobally/Values/Values/Map as step s32
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/GroupGlobally/ParDo(Concat) as step s33
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/GetPane/Map as step s34
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/RunChecks as step s35
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/VerifyAssertions/ParDo(DefaultConclude) as step s36
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-1216005017-ace12e12/output/results/staging/
Dec 16, 2018 12:50:29 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <77886 bytes, hash AWoINmLpIHBFIcGmAylHlQ> to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-1216005017-ace12e12/output/results/staging/pipeline-AWoINmLpIHBFIcGmAylHlQ.pb
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Dataflow SDK version: 2.10.0-SNAPSHOT
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Dec 16, 2018 12:50:30 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-15_16_50_29-7301157709659120626?project=apache-beam-testing
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Submitted job: 2018-12-15_16_50_29-7301157709659120626
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Dec 16, 2018 12:50:30 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-12-15_16_50_29-7301157709659120626
Dec 16, 2018 12:50:30 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-12-15_16_50_29-7301157709659120626 with 0 expected assertions.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:29.596Z: Autoscaling is enabled for job 2018-12-15_16_50_29-7301157709659120626. The number of workers will be between 1 and 1000.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:29.650Z: Autoscaling was automatically enabled for job 2018-12-15_16_50_29-7301157709659120626.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-12-16T00:50:32.003Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: flattentest0testflattenpcollectionsemptythenpardo-jenkins--z4l4. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:32.322Z: Checking permissions granted to controller Service Account.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:37.336Z: Worker configuration: n1-standard-1 in us-central1-b.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:37.782Z: Expanding CollectionToSingleton operations into optimizable parts.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:37.871Z: Expanding CoGroupByKey operations into optimizable parts.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.093Z: Expanding GroupByKey operations into optimizable parts.
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.166Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.209Z: Elided trivial flatten
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.253Z: Elided trivial flatten
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.289Z: Elided trivial flatten
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.340Z: Unzipping flatten s29 for input s17.org.apache.beam.sdk.values.PCollection.<init>:402#a4f9f304fed667ee
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.385Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$13/GroupGlobally/FlattenDummyAndContents, into producer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.430Z: Fusing consumer PAssert$13/VerifyAssertions/ParDo(DefaultConclude) into PAssert$13/RunChecks
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.474Z: Unzipping flatten s29-u40 for input s31-reify-value18-c38
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.526Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Write, through flatten s29-u40, into producer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.572Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$13/GroupGlobally/GroupDummyAndContents/Read
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.619Z: Fusing consumer PAssert$13/GroupGlobally/Values/Values/Map into PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.658Z: Fusing consumer PAssert$13/GetPane/Map into PAssert$13/GroupGlobally/ParDo(Concat)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.696Z: Fusing consumer PAssert$13/RunChecks into PAssert$13/GetPane/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.743Z: Fusing consumer PAssert$13/GroupGlobally/ParDo(Concat) into PAssert$13/GroupGlobally/Values/Values/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.786Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify into PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.831Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Write into PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.874Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.918Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:38.956Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.000Z: Fusing consumer PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.035Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.064Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.110Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.155Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.193Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.239Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.289Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.332Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.371Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.418Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.465Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.516Z: Fusing consumer PAssert$13/GroupGlobally/Window.Into()/Window.Assign into ParDo(Identity)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.585Z: Fusing consumer PAssert$13/GroupGlobally/RewindowActuals/Window.Assign into PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.636Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.703Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.780Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.886Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:39.962Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.001Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.039Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$13/GroupGlobally/Window.Into()/Window.Assign
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.081Z: Fusing consumer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$13/GroupGlobally/RewindowActuals/Window.Assign
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.118Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.155Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.196Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.243Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.292Z: Fusing consumer ParDo(Identity) into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.737Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.782Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.830Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Create
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.857Z: Starting 1 workers in us-central1-b...
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:40.905Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:41.163Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 16, 2018 12:50:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:41.205Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse+Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 16, 2018 12:51:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:50:59.875Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Dec 16, 2018 12:51:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:51:34.856Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Dec 16, 2018 12:51:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:51:34.898Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Dec 16, 2018 12:51:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:51:37.239Z: Workers have started successfully.
Dec 16, 2018 12:51:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:51:37.286Z: Workers have started successfully.
Dec 16, 2018 12:52:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:07.455Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 16, 2018 12:52:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:07.548Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+ParDo(Identity)+PAssert$13/GroupGlobally/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Dec 16, 2018 12:52:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:09.988Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 16, 2018 12:52:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:10.082Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$13/GroupGlobally/GroupDummyAndContents/Reify+PAssert$13/GroupGlobally/GroupDummyAndContents/Write
Dec 16, 2018 12:52:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:17.762Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Dec 16, 2018 12:52:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:17.873Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$13/GroupGlobally/RewindowActuals/Window.Assign+PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$13/GroupGlobally/GroupDummyAndContents/Reify+PAssert$13/GroupGlobally/GroupDummyAndContents/Write
Dec 16, 2018 12:52:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:22.865Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Close
Dec 16, 2018 12:52:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:22.957Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Read+PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$13/GroupGlobally/Values/Values/Map+PAssert$13/GroupGlobally/ParDo(Concat)+PAssert$13/GetPane/Map+PAssert$13/RunChecks+PAssert$13/VerifyAssertions/ParDo(DefaultConclude)
Dec 16, 2018 12:52:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:29.486Z: Cleaning up.
Dec 16, 2018 12:52:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:52:29.609Z: Stopping worker pool...
Dec 16, 2018 12:54:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:54:05.289Z: Autoscaling: Resized worker pool from 1 to 0.
Dec 16, 2018 12:54:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:54:05.331Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Dec 16, 2018 12:54:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T00:54:05.391Z: Worker pool stopped.
Dec 16, 2018 12:54:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-12-15_16_50_29-7301157709659120626 finished with status DONE.
Dec 16, 2018 12:54:11 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-12-15_16_50_29-7301157709659120626. Found 0 success, 0 failures out of 0 expected assertions.
Gradle Test Executor 119 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest
Finished generating test XML results (0.245 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerFnApiWorkerExecutableStageTest>
Generating HTML test report...
Finished generating test html results (0.352 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest>
Packing task ':beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest'
Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin
:beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest (Thread[Task worker for ':' Thread 99,5,main]) completed. Took 50 mins 58.468 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread 99,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages FAILED
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages': Caching has not been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216000022
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216000022
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:33c77c0c99fcb9d4ef8eb4f62674d6dc7bbaacc8198fa96c71899bf5dbf9401b
Starting process 'command 'gcloud''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images delete --force-delete-tags us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216000022
Successfully started process 'command 'gcloud''
ERROR: (gcloud.container.images.delete) [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216000022] is not a valid name.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread 99,5,main]) completed. Took 0.975 secs.
:beam-runners-google-cloud-dataflow-java:validatesRunnerPortabilityApiExecutableStage (Thread[Task worker for ':' Thread 99,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerPortabilityApiExecutableStage
Skipping task ':beam-runners-google-cloud-dataflow-java:validatesRunnerPortabilityApiExecutableStage' as it has no actions.
:beam-runners-google-cloud-dataflow-java:validatesRunnerPortabilityApiExecutableStage (Thread[Task worker for ':' Thread 99,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 457
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54m 3s
75 actionable tasks: 69 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/5jjmy3kz5rysw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/307/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/306/display/redirect>
------------------------------------------
[...truncated 8.08 MB...]
Dec 16, 2018 1:49:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/RunChecks as step s35
Dec 16, 2018 1:49:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/VerifyAssertions/ParDo(DefaultConclude) as step s36
Dec 16, 2018 1:49:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-1216134945-d0da1b04/output/results/staging/
Dec 16, 2018 1:49:53 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <77886 bytes, hash Ozjcig-xo_FaPWIdRBcusw> to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-1216134945-d0da1b04/output/results/staging/pipeline-Ozjcig-xo_FaPWIdRBcusw.pb
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Dataflow SDK version: 2.10.0-SNAPSHOT
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Dec 16, 2018 1:49:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-16_05_49_54-13950410511666273800?project=apache-beam-testing
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Submitted job: 2018-12-16_05_49_54-13950410511666273800
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Dec 16, 2018 1:49:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-12-16_05_49_54-13950410511666273800
Dec 16, 2018 1:49:55 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-12-16_05_49_54-13950410511666273800 with 0 expected assertions.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:49:54.326Z: Autoscaling is enabled for job 2018-12-16_05_49_54-13950410511666273800. The number of workers will be between 1 and 1000.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:49:54.385Z: Autoscaling was automatically enabled for job 2018-12-16_05_49_54-13950410511666273800.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-12-16T13:49:57.704Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: flattentest0testflattenpcollectionsemptythenpardo-jenkins--w8ot. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:49:58.306Z: Checking permissions granted to controller Service Account.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:03.522Z: Worker configuration: n1-standard-1 in us-central1-b.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:03.994Z: Expanding CollectionToSingleton operations into optimizable parts.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.079Z: Expanding CoGroupByKey operations into optimizable parts.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.338Z: Expanding GroupByKey operations into optimizable parts.
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.443Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.491Z: Elided trivial flatten
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.524Z: Elided trivial flatten
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.570Z: Elided trivial flatten
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.619Z: Unzipping flatten s29 for input s17.org.apache.beam.sdk.values.PCollection.<init>:402#a4f9f304fed667ee
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.655Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$13/GroupGlobally/FlattenDummyAndContents, into producer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.688Z: Fusing consumer PAssert$13/VerifyAssertions/ParDo(DefaultConclude) into PAssert$13/RunChecks
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.730Z: Unzipping flatten s29-u40 for input s31-reify-value18-c38
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.777Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Write, through flatten s29-u40, into producer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.835Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$13/GroupGlobally/GroupDummyAndContents/Read
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.880Z: Fusing consumer PAssert$13/GroupGlobally/Values/Values/Map into PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.920Z: Fusing consumer PAssert$13/GetPane/Map into PAssert$13/GroupGlobally/ParDo(Concat)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:04.963Z: Fusing consumer PAssert$13/RunChecks into PAssert$13/GetPane/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.009Z: Fusing consumer PAssert$13/GroupGlobally/ParDo(Concat) into PAssert$13/GroupGlobally/Values/Values/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.046Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify into PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.092Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Write into PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.139Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.185Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.213Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.259Z: Fusing consumer PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.294Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.502Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.549Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.588Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.631Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.679Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.721Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.767Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.809Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.846Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.892Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.940Z: Fusing consumer PAssert$13/GroupGlobally/Window.Into()/Window.Assign into ParDo(Identity)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:05.971Z: Fusing consumer PAssert$13/GroupGlobally/RewindowActuals/Window.Assign into PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.015Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.060Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.108Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.150Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.196Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.244Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.270Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$13/GroupGlobally/Window.Into()/Window.Assign
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.317Z: Fusing consumer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$13/GroupGlobally/RewindowActuals/Window.Assign
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.365Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.403Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.452Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.499Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:06.539Z: Fusing consumer ParDo(Identity) into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.003Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.042Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.086Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Create
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.099Z: Starting 1 workers in us-central1-b...
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.133Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.374Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 16, 2018 1:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:07.417Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse+Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 16, 2018 1:50:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:15.365Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Dec 16, 2018 1:50:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:44.568Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Dec 16, 2018 1:50:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:44.615Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Dec 16, 2018 1:50:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:50.803Z: Workers have started successfully.
Dec 16, 2018 1:50:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T13:50:50.841Z: Workers have started successfully.
Dec 16, 2018 2:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-12-16T14:50:07.492Z: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Dec 16, 2018 2:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T14:50:07.641Z: Cancel request is committed for workflow job: 2018-12-16_05_49_54-13950410511666273800.
Dec 16, 2018 2:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T14:50:07.743Z: Cleaning up.
Dec 16, 2018 2:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T14:50:07.848Z: Stopping worker pool...
Dec 16, 2018 2:50:08 PM org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler process
INFO: Dataflow job 2018-12-16_05_49_54-13950410511666273800 threw exception. Failure message was: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Dec 16, 2018 2:51:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T14:51:43.772Z: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
Dec 16, 2018 2:51:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T14:51:43.816Z: Worker pool stopped.
Dec 16, 2018 2:51:49 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-12-16_05_49_54-13950410511666273800 failed with status FAILED.
Dec 16, 2018 2:51:49 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-12-16_05_49_54-13950410511666273800. Found 0 success, 0 failures out of 0 expected assertions.
Gradle Test Executor 119 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest FAILED
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo FAILED
java.lang.RuntimeException: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo(FlattenTest.java:224)
72 tests completed, 2 failed, 1 skipped
Finished generating test XML results (0.168 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerFnApiWorkerExecutableStageTest>
Generating HTML test report...
Finished generating test html results (0.286 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest (Thread[Task worker for ':' Thread 117,5,main]) completed. Took 2 hrs 48 mins 42.306 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread 117,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages FAILED
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages': Caching has not been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216120022
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216120022
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c3b553ce1a019809528bf628ec329e778d16eb82953be7f0912179ee5c836d70
Starting process 'command 'gcloud''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images delete --force-delete-tags us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216120022
Successfully started process 'command 'gcloud''
ERROR: (gcloud.container.images.delete) [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216120022] is not a valid name.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread 117,5,main]) completed. Took 0.985 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 457
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 51m 39s
75 actionable tasks: 69 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/bs6moj2cgs4ze
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow #305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/305/display/redirect>
------------------------------------------
[...truncated 8.08 MB...]
Dec 16, 2018 7:49:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/RunChecks as step s35
Dec 16, 2018 7:49:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$13/VerifyAssertions/ParDo(DefaultConclude) as step s36
Dec 16, 2018 7:49:52 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-1216074943-18fb3c8a/output/results/staging/
Dec 16, 2018 7:49:52 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <77886 bytes, hash bmeHQUI2qCr_SQLzmWA52Q> to gs://temp-storage-for-end-to-end-tests/flattentest0testflattenpcollectionsemptythenpardo-jenkins-1216074943-18fb3c8a/output/results/staging/pipeline-bmeHQUI2qCr_SQLzmWA52Q.pb
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Dataflow SDK version: 2.10.0-SNAPSHOT
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Dec 16, 2018 7:49:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-15_23_49_53-17134043319040271707?project=apache-beam-testing
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_OUT
Submitted job: 2018-12-15_23_49_53-17134043319040271707
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo STANDARD_ERROR
Dec 16, 2018 7:49:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-12-15_23_49_53-17134043319040271707
Dec 16, 2018 7:49:54 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-12-15_23_49_53-17134043319040271707 with 0 expected assertions.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:49:53.190Z: Autoscaling is enabled for job 2018-12-15_23_49_53-17134043319040271707. The number of workers will be between 1 and 1000.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:49:53.235Z: Autoscaling was automatically enabled for job 2018-12-15_23_49_53-17134043319040271707.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-12-16T07:49:55.634Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: flattentest0testflattenpcollectionsemptythenpardo-jenkins--842a. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:49:55.958Z: Checking permissions granted to controller Service Account.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:49:59.674Z: Worker configuration: n1-standard-1 in us-central1-b.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.365Z: Expanding CollectionToSingleton operations into optimizable parts.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.445Z: Expanding CoGroupByKey operations into optimizable parts.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.650Z: Expanding GroupByKey operations into optimizable parts.
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.737Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.780Z: Elided trivial flatten
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.835Z: Elided trivial flatten
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.882Z: Elided trivial flatten
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.930Z: Unzipping flatten s29 for input s17.org.apache.beam.sdk.values.PCollection.<init>:402#a4f9f304fed667ee
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:00.977Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$13/GroupGlobally/FlattenDummyAndContents, into producer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.024Z: Fusing consumer PAssert$13/VerifyAssertions/ParDo(DefaultConclude) into PAssert$13/RunChecks
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.065Z: Unzipping flatten s29-u40 for input s31-reify-value18-c38
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.114Z: Fusing unzipped copy of PAssert$13/GroupGlobally/GroupDummyAndContents/Write, through flatten s29-u40, into producer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.157Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$13/GroupGlobally/GroupDummyAndContents/Read
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.204Z: Fusing consumer PAssert$13/GroupGlobally/Values/Values/Map into PAssert$13/GroupGlobally/GroupDummyAndContents/GroupByWindow
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.246Z: Fusing consumer PAssert$13/GetPane/Map into PAssert$13/GroupGlobally/ParDo(Concat)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.377Z: Fusing consumer PAssert$13/RunChecks into PAssert$13/GetPane/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.419Z: Fusing consumer PAssert$13/GroupGlobally/ParDo(Concat) into PAssert$13/GroupGlobally/Values/Values/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.466Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Reify into PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.507Z: Fusing consumer PAssert$13/GroupGlobally/GroupDummyAndContents/Write into PAssert$13/GroupGlobally/GroupDummyAndContents/Reify
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.757Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.806Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.850Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.899Z: Fusing consumer PAssert$13/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.950Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:01.999Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.038Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.089Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.134Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.181Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.229Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.272Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.324Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.369Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.417Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.465Z: Fusing consumer PAssert$13/GroupGlobally/Window.Into()/Window.Assign into ParDo(Identity)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.511Z: Fusing consumer PAssert$13/GroupGlobally/RewindowActuals/Window.Assign into PAssert$13/GroupGlobally/GatherAllOutputs/Values/Values/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.550Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.598Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource) into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.672Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.713Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.760Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.801Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.844Z: Fusing consumer PAssert$13/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$13/GroupGlobally/Window.Into()/Window.Assign
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.892Z: Fusing consumer PAssert$13/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$13/GroupGlobally/RewindowActuals/Window.Assign
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.934Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:02.982Z: Fusing consumer Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.028Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource) into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.070Z: Fusing consumer PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key into PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.113Z: Fusing consumer ParDo(Identity) into Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.585Z: Executing operation PAssert$13/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.632Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.668Z: Starting 1 workers in us-central1-b...
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.682Z: Executing operation PAssert$13/GroupGlobally/GroupDummyAndContents/Create
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.730Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.922Z: Executing operation PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Impulse+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+PAssert$13/GroupGlobally/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 16, 2018 7:50:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:03.987Z: Executing operation Flatten.PCollections/Create.Values/Read(CreateSource)/Impulse+Flatten.PCollections/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Flatten.PCollections/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 16, 2018 7:50:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:13.003Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Dec 16, 2018 7:50:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:40.332Z: Workers have started successfully.
Dec 16, 2018 7:50:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:41.017Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Dec 16, 2018 7:50:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:50:41.067Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Dec 16, 2018 7:51:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T07:51:11.388Z: Workers have started successfully.
Dec 16, 2018 8:50:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-12-16T08:50:04.067Z: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Dec 16, 2018 8:50:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T08:50:04.167Z: Cancel request is committed for workflow job: 2018-12-15_23_49_53-17134043319040271707.
Dec 16, 2018 8:50:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T08:50:04.380Z: Cleaning up.
Dec 16, 2018 8:50:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T08:50:04.509Z: Stopping worker pool...
Dec 16, 2018 8:50:04 AM org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler process
INFO: Dataflow job 2018-12-15_23_49_53-17134043319040271707 threw exception. Failure message was: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Dec 16, 2018 8:51:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T08:51:29.789Z: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
Dec 16, 2018 8:51:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-12-16T08:51:29.860Z: Worker pool stopped.
Dec 16, 2018 8:51:35 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-12-15_23_49_53-17134043319040271707 failed with status FAILED.
Dec 16, 2018 8:51:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-12-15_23_49_53-17134043319040271707. Found 0 success, 0 failures out of 0 expected assertions.
Gradle Test Executor 120 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest FAILED
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmptyThenParDo FAILED
java.lang.RuntimeException: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo(FlattenTest.java:224)
72 tests completed, 2 failed, 1 skipped
Finished generating test XML results (0.176 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerFnApiWorkerExecutableStageTest>
Generating HTML test report...
Finished generating test html results (0.238 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest (Thread[Task worker for ':' Thread 90,5,main]) completed. Took 2 hrs 48 mins 30.818 secs.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread 90,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:cleanUpDockerImages FAILED
Caching disabled for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages': Caching has not been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216060022
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216060022
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:eb0195272ba6a4c630a1b5a6efd850691860359fec964d64f8b49bb351bb70f6
Starting process 'command 'gcloud''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images delete --force-delete-tags us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216060022
Successfully started process 'command 'gcloud''
ERROR: (gcloud.container.images.delete) [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20181216060022] is not a valid name.
:beam-runners-google-cloud-dataflow-java:cleanUpDockerImages (Thread[Task worker for ':' Thread 90,5,main]) completed. Took 0.955 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerFnApiWorkerExecutableStageTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerFnApiWorkerExecutableStageTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_PortabilityApi_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 457
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 51m 25s
75 actionable tasks: 69 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/xfbjltuk4gn54
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org