You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/07/15 18:41:04 UTC
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT #3658
See <https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT/3658/display/redirect?page=changes>
Changes:
[noreply] [BEAM-10486] Update OffsetRestrictionTracker to honor failed claim
[noreply] [BEAM-7390] Add cogroupbykey code snippets (#12217)
[noreply] Gate GH actions so it only runs in main/upstream repo (#12222)
------------------------------------------
[...truncated 298.23 KB...]
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:24.991Z: Fusing consumer Match all files/Match filepatterns into Values/Values/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.025Z: Fusing consumer Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate hashcode/Values/Values/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.061Z: Fusing consumer Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous) into Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.095Z: Fusing consumer Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map into Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.130Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Finalize into Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.166Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into Write Avro records to files/Write/FinalizeTempFileBundles/Finalize
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.196Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.224Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.248Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.277Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.301Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.338Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.361Z: Fusing consumer Collect middle time into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.390Z: Fusing consumer Values/Values/Map into Collect middle time
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.415Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Pair with random key into Match all files/Match filepatterns
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.449Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Match all files/Reshuffle.ViaRandomKey/Pair with random key
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.484Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.518Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.544Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.573Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.613Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Values/Values/Map into Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.656Z: Fusing consumer Read matches/ParDo(ToReadableFile) into Match all files/Reshuffle.ViaRandomKey/Values/Values/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.687Z: Fusing consumer Read files/Read all via FileBasedSource/Split into ranges into Read matches/ParDo(ToReadableFile)
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.727Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Pair with random key into Read files/Read all via FileBasedSource/Split into ranges
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.763Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read files/Read all via FileBasedSource/Reshuffle/Pair with random key
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.802Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.833Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.857Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.885Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.919Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Values/Values/Map into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.952Z: Fusing consumer Read files/Read all via FileBasedSource/Read ranges into Read files/Read all via FileBasedSource/Reshuffle/Values/Values/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:25.983Z: Fusing consumer Collect end time into Read files/Read all via FileBasedSource/Read ranges
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.015Z: Fusing consumer Parse Avro records to Strings into Collect end time
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.049Z: Fusing consumer Calculate hashcode/WithKeys/AddKeys/Map into Parse Avro records to Strings
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.089Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate hashcode/WithKeys/AddKeys/Map
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.125Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.165Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.191Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.227Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.259Z: Fusing consumer Calculate hashcode/Values/Values/Map into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.282Z: Fusing consumer Calculate hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.304Z: Fusing consumer PAssert$0/GroupGlobally/WithKeys/AddKeys/Map into PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Jul 15, 2020 6:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.345Z: Fusing consumer PAssert$0/GroupGlobally/GroupByKey/Reify into PAssert$0/GroupGlobally/WithKeys/AddKeys/Map
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.748Z: Executing operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.828Z: Starting 5 ****s in us-central1-f...
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.828Z: Executing operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.866Z: Executing operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.886Z: Finished operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.899Z: Finished operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.902Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.935Z: Executing operation PAssert$0/GroupGlobally/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.970Z: Finished operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:26.996Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.004Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.030Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.041Z: Finished operation PAssert$0/GroupGlobally/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.061Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.074Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.160Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.178Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.605Z: Executing operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GroupByKey/Reify+PAssert$0/GroupGlobally/GroupByKey/Write
Jul 15, 2020 6:35:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:27.646Z: Executing operation Generate sequence/Read(BoundedCountingSource)+Produce text lines+Produce Avro records+Collect start time+Write Avro records to files/Write/RewindowIntoGlobal/Window.Assign+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Jul 15, 2020 6:35:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2020-07-15T18:35:31.383Z: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jul 15, 2020 6:35:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:35:53.074Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s).
Jul 15, 2020 6:36:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:36:11.511Z: Workers have started successfully.
Jul 15, 2020 6:36:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:36:11.535Z: Workers have started successfully.
Jul 15, 2020 6:36:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:36:32.508Z: Finished operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GroupByKey/Reify+PAssert$0/GroupGlobally/GroupByKey/Write
Jul 15, 2020 6:39:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:10.537Z: Finished operation Generate sequence/Read(BoundedCountingSource)+Produce text lines+Produce Avro records+Collect start time+Write Avro records to files/Write/RewindowIntoGlobal/Window.Assign+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Jul 15, 2020 6:39:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:10.645Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Jul 15, 2020 6:39:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:10.709Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Jul 15, 2020 6:39:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:10.783Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/DropShardNum+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
Jul 15, 2020 6:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:12.182Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/DropShardNum+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
Jul 15, 2020 6:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:12.333Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1
Jul 15, 2020 6:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:12.460Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1
Jul 15, 2020 6:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:12.618Z: Executing operation Write Avro records to files/Write/GatherTempFileResults/View.AsList/CreateDataflowView
Jul 15, 2020 6:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:12.681Z: Finished operation Write Avro records to files/Write/GatherTempFileResults/View.AsList/CreateDataflowView
Jul 15, 2020 6:39:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:12.831Z: Executing operation Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+Write Avro records to files/Write/FinalizeTempFileBundles/Finalize+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jul 15, 2020 6:39:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:14.940Z: Finished operation Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+Write Avro records to files/Write/FinalizeTempFileBundles/Finalize+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jul 15, 2020 6:39:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:14.999Z: Executing operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jul 15, 2020 6:39:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:15.059Z: Finished operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jul 15, 2020 6:39:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:15.137Z: Executing operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Collect middle time+Values/Values/Map+Match all files/Match filepatterns+Match all files/Reshuffle.ViaRandomKey/Pair with random key+Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jul 15, 2020 6:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:17.568Z: Finished operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Collect middle time+Values/Values/Map+Match all files/Match filepatterns+Match all files/Reshuffle.ViaRandomKey/Pair with random key+Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jul 15, 2020 6:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:17.655Z: Executing operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jul 15, 2020 6:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:17.708Z: Finished operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jul 15, 2020 6:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:17.779Z: Executing operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Match all files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matches/ParDo(ToReadableFile)+Read files/Read all via FileBasedSource/Split into ranges+Read files/Read all via FileBasedSource/Reshuffle/Pair with random key+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
Jul 15, 2020 6:39:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:18.612Z: Finished operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Match all files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matches/ParDo(ToReadableFile)+Read files/Read all via FileBasedSource/Split into ranges+Read files/Read all via FileBasedSource/Reshuffle/Pair with random key+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
Jul 15, 2020 6:39:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:18.677Z: Executing operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
Jul 15, 2020 6:39:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:18.736Z: Finished operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
Jul 15, 2020 6:39:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-07-15T18:39:18.796Z: Executing operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable+Read files/Read all via FileBasedSource/Reshuffle/Values/Values/Map+Read files/Read all via FileBasedSource/Read ranges+Collect end time+Parse Avro records to Strings+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Jul 15, 2020 6:41:03 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2020-07-15_11_35_06-3277177646110944612
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll SKIPPED
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 6 mins 6.624 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 10' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at https://docs.gradle.org/5.2.1/userguide/java_testing.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 45s
91 actionable tasks: 58 executed, 33 from cache
Publishing build scan...
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=74d84b08-5377-4c40-90dd-0aa250e9b5af, currentDir=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 13399
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-13399.out.log
----- Last 20 lines from daemon log file - daemon-13399.out.log -----
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 10' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at https://docs.gradle.org/5.2.1/userguide/java_testing.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 45s
91 actionable tasks: 58 executed, 33 from cache
Publishing build scan...
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_AvroIOIT
#3659
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT/3659/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org