You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/05/31 12:41:33 UTC
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT #3478
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/3478/display/redirect>
Changes:
------------------------------------------
[...truncated 303.39 KB...]
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.349Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into Write Avro records to files/Write/FinalizeTempFileBundles/Finalize
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.394Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.432Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.462Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.501Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.543Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.581Z: Fusing consumer Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.617Z: Fusing consumer Collect middle time into Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.653Z: Fusing consumer Values/Values/Map into Collect middle time
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.687Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Pair with random key into Match all files/Match filepatterns
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.725Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Match all files/Reshuffle.ViaRandomKey/Pair with random key
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.766Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.799Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.829Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.863Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.897Z: Fusing consumer Match all files/Reshuffle.ViaRandomKey/Values/Values/Map into Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.920Z: Fusing consumer Read matches/ParDo(ToReadableFile) into Match all files/Reshuffle.ViaRandomKey/Values/Values/Map
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.944Z: Fusing consumer Read files/Read all via FileBasedSource/Split into ranges into Read matches/ParDo(ToReadableFile)
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:39.979Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Pair with random key into Read files/Read all via FileBasedSource/Split into ranges
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.012Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read files/Read all via FileBasedSource/Reshuffle/Pair with random key
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.051Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.088Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.123Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.157Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.192Z: Fusing consumer Read files/Read all via FileBasedSource/Reshuffle/Values/Values/Map into Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.232Z: Fusing consumer Read files/Read all via FileBasedSource/Read ranges into Read files/Read all via FileBasedSource/Reshuffle/Values/Values/Map
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.268Z: Fusing consumer Collect end time into Read files/Read all via FileBasedSource/Read ranges
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.302Z: Fusing consumer Parse Avro records to Strings into Collect end time
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.333Z: Fusing consumer Calculate hashcode/WithKeys/AddKeys/Map into Parse Avro records to Strings
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.375Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate hashcode/WithKeys/AddKeys/Map
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.411Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.455Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.492Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.526Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.567Z: Fusing consumer Calculate hashcode/Values/Values/Map into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.604Z: Fusing consumer Calculate hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.640Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Reify into PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.678Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Write into PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2020 12:35:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:40.716Z: Fusing consumer PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.297Z: Executing operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.347Z: Executing operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.394Z: Starting 5 ****s in us-central1-a...
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.394Z: Executing operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.450Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.472Z: Finished operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.491Z: Finished operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.491Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.491Z: Finished operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.530Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.540Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.578Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.579Z: Finished operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.610Z: Finished operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.617Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.665Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.673Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.699Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:41.743Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:42.094Z: Executing operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
May 31, 2020 12:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:35:42.145Z: Executing operation Generate sequence/Read(BoundedCountingSource)+Produce text lines+Produce Avro records+Collect start time+Write Avro records to files/Write/RewindowIntoGlobal/Window.Assign+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
May 31, 2020 12:35:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2020-05-31T12:35:57.713Z: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
May 31, 2020 12:36:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:36:06.760Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s).
May 31, 2020 12:36:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:36:06.795Z: Resized **** pool to 3, though goal was 5. This could be a quota issue.
May 31, 2020 12:36:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:36:12.196Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s).
May 31, 2020 12:36:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:36:35.925Z: Workers have started successfully.
May 31, 2020 12:36:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:36:35.961Z: Workers have started successfully.
May 31, 2020 12:36:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:36:49.750Z: Finished operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
May 31, 2020 12:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:17.359Z: Finished operation Generate sequence/Read(BoundedCountingSource)+Produce text lines+Produce Avro records+Collect start time+Write Avro records to files/Write/RewindowIntoGlobal/Window.Assign+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
May 31, 2020 12:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:17.504Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
May 31, 2020 12:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:17.605Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
May 31, 2020 12:39:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:17.745Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/DropShardNum+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
May 31, 2020 12:39:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:18.847Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/DropShardNum+Write Avro records to files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
May 31, 2020 12:39:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:19.000Z: Executing operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1
May 31, 2020 12:39:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:19.130Z: Finished operation Write Avro records to files/Write/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1
May 31, 2020 12:39:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:19.293Z: Executing operation Write Avro records to files/Write/GatherTempFileResults/View.AsList/CreateDataflowView
May 31, 2020 12:39:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:19.347Z: Finished operation Write Avro records to files/Write/GatherTempFileResults/View.AsList/CreateDataflowView
May 31, 2020 12:39:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:19.504Z: Executing operation Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+Write Avro records to files/Write/FinalizeTempFileBundles/Finalize+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 31, 2020 12:39:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:22.832Z: Finished operation Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+Write Avro records to files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+Write Avro records to files/Write/FinalizeTempFileBundles/Finalize+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 31, 2020 12:39:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:22.921Z: Executing operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 31, 2020 12:39:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:22.990Z: Finished operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 31, 2020 12:39:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:23.077Z: Executing operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Collect middle time+Values/Values/Map+Match all files/Match filepatterns+Match all files/Reshuffle.ViaRandomKey/Pair with random key+Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 31, 2020 12:39:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:25.400Z: Finished operation Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write Avro records to files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Collect middle time+Values/Values/Map+Match all files/Match filepatterns+Match all files/Reshuffle.ViaRandomKey/Pair with random key+Match all files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
May 31, 2020 12:39:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:25.545Z: Executing operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 31, 2020 12:39:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:25.642Z: Finished operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
May 31, 2020 12:39:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:25.755Z: Executing operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Match all files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matches/ParDo(ToReadableFile)+Read files/Read all via FileBasedSource/Split into ranges+Read files/Read all via FileBasedSource/Reshuffle/Pair with random key+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
May 31, 2020 12:39:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:27.446Z: Finished operation Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Match all files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Match all files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matches/ParDo(ToReadableFile)+Read files/Read all via FileBasedSource/Split into ranges+Read files/Read all via FileBasedSource/Reshuffle/Pair with random key+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
May 31, 2020 12:39:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:27.544Z: Executing operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
May 31, 2020 12:39:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:27.627Z: Finished operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
May 31, 2020 12:39:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-05-31T12:39:27.749Z: Executing operation Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+Read files/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable+Read files/Read all via FileBasedSource/Reshuffle/Values/Values/Map+Read files/Read all via FileBasedSource/Read ranges+Collect end time+Parse Avro records to Strings+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write
May 31, 2020 12:41:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob lambda$waitUntilFinish$0
WARNING: Job is already running in Google Cloud Platform, Ctrl-C will not cancel it.
To cancel the job in the cloud, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2020-05-31_05_35_20-17274243816645739970
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll SKIPPED
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 6 mins 24.81 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 1' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at https://docs.gradle.org/5.2.1/userguide/java_testing.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 12s
91 actionable tasks: 58 executed, 33 from cache
Publishing build scan...
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=1a881c1c-ae33-49f7-909d-33d14f7f7b74, currentDir=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 16132
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-16132.out.log
----- Last 20 lines from daemon log file - daemon-16132.out.log -----
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 1' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at https://docs.gradle.org/5.2.1/userguide/java_testing.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 12s
91 actionable tasks: 58 executed, 33 from cache
Publishing build scan...
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_AvroIOIT
#3479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/3479/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org