You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/04/22 18:32:31 UTC
Build failed in Jenkins: beam_PerformanceTests_ManyFiles_TextIOIT
#460
See <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/460/display/redirect>
------------------------------------------
[...truncated 270.13 KB...]
INFO: 2019-04-22T18:13:16.040Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.105Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.160Z: Fusing consumer PAssert$0/GroupGlobally/RewindowActuals/Window.Assign into PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.218Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.266Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.338Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.389Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.443Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.492Z: Created new flatten s44-c101 to unzip producers of s45
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.543Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.579Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.623Z: Unzipping flatten s57-u99 for input s59-reify-value63-c97
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.672Z: Fusing unzipped copy of PAssert$0/GroupGlobally/GroupDummyAndContents/Write, through flatten PAssert$0/GroupGlobally/FlattenDummyAndContents/Unzipped-1, into producer PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.719Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.765Z: Unzipping flatten s44-c101 for input s39.org.apache.beam.sdk.values.PCollection.<init>:402#c574c40af2bc3c2d
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.812Z: Fusing unzipped copy of PAssert$0/GroupGlobally/Window.Into()/Window.Assign, through flatten Calculate hashcode/Flatten.PCollections, into producer Calculate hashcode/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.863Z: Unzipping flatten s44 for input s39.org.apache.beam.sdk.values.PCollection.<init>:402#c574c40af2bc3c2d
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.908Z: Fusing unzipped copy of View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map, through flatten Calculate hashcode/Flatten.PCollections, into producer Calculate hashcode/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:16.950Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.001Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.028Z: Fusing consumer PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.077Z: Fusing consumer PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$0/GroupGlobally/RewindowActuals/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.116Z: Fusing consumer PAssert$0/GroupGlobally/ParDo(Concat) into PAssert$0/GroupGlobally/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.180Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.222Z: Unzipping flatten s44-u125 for input s664-reify-value81-c123
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.264Z: Fusing unzipped copy of View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write, through flatten Calculate hashcode/Flatten.PCollections/Unzipped-1, into producer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.336Z: Fusing consumer PAssert$0/GetPane/Map into PAssert$0/GroupGlobally/ParDo(Concat)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.382Z: Fusing consumer PAssert$0/RunChecks into PAssert$0/GetPane/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.434Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$0/GroupGlobally/GroupDummyAndContents/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.481Z: Fusing consumer PAssert$0/GroupGlobally/Values/Values/Map into PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.532Z: Fusing consumer PAssert$0/GroupGlobally/Window.Into()/Window.Assign into Calculate hashcode/ProduceDefault
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.563Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Calculate hashcode/ProduceDefault
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.607Z: Fusing consumer Read all files/FileIO.MatchAll/Match filepatterns into Collect write end time
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.652Z: Fusing consumer Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate hashcode/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.697Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.740Z: Fusing consumer Read all files/FileIO.ReadMatches/ParDo(ToReadableFile) into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.783Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.823Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate hashcode/WithKeys/AddKeys/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.872Z: Fusing consumer Collect read end time into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Read ranges
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.914Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:17.964Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.014Z: Fusing consumer Calculate hashcode/WithKeys/AddKeys/Map into Collect read end time
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.061Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.117Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into Write content to files/WriteFiles/FinalizeTempFileBundles/Finalize
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.171Z: Fusing consumer Calculate hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.213Z: Fusing consumer Calculate hashcode/Values/Values/Map into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.290Z: Fusing consumer Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map into Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.357Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Read ranges into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.400Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.454Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Values/Values/Map into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.519Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.564Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.615Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.667Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Finalize into Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.718Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Pair with random key
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.774Z: Fusing consumer Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Pair with random key into Read all files/FileIO.MatchAll/Match filepatterns
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.826Z: Fusing consumer Values/Values/Map into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.879Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.932Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:18.979Z: Fusing consumer Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous) into Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.024Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.075Z: Fusing consumer Collect write end time into Values/Values/Map
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.138Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.186Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Pair with random key into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Split into ranges
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.228Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Split into ranges into Read all files/FileIO.ReadMatches/ParDo(ToReadableFile)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.272Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.321Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Values/Values/Map into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.368Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.415Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.471Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.520Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.564Z: Fusing consumer Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Pair with random key
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.615Z: Fusing consumer Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.651Z: Fusing consumer Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Write into Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.696Z: Fusing consumer Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify into Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.741Z: Fusing consumer Write content to files/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow) into Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.783Z: Fusing consumer Write content to files/WriteFiles/RewindowIntoGlobal/Window.Assign into Collect write start time
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.831Z: Fusing consumer Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow into Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Read
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.880Z: Fusing consumer Produce text lines into Generate sequence/Read(BoundedCountingSource)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.923Z: Fusing consumer Collect write start time into Produce text lines
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:19.970Z: Fusing consumer Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles into Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.027Z: Fusing consumer Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey into Write content to files/WriteFiles/RewindowIntoGlobal/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.075Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Reify into PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.119Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Write into PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.154Z: Fusing consumer PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Apr 22, 2019 6:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.773Z: Executing operation Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.837Z: Executing operation Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.864Z: Starting 1 workers in us-central1-a...
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.895Z: Executing operation Read all files/TextIO.ReadFiles/Read all via FileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.950Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:20.988Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:21.027Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:21.072Z: Executing operation Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:21.158Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:21.206Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:21.826Z: Executing operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Apr 22, 2019 6:13:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:21.904Z: Executing operation Generate sequence/Read(BoundedCountingSource)+Produce text lines+Collect write start time+Write content to files/WriteFiles/RewindowIntoGlobal/Window.Assign+Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/ApplyShardingKey+Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Reify+Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Write
Apr 22, 2019 6:13:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:58.260Z: Workers have started successfully.
Apr 22, 2019 6:14:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:13:59.182Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 22, 2019 6:14:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:14:29.609Z: Workers have started successfully.
Apr 22, 2019 6:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:14:34.680Z: Executing operation Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Close
Apr 22, 2019 6:14:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:14:34.880Z: Executing operation Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/Read+Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/GroupIntoShards/GroupByWindow+Write content to files/WriteFiles/WriteShardedBundlesToTempFiles/WriteShardsIntoTempFiles+Write content to files/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
Apr 22, 2019 6:17:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:17:59.001Z: Executing operation Write content to files/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView
Apr 22, 2019 6:18:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:17:59.283Z: Executing operation Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+Write content to files/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+Write content to files/WriteFiles/FinalizeTempFileBundles/Finalize+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 22, 2019 6:22:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:22:11.480Z: Executing operation Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 22, 2019 6:22:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-22T18:22:11.631Z: Executing operation Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write content to files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Values/Values/Map+Collect write end time+Read all files/FileIO.MatchAll/Match filepatterns+Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Pair with random key+Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Read all files/FileIO.MatchAll/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
STDERR:
2019-04-22 18:32:28,724 a744d90d MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-04-22 18:32:28,725 a744d90d MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-04-22 18:32:28,727 a744d90d MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 903, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-04-22 18:32:28,727 a744d90d MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-04-22 18:32:28,727 a744d90d MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-04-22 18:32:28,728 a744d90d MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/runs/a744d90d/pkb.log>
2019-04-22 18:32:28,728 a744d90d MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/ws/runs/a744d90d/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_ManyFiles_TextIOIT #461
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ManyFiles_TextIOIT/461/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org