You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/06/17 19:25:11 UTC
Build failed in Jenkins: beam_PerformanceTests_TFRecordIOIT #2082
See <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/2082/display/redirect?page=changes>
Changes:
[github] Use code.jquery.com for jQuery CDN
[github] use https
[alireza4263] [BEAM-7513] Implements row estimation for BigQuery.
[aaltay] [BEAM-6777] Let HealthzServlet respond actual health information of SDK
------------------------------------------
[...truncated 437.35 KB...]
Dataflow SDK version: 2.14.0-SNAPSHOT
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_ERROR
Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-06-17_12_20_39-16640468506312754190?project=apache-beam-testing
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_OUT
Submitted job: 2019-06-17_12_20_39-16640468506312754190
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_ERROR
Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2019-06-17_12_20_39-16640468506312754190
Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2019-06-17_12_20_39-16640468506312754190 with 1 expected assertions.
Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:39.947Z: Autoscaling is enabled for job 2019-06-17_12_20_39-16640468506312754190. The number of workers will be between 1 and 1000.
Jun 17, 2019 7:20:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:39.989Z: Autoscaling was automatically enabled for job 2019-06-17_12_20_39-16640468506312754190.
Jun 17, 2019 7:20:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:43.211Z: Checking permissions granted to controller Service Account.
Jun 17, 2019 7:20:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:50.060Z: Worker configuration: n1-standard-1 in us-central1-f.
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:50.674Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:50.864Z: Expanding GroupByKey operations into optimizable parts.
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:50.909Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.257Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.291Z: Elided trivial flatten
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.330Z: Elided trivial flatten
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.380Z: Elided trivial flatten
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.428Z: Fusing consumer PAssert$0/GroupGlobally/Window.Into()/Window.Assign into Reshuffle.ViaRandomKey/Values/Values/Map
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.469Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Reshuffle.ViaRandomKey/Values/Values/Map
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.519Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Write into PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.566Z: Fusing consumer PAssert$0/GroupGlobally/ParDo(Concat) into PAssert$0/GroupGlobally/Values/Values/Map
Jun 17, 2019 7:20:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.605Z: Fusing consumer PAssert$0/GetPane/Map into PAssert$0/GroupGlobally/ParDo(Concat)
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.653Z: Fusing consumer PAssert$0/RunChecks into PAssert$0/GetPane/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.695Z: Fusing consumer PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.733Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$0/GroupGlobally/GroupDummyAndContents/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.778Z: Fusing consumer PAssert$0/GroupGlobally/Values/Values/Map into PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.821Z: Unzipping flatten s30 for input s25.org.apache.beam.sdk.values.PCollection.<init>:402#710158705210b615
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.846Z: Fusing unzipped copy of PAssert$0/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$0/GroupGlobally/FlattenDummyAndContents, into producer PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.894Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Reshuffle.ViaRandomKey/Pair with random key
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.932Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:51.976Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.023Z: Fusing consumer PAssert$0/GroupGlobally/RewindowActuals/Window.Assign into PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.070Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.104Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.148Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$0/GroupGlobally/Window.Into()/Window.Assign
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.196Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.236Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.286Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.332Z: Fusing consumer Reshuffle.ViaRandomKey/Values/Values/Map into Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.379Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.427Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.509Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.562Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.611Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.655Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.699Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.754Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.799Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.847Z: Unzipping flatten s12 for input s11.org.apache.beam.sdk.values.PCollection.<init>:402#dabfabce15317cd8
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.910Z: Fusing unzipped copy of Reshuffle.ViaRandomKey/Pair with random key, through flatten Calculate hashcode/Flatten.PCollections, into producer Calculate hashcode/ProduceDefault
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:52.966Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.016Z: Unzipping flatten s12-u80 for input s15-reify-value18-c78
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.057Z: Fusing unzipped copy of Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write, through flatten Calculate hashcode/Flatten.PCollections/Unzipped-1, into producer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.106Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.144Z: Fusing consumer PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$0/GroupGlobally/RewindowActuals/Window.Assign
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.192Z: Fusing consumer Reshuffle.ViaRandomKey/Pair with random key into Calculate hashcode/Values/Values/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.239Z: Fusing consumer Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate hashcode/Values/Values/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.290Z: Fusing consumer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.337Z: Fusing consumer Calculate hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.385Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate hashcode/WithKeys/AddKeys/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.439Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.480Z: Fusing consumer Transform bytes to strings/Map into Record time after reading
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.521Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.567Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.618Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.656Z: Fusing consumer Record time after reading into TFRecordIO.Read/Read
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.690Z: Fusing consumer Calculate hashcode/Values/Values/Map into Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.731Z: Fusing consumer Calculate hashcode/WithKeys/AddKeys/Map into Transform bytes to strings/Map
Jun 17, 2019 7:20:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.779Z: Fusing consumer Delete test files into Create.Values/Read(CreateSource)
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.821Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Reify into PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:53.861Z: Fusing consumer PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.370Z: Executing operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.421Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.460Z: Starting 1 workers in us-central1-f...
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.470Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.517Z: Finished operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.520Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.540Z: Finished operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.541Z: Finished operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.574Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.594Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.694Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.712Z: Finished operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:54.782Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:55.104Z: Executing operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Jun 17, 2019 7:20:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:20:55.154Z: Executing operation TFRecordIO.Read/Read+Record time after reading+Transform bytes to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Jun 17, 2019 7:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:20.435Z: Workers have started successfully.
Jun 17, 2019 7:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:20.904Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 17, 2019 7:24:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:50.272Z: Finished operation TFRecordIO.Read/Read+Record time after reading+Transform bytes to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Jun 17, 2019 7:24:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:50.377Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Close
Jun 17, 2019 7:24:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:50.431Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Close
Jun 17, 2019 7:24:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:50.535Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate hashcode/Values/Values/Map+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jun 17, 2019 7:24:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:51.572Z: Workers have started successfully.
Jun 17, 2019 7:24:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:24:52.541Z: Finished operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:00.509Z: Finished operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate hashcode/Values/Values/Map+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:00.711Z: Executing operation Calculate hashcode/View.AsIterable/CreateDataflowView
Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:00.783Z: Finished operation Calculate hashcode/View.AsIterable/CreateDataflowView
Jun 17, 2019 7:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:00.976Z: Executing operation Calculate hashcode/CreateVoid/Read(CreateSource)+Calculate hashcode/ProduceDefault+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:02.596Z: Finished operation Calculate hashcode/CreateVoid/Read(CreateSource)+Calculate hashcode/ProduceDefault+Reshuffle.ViaRandomKey/Pair with random key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:02.707Z: Executing operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:02.744Z: Finished operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Jun 17, 2019 7:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-06-17T19:25:02.836Z: Executing operation Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$0/GroupGlobally/Window.Into()/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
STDERR: Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
2019-06-17 19:25:07,443 6950ae0a MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-17 19:25:07,446 6950ae0a MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-06-17 19:25:07,451 6950ae0a MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 903, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 760, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 609, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-06-17 19:25:07,451 6950ae0a MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-06-17 19:25:07,452 6950ae0a MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-06-17 19:25:07,453 6950ae0a MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/runs/6950ae0a/pkb.log>
2019-06-17 19:25:07,453 6950ae0a MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/runs/6950ae0a/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_TFRecordIOIT #2083
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/2083/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org