You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/11/20 01:52:49 UTC
Build failed in Jenkins:
beam_BiqQueryIO_Batch_Performance_Test_Java #192
See <https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/192/display/redirect?page=changes>
Changes:
[markliu] Add Java mobile game on DirectRunner to release script
[suztomo] empty commit
[suztomo] Revert empty line
[suztomo] Fixed typo
[suztomo] Correct value is 'Triage Needed'
[suztomo] Reverting unnecessary changes
[robertwb] More compartmentalization of bundle-based-runner only utilities.
[robertwb] [BEAM-8335] Adds the StreamingCache (#10119)
[github] [BEAM-8151] Further cleanup of SDK Workers. (#10134)
------------------------------------------
[...truncated 253.28 KB...]
INFO: Adding DropInputs as step s59
Nov 20, 2019 1:51:56 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-perf-tests/loadtests/staging/
Nov 20, 2019 1:51:56 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <179760 bytes, hash wxJ9IJP5nSQkX3uCk_Ax0A> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-wxJ9IJP5nSQkX3uCk_Ax0A.pb
Nov 20, 2019 1:51:56 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.18.0-SNAPSHOT
Nov 20, 2019 1:51:56 AM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$DefaultGcpRegionFactory create
WARNING: Region will default to us-central1. Future releases of Beam will require the user to set the region explicitly. https://cloud.google.com/compute/docs/regions-zones/regions-zones
Nov 20, 2019 1:51:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-11-19_17_51_57-492776052188222111?project=apache-beam-testing
Nov 20, 2019 1:51:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2019-11-19_17_51_57-492776052188222111
Nov 20, 2019 1:51:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2019-11-19_17_51_57-492776052188222111
Nov 20, 2019 1:51:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2019-11-20T01:51:57.092Z: The requested max number of workers (5) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Nov 20, 2019 1:52:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:01.586Z: Checking permissions granted to controller Service Account.
Nov 20, 2019 1:52:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:09.990Z: Worker configuration: n1-standard-1 in us-central1-f.
Nov 20, 2019 1:52:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:10.606Z: Expanding CoGroupByKey operations into optimizable parts.
Nov 20, 2019 1:52:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:10.853Z: Expanding GroupByKey operations into optimizable parts.
Nov 20, 2019 1:52:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:10.871Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.111Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.132Z: Unzipping flatten s29 for input s26.writtenFiles
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.153Z: Fusing unzipped copy of Write to BQ/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow), through flatten Write to BQ/BatchLoads/FlattenFiles, into producer Write to BQ/BatchLoads/WriteBundlesToFiles
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.171Z: Fusing consumer Write to BQ/BatchLoads/ReifyResults/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Write to BQ/BatchLoads/WriteGroupedRecords
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.197Z: Fusing consumer Gather time into Read from source
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.220Z: Fusing consumer Map records into Gather time
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.246Z: Fusing consumer Write to BQ/PrepareWrite/ParDo(Anonymous) into Map records
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.273Z: Fusing consumer Write to BQ/BatchLoads/rewindowIntoGlobal/Window.Assign into Write to BQ/PrepareWrite/ParDo(Anonymous)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.298Z: Fusing consumer Write to BQ/BatchLoads/WriteBundlesToFiles into Write to BQ/BatchLoads/rewindowIntoGlobal/Window.Assign
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.324Z: Fusing consumer Write to BQ/BatchLoads/GroupByDestination/Reify into Write to BQ/BatchLoads/WriteBundlesToFiles
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.348Z: Fusing consumer Write to BQ/BatchLoads/GroupByDestination/Write into Write to BQ/BatchLoads/GroupByDestination/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.371Z: Fusing consumer Write to BQ/BatchLoads/GroupByDestination/GroupByWindow into Write to BQ/BatchLoads/GroupByDestination/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.396Z: Fusing consumer Write to BQ/BatchLoads/WriteGroupedRecords into Write to BQ/BatchLoads/GroupByDestination/GroupByWindow
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.419Z: Fusing consumer Write to BQ/BatchLoads/CreateJobId into Write to BQ/BatchLoads/JobIdCreationRoot/Read(CreateSource)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.442Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Write to BQ/BatchLoads/CreateJobId
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.469Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.495Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.516Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.541Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.563Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.589Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.614Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.640Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.663Z: Fusing consumer Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.689Z: Fusing consumer Write to BQ/BatchLoads/GetTempFilePrefix into Write to BQ/BatchLoads/Create.Values/Read(CreateSource)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.712Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Write to BQ/BatchLoads/GetTempFilePrefix
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.735Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.760Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.786Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.812Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.834Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.860Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.887Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.913Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.936Z: Fusing consumer Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.959Z: Fusing consumer Write to BQ/BatchLoads/ReifyResults/ParDo(Anonymous) into Write to BQ/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:11.984Z: Fusing consumer Write to BQ/BatchLoads/WritePartitionUntriggered into Write to BQ/BatchLoads/ReifyResults/ParDo(Anonymous)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.009Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign into Write to BQ/BatchLoads/WritePartitionUntriggered
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.034Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign into Write to BQ/BatchLoads/WritePartitionUntriggered
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.055Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify into Write to BQ/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.080Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write into Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.106Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow into Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.128Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsReshuffle/ExpandIterable into Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.154Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables) into Write to BQ/BatchLoads/MultiPartitionsReshuffle/ExpandIterable
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.176Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map into Write to BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.203Z: Fusing consumer Write to BQ/BatchLoads/ReifyRenameInput/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Write to BQ/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.228Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign into Write to BQ/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.251Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify into Write to BQ/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.276Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write into Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.301Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow into Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.323Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map into Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.350Z: Fusing consumer Write to BQ/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles) into Write to BQ/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.374Z: Fusing consumer Write to BQ/BatchLoads/ReifyRenameInput/ParDo(Anonymous) into Write to BQ/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.397Z: Fusing consumer Write to BQ/BatchLoads/WriteRenameUntriggered into Write to BQ/BatchLoads/ReifyRenameInput/ParDo(Anonymous)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.421Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify into Write to BQ/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.443Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write into Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.468Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow into Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.494Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionsReshuffle/ExpandIterable into Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.516Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables) into Write to BQ/BatchLoads/SinglePartitionsReshuffle/ExpandIterable
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.539Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map into Write to BQ/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.566Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign into Write to BQ/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.588Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify into Write to BQ/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.613Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write into Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.637Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow into Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.661Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/Values/Values/Map into Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.687Z: Fusing consumer Write to BQ/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles) into Write to BQ/BatchLoads/SinglePartitionWriteTables/Values/Values/Map
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:12.713Z: Fusing consumer DropInputs into Write to BQ/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.103Z: Executing operation Write to BQ/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)+DropInputs
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.162Z: Executing operation Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Nov 20, 2019 1:52:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.166Z: Starting 5 workers in us-central1-f...
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.188Z: Executing operation Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.219Z: Executing operation Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.220Z: Finished operation Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.220Z: Finished operation Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.249Z: Executing operation Write to BQ/BatchLoads/GroupByDestination/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.264Z: Finished operation Write to BQ/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.278Z: Executing operation Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.290Z: Finished operation Write to BQ/BatchLoads/GroupByDestination/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.309Z: Executing operation Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.320Z: Finished operation Write to BQ/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.334Z: Executing operation Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.350Z: Finished operation Write to BQ/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.363Z: Executing operation Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.380Z: Finished operation Write to BQ/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.389Z: Executing operation Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.413Z: Finished operation Write to BQ/BatchLoads/SinglePartitionWriteTables/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.449Z: Finished operation Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 20, 2019 1:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:13.788Z: Executing operation Write to BQ/BatchLoads/JobIdCreationRoot/Read(CreateSource)+Write to BQ/BatchLoads/CreateJobId+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+Write to BQ/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 20, 2019 1:52:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2019-11-20T01:52:32.117Z: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Nov 20, 2019 1:52:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-11-20T01:52:45.594Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=52e6bee5-b6e2-469c-8538-e43d754e2b28, currentDir=<https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 14947
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-14947.out.log
----- Last 20 lines from daemon log file - daemon-14947.out.log -----
at org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)
at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)
at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)
at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)
at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)
at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)
at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)
at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)
at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)
... 7 more
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_BiqQueryIO_Batch_Performance_Test_Java #193
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java/193/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org