You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/10/27 03:15:29 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #838
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/838/display/redirect?page=changes>
Changes:
[amaliujia] Test NULL in Pubsub JSON format for SQL read.
------------------------------------------
[...truncated 656.49 KB...]
INFO: 2018-10-27T03:13:40.697Z: Cleaning up.
Oct 27, 2018 3:13:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:40.795Z: Stopping worker pool...
Oct 27, 2018 3:13:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:47.428Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 3:13:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:47.525Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 27, 2018 3:13:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:52.098Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Close
Oct 27, 2018 3:13:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:52.221Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Read+Query9/Query9/CoGroupByKey/GBK/GroupByWindow+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull
Oct 27, 2018 3:13:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:57.873Z: Executing operation Query8/CoGroupByKey/GBK/Close
Oct 27, 2018 3:13:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:55.936Z: Executing operation Query6/Query6.WinningBids/CoGroupByKey/GBK/Close
Oct 27, 2018 3:13:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:56.042Z: Executing operation Query6/Query6.WinningBids/CoGroupByKey/GBK/Read+Query6/Query6.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query6/Query6.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query6/Query6.WinningBids/Query6.WinningBids.Join+Query6/Query6.Rekey+Query6/Window.Into()/Window.Assign+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Partial+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Reify+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Write
Oct 27, 2018 3:14:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:59.472Z: Executing operation Query3/CoGroupByKey/GBK/Close
Oct 27, 2018 3:14:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:59.558Z: Executing operation Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 27, 2018 3:14:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:58.095Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 3:14:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:58.194Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull
Oct 27, 2018 3:14:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:13:57.978Z: Executing operation Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull
Oct 27, 2018 3:14:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:00.473Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 3:14:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:00.572Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 3:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:01.865Z: Cleaning up.
Oct 27, 2018 3:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:01.946Z: Stopping worker pool...
Oct 27, 2018 3:14:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:04.434Z: Cleaning up.
Oct 27, 2018 3:14:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:04.546Z: Stopping worker pool...
Oct 27, 2018 3:14:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:06.338Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 27, 2018 3:14:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:06.458Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 27, 2018 3:14:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:06.538Z: Cleaning up.
Oct 27, 2018 3:14:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:06.642Z: Stopping worker pool...
Oct 27, 2018 3:14:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:09.342Z: Cleaning up.
Oct 27, 2018 3:14:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:09.451Z: Stopping worker pool...
Oct 27, 2018 3:14:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:11.354Z: Cleaning up.
Oct 27, 2018 3:14:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:11.488Z: Stopping worker pool...
Oct 27, 2018 3:14:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:12.681Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 3:14:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:12.788Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 27, 2018 3:14:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:12.731Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Close
Oct 27, 2018 3:14:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:12.832Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Read+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Extract+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull
Oct 27, 2018 3:14:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:14.593Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 27, 2018 3:14:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:14.686Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 27, 2018 3:14:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:15.853Z: Cleaning up.
Oct 27, 2018 3:14:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:15.959Z: Stopping worker pool...
Oct 27, 2018 3:14:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:16.181Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 27, 2018 3:14:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:16.277Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 27, 2018 3:14:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:18.507Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 3:14:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:18.601Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 27, 2018 3:14:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:20.318Z: Executing operation Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 27, 2018 3:14:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:20.532Z: Executing operation Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 27, 2018 3:14:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:25.032Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 27, 2018 3:14:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:25.142Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 27, 2018 3:14:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:26.954Z: Cleaning up.
Oct 27, 2018 3:14:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:27.075Z: Stopping worker pool...
Oct 27, 2018 3:14:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:34.688Z: Executing operation Query10/Query10.GroupByKey/Close
Oct 27, 2018 3:14:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:34.810Z: Executing operation Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 27, 2018 3:14:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:48.027Z: Cleaning up.
Oct 27, 2018 3:14:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:14:48.157Z: Stopping worker pool...
Oct 27, 2018 3:15:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:15:04.089Z: Executing operation Query10/Query10.GroupByKey2/Close
Oct 27, 2018 3:15:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:15:04.196Z: Executing operation Query10/Query10.GroupByKey2/Read+Query10/Query10.GroupByKey2/GroupByWindow+Query10/Query10.Index+Query10/Query10.Forget+Query10/Query10.Debug+Query10/Query10.Stamp+Query10.Format+Query10.DevNull
Oct 27, 2018 3:15:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:15:05.724Z: Cleaning up.
Oct 27, 2018 3:15:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T03:15:05.841Z: Stopping worker pool...
Oct 27, 2018 3:15:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:09.022Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:09.050Z RUNNING Query11
Oct 27, 2018 3:15:09 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:09.097Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:09.124Z RUNNING Query2
==========================================================================================
Run started 2018-10-27T03:10:56.844Z and ran for PT252.304S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Exception in thread "main" Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0000 *** not run ***
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
Oct 27, 2018 3:15:13 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:13.419Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:13.454Z RUNNING Query8
Oct 27, 2018 3:15:16 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:16.148Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:16.175Z RUNNING Query3
Oct 27, 2018 3:15:18 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:18.356Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:18.390Z RUNNING Query10
Oct 27, 2018 3:15:18 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:18.675Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:18.751Z RUNNING Query9
Oct 27, 2018 3:15:20 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:20.556Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:20.666Z RUNNING Query1
Oct 27, 2018 3:15:21 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:21.429Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:21.456Z RUNNING Query6
Oct 27, 2018 3:15:22 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:22.335Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:22.364Z RUNNING Query7
Oct 27, 2018 3:15:23 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:23.438Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:23.463Z RUNNING Query12
Oct 27, 2018 3:15:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:24.769Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:24.797Z RUNNING Query0
Oct 27, 2018 3:15:26 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:26.331Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:26.359Z RUNNING Query4
Oct 27, 2018 3:15:26 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T03:15:26.859Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T03:15:26.904Z RUNNING Query5
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 4 mins 31.001 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 27s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/hulgq473dykrm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #856
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/856/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #855
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/855/display/redirect>
------------------------------------------
[...truncated 1.44 MB...]
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.884Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.922Z: Fusing consumer SqlQuery0/SqlQuery0.Monitor into SqlQuery0.ReadBounded
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.953Z: Fusing consumer SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous) into SqlQuery0/SqlQuery0.Snoop
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.992Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_178/ParDo(Calc) into SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.028Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlQuery0.Serialize
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.059Z: Fusing consumer SqlQuery0.Format into SqlQuery0/SqlQuery0.Stamp
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.091Z: Fusing consumer SqlQuery0.DevNull into SqlQuery0.Format
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.121Z: Fusing consumer SqlQuery0/SqlQuery0.Stamp into SqlQuery0/SqlQuery0.Debug
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.151Z: Fusing consumer SqlQuery0/SqlQuery0.Debug into SqlQuery0/SqlQuery0.Forget
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.181Z: Fusing consumer SqlQuery0/SqlQuery0.Forget into SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.206Z: Fusing consumer SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_178/ParDo(Calc)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.242Z: Fusing consumer SqlQuery0/SqlQuery0.Snoop into SqlQuery0/SqlQuery0.Monitor
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.279Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous) into SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.319Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.Serialize into SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.671Z: Executing operation SqlQuery0.ReadBounded+SqlQuery0/SqlQuery0.Monitor+SqlQuery0/SqlQuery0.Snoop+SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.Serialize+SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_178/ParDo(Calc)+SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0.Forget+SqlQuery0/SqlQuery0.Debug+SqlQuery0/SqlQuery0.Stamp+SqlQuery0.Format+SqlQuery0.DevNull
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.759Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T12:24:16.168Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.918Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.330Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.866Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.919Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.967Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.075Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.113Z: Fusing consumer SqlQuery2/SqlQuery2.Monitor into SqlQuery2.ReadBounded
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.161Z: Fusing consumer SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous) into SqlQuery2/SqlQuery2.Snoop
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.200Z: Fusing consumer SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_250/ParDo(Calc)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.246Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_250/ParDo(Calc) into SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.295Z: Fusing consumer SqlQuery2.DevNull into SqlQuery2.Format
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.337Z: Fusing consumer SqlQuery2.Format into SqlQuery2/SqlQuery2.Stamp
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.382Z: Fusing consumer SqlQuery2/SqlQuery2.Stamp into SqlQuery2/SqlQuery2.Debug
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.419Z: Fusing consumer SqlQuery2/SqlQuery2.Debug into SqlQuery2/SqlQuery2.Forget
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.458Z: Fusing consumer SqlQuery2/SqlQuery2.Forget into SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.494Z: Fusing consumer SqlQuery2/SqlQuery2.Snoop into SqlQuery2/SqlQuery2.Monitor
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.523Z: Fusing consumer SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous) into SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.564Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.946Z: Executing operation SqlQuery2.ReadBounded+SqlQuery2/SqlQuery2.Monitor+SqlQuery2/SqlQuery2.Snoop+SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_250/ParDo(Calc)+SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2.Forget+SqlQuery2/SqlQuery2.Debug+SqlQuery2/SqlQuery2.Stamp+SqlQuery2.Format+SqlQuery2.DevNull
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:24.054Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:24:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:30.215Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:34.779Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:34.181Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:38.147Z: Workers have started successfully.
Oct 29, 2018 12:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:38.453Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:38.492Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:39.178Z: Workers have started successfully.
Oct 29, 2018 12:25:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:59.005Z: Workers have started successfully.
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:02.485Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:02.533Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.288Z: Workers have started successfully.
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.339Z: Workers have started successfully.
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:04.811Z: Workers have started successfully.
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.740Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.774Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:05.862Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:09.207Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:09.244Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:26.260Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:26.300Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:29.352Z: Workers have started successfully.
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:31.224Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:32.029Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:30.623Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:30.673Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:36.098Z: Workers have started successfully.
Oct 29, 2018 12:25:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:36.125Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:26:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:03.401Z: Cleaning up.
Oct 29, 2018 12:26:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:03.523Z: Stopping worker pool...
Oct 29, 2018 12:26:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:07.391Z: Cleaning up.
Oct 29, 2018 12:26:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:07.489Z: Stopping worker pool...
Oct 29, 2018 12:26:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:33.968Z: Cleaning up.
Oct 29, 2018 12:26:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:34.075Z: Stopping worker pool...
Oct 29, 2018 12:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:42.085Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close
Oct 29, 2018 12:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:42.185Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 12:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:47.040Z: Cleaning up.
Oct 29, 2018 12:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:47.142Z: Stopping worker pool...
Oct 29, 2018 12:27:49 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:27:49.778Z Waiting for main pipeline to 'finish'
2018-10-29T12:27:49.812Z RUNNING SqlQuery1
2018-10-29T12:27:50.611Z new perf {"snapshots":null,"runtimeSec":76.742,"numEvents":10000000,"eventsPerSec":130306.74207083473,"eventBytesPerSec":1.6725715996455656E7,"numResults":9200000,"resultsPerSec":119882.20270516796,"resultBytesPerSec":1.2048090302572254E7,"startupDelaySec":-179.349,"processingDelaySec":0.662,"shutdownDelaySec":102.607,"timeDilation":13.03002267337312,"errors":null,"jobId":null}
Oct 29, 2018 12:28:01 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T12:28:01.743Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:28:01.781Z RUNNING SqlQuery3
2018-10-29T12:28:02.701Z new perf {"snapshots":null,"runtimeSec":94.246,"numEvents":10000000,"eventsPerSec":106105.298898627,"eventBytesPerSec":1.3619303705197038E7,"numResults":9054,"resultsPerSec":96.06773762281689,"resultBytesPerSec":3068.1938756021477,"startupDelaySec":-169.199,"processingDelaySec":90.34,"shutdownDelaySec":74.953,"timeDilation":10.504424590964073,"errors":null,"jobId":null}
2018-10-29T12:28:05.641Z RUNNING SqlQuery1
2018-10-29T12:28:06.374Z no activity
Oct 29, 2018 12:28:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T12:28:12.633Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:28:12.663Z RUNNING SqlQuery0
2018-10-29T12:28:13.401Z new perf {"snapshots":null,"runtimeSec":79.056,"numEvents":10000000,"eventsPerSec":126492.61283141065,"eventBytesPerSec":1.6236147756021049E7,"numResults":9200000,"resultsPerSec":116373.2038048978,"resultBytesPerSec":1.169543799332119E7,"startupDelaySec":-177.947,"processingDelaySec":0.722,"shutdownDelaySec":98.891,"timeDilation":12.648628820076908,"errors":null,"jobId":null}
Oct 29, 2018 12:28:16 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T12:28:16.976Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:28:17.022Z RUNNING SqlQuery2
2018-10-29T12:28:17.738Z RUNNING SqlQuery3
2018-10-29T12:28:17.776Z new perf {"snapshots":null,"runtimeSec":46.041,"numEvents":10000000,"eventsPerSec":217197.71508003736,"eventBytesPerSec":2.7878736278534353E7,"numResults":83527,"resultsPerSec":1814.1873547490281,"resultBytesPerSec":29026.99767598445,"startupDelaySec":-180.686,"processingDelaySec":1.149,"shutdownDelaySec":134.649,"timeDilation":21.718468321713257,"errors":null,"jobId":null}
2018-10-29T12:28:18.605Z no activity
2018-10-29T12:28:21.403Z RUNNING SqlQuery1
2018-10-29T12:28:22.149Z no activity
2018-10-29T12:28:28.432Z RUNNING SqlQuery0
2018-10-29T12:28:29.203Z no activity
2018-10-29T12:28:32.801Z RUNNING SqlQuery2
2018-10-29T12:28:33.521Z no activity
2018-10-29T12:28:33.636Z RUNNING SqlQuery3
2018-10-29T12:28:34.540Z no activity
2018-10-29T12:28:37.183Z RUNNING SqlQuery1
2018-10-29T12:28:37.899Z no activity
2018-10-29T12:28:44.238Z RUNNING SqlQuery0
2018-10-29T12:28:44.945Z no activity
2018-10-29T12:28:48.558Z RUNNING SqlQuery2
2018-10-29T12:28:49.372Z no activity
2018-10-29T12:28:49.576Z RUNNING SqlQuery3
2018-10-29T12:28:50.396Z no activity
2018-10-29T12:28:52.934Z RUNNING SqlQuery1
2018-10-29T12:28:53.882Z no activity
2018-10-29T12:28:59.979Z RUNNING SqlQuery0
2018-10-29T12:29:00.702Z no activity
2018-10-29T12:29:04.408Z RUNNING SqlQuery2
2018-10-29T12:29:05.115Z no activity
2018-10-29T12:29:05.452Z RUNNING SqlQuery3
2018-10-29T12:29:06.285Z no activity
2018-10-29T12:29:08.922Z RUNNING SqlQuery1
2018-10-29T12:29:09.695Z no activity
2018-10-29T12:29:15.744Z RUNNING SqlQuery0
2018-10-29T12:29:16.667Z no activity
2018-10-29T12:29:20.146Z RUNNING SqlQuery2
2018-10-29T12:29:21.028Z no activity
2018-10-29T12:29:21.316Z RUNNING SqlQuery3
2018-10-29T12:29:22.190Z no activity
2018-10-29T12:29:24.781Z RUNNING SqlQuery1
2018-10-29T12:29:25.840Z no activity
2018-10-29T12:29:31.698Z RUNNING SqlQuery0
2018-10-29T12:29:32.535Z no activity
2018-10-29T12:29:36.107Z DONE SqlQuery2
2018-10-29T12:29:37.220Z RUNNING SqlQuery3
2018-10-29T12:29:38.324Z no activity
2018-10-29T12:29:40.876Z DONE SqlQuery1
2018-10-29T12:29:47.581Z RUNNING SqlQuery0
2018-10-29T12:29:48.328Z no activity
2018-10-29T12:29:53.364Z RUNNING SqlQuery3
2018-10-29T12:29:54.339Z no activity
2018-10-29T12:30:03.367Z RUNNING SqlQuery0
2018-10-29T12:30:04.384Z no activity
2018-10-29T12:30:09.385Z RUNNING SqlQuery3
2018-10-29T12:30:10.340Z no activity
2018-10-29T12:30:19.471Z DONE SqlQuery0
2018-10-29T12:30:25.386Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 6 mins 44.547 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 56s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/w2wwpva5qa77k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #854
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/854/display/redirect?page=changes>
Changes:
[kenn] [BEAM-5817] Use an explicit enum for naming Nexmark benchmarks
------------------------------------------
[...truncated 1.31 MB...]
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.836Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.882Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.929Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.977Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.010Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.055Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.104Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.150Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.186Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.235Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.279Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.328Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.365Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.413Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.461Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.507Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.554Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.604Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 29, 2018 9:09:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.054Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T09:09:10.189Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:12.945Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.331Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.910Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.955Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.991Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.095Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.141Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor into SqlQuery1.ReadBounded
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.182Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.228Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.275Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc) into SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.320Z: Fusing consumer SqlQuery1.DevNull into SqlQuery1.Format
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.366Z: Fusing consumer SqlQuery1.Format into SqlQuery1/SqlQuery1.Stamp
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.403Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp into SqlQuery1/SqlQuery1.Debug
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.451Z: Fusing consumer SqlQuery1/SqlQuery1.Debug into SqlQuery1/SqlQuery1.Forget
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.497Z: Fusing consumer SqlQuery1/SqlQuery1.Forget into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.540Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop into SqlQuery1/SqlQuery1.Monitor
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.566Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.612Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.055Z: Executing operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Forget+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.166Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.112Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Create
Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.215Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.434Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write
Oct 29, 2018 9:09:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:30.154Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:09:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:30.266Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:09:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:33.005Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:09:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:32.799Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:00.596Z: Workers have started successfully.
Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:01.114Z: Workers have started successfully.
Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:00.532Z: Workers have started successfully.
Oct 29, 2018 9:10:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:04.214Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:03.009Z: Workers have started successfully.
Oct 29, 2018 9:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:04.255Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:08.916Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:08.955Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:10.043Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:12.611Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:12.657Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:13.145Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:13.185Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:14.936Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:18.170Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:31.422Z: Workers have started successfully.
Oct 29, 2018 9:10:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:31.830Z: Workers have started successfully.
Oct 29, 2018 9:10:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:31.780Z: Workers have started successfully.
Oct 29, 2018 9:10:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:34.152Z: Workers have started successfully.
Oct 29, 2018 9:10:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:35.890Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:52.962Z: Cleaning up.
Oct 29, 2018 9:10:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:53.097Z: Stopping worker pool...
Oct 29, 2018 9:11:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:22.914Z: Cleaning up.
Oct 29, 2018 9:11:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:23.017Z: Stopping worker pool...
Oct 29, 2018 9:11:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:31.272Z: Cleaning up.
Oct 29, 2018 9:11:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:31.368Z: Stopping worker pool...
Oct 29, 2018 9:11:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:43.719Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close
Oct 29, 2018 9:11:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:43.823Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 9:11:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:47.633Z: Cleaning up.
Oct 29, 2018 9:11:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:47.732Z: Stopping worker pool...
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T09:13:11.024Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T09:13:11.051Z RUNNING SqlQuery0
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T09:13:11.092Z Waiting for main pipeline to 'finish'
2018-10-29T09:13:11.226Z RUNNING SqlQuery1
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T09:13:11.227Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T09:13:11.257Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T09:13:11.266Z RUNNING SqlQuery2
2018-10-29T09:13:11.290Z RUNNING SqlQuery3
2018-10-29T09:13:11.954Z new perf {"snapshots":null,"runtimeSec":76.565,"numEvents":10000000,"eventsPerSec":130607.98014758702,"eventBytesPerSec":1.6764381858551558E7,"numResults":9200000,"resultsPerSec":120159.34173578006,"resultBytesPerSec":1.2075942610853523E7,"startupDelaySec":-177.634,"processingDelaySec":0.766,"shutdownDelaySec":101.069,"timeDilation":13.060144974857964,"errors":null,"jobId":null}
2018-10-29T09:13:11.998Z new perf {"snapshots":null,"runtimeSec":70.253,"numEvents":10000000,"eventsPerSec":142342.67575761888,"eventBytesPerSec":1.827060619475325E7,"numResults":9200000,"resultsPerSec":130955.26169700938,"resultBytesPerSec":1.3160926166854085E7,"startupDelaySec":-178.699,"processingDelaySec":0.631,"shutdownDelaySec":108.446,"timeDilation":14.2335558623831,"errors":null,"jobId":null}
2018-10-29T09:13:12.041Z new perf {"snapshots":null,"runtimeSec":40.904,"numEvents":10000000,"eventsPerSec":244474.86798357125,"eventBytesPerSec":3.1379935874242127E7,"numResults":83527,"resultsPerSec":2042.0252298063758,"resultBytesPerSec":32672.403676902013,"startupDelaySec":-179.503,"processingDelaySec":1.135,"shutdownDelaySec":138.599,"timeDilation":24.44601994914923,"errors":null,"jobId":null}
2018-10-29T09:13:12.114Z new perf {"snapshots":null,"runtimeSec":89.979,"numEvents":10000000,"eventsPerSec":111137.04308783161,"eventBytesPerSec":1.4265160726391714E7,"numResults":9054,"resultsPerSec":100.62347881172273,"resultBytesPerSec":3213.6943064492825,"startupDelaySec":-173.886,"processingDelaySec":87.123,"shutdownDelaySec":83.907,"timeDilation":11.00256726569533,"errors":null,"jobId":null}
2018-10-29T09:13:27.001Z RUNNING SqlQuery0
2018-10-29T09:13:27.031Z RUNNING SqlQuery1
2018-10-29T09:13:27.071Z RUNNING SqlQuery2
2018-10-29T09:13:27.146Z RUNNING SqlQuery3
2018-10-29T09:13:27.723Z no activity
2018-10-29T09:13:27.750Z no activity
2018-10-29T09:13:27.969Z no activity
2018-10-29T09:13:28.003Z no activity
2018-10-29T09:13:42.801Z RUNNING SqlQuery1
2018-10-29T09:13:42.801Z RUNNING SqlQuery0
2018-10-29T09:13:42.997Z RUNNING SqlQuery2
2018-10-29T09:13:43.030Z RUNNING SqlQuery3
2018-10-29T09:13:43.495Z no activity
2018-10-29T09:13:43.496Z no activity
2018-10-29T09:13:43.655Z no activity
2018-10-29T09:13:43.794Z no activity
2018-10-29T09:13:58.523Z RUNNING SqlQuery1
2018-10-29T09:13:58.525Z RUNNING SqlQuery0
2018-10-29T09:13:58.683Z RUNNING SqlQuery2
2018-10-29T09:13:58.822Z RUNNING SqlQuery3
2018-10-29T09:13:59.139Z no activity
2018-10-29T09:13:59.171Z no activity
2018-10-29T09:13:59.424Z no activity
2018-10-29T09:13:59.692Z no activity
2018-10-29T09:14:14.174Z RUNNING SqlQuery1
2018-10-29T09:14:14.198Z RUNNING SqlQuery0
2018-10-29T09:14:14.446Z RUNNING SqlQuery2
2018-10-29T09:14:14.723Z RUNNING SqlQuery3
2018-10-29T09:14:14.921Z no activity
2018-10-29T09:14:14.953Z no activity
2018-10-29T09:14:15.171Z no activity
2018-10-29T09:14:15.726Z no activity
2018-10-29T09:14:29.989Z RUNNING SqlQuery1
2018-10-29T09:14:29.990Z RUNNING SqlQuery0
2018-10-29T09:14:30.328Z DONE SqlQuery2
2018-10-29T09:14:30.760Z RUNNING SqlQuery3
2018-10-29T09:14:30.790Z no activity
2018-10-29T09:14:30.801Z no activity
2018-10-29T09:14:31.599Z no activity
2018-10-29T09:14:45.824Z DONE SqlQuery0
2018-10-29T09:14:45.836Z RUNNING SqlQuery1
2018-10-29T09:14:46.613Z no activity
2018-10-29T09:14:46.637Z RUNNING SqlQuery3
2018-10-29T09:14:47.473Z no activity
2018-10-29T09:15:01.656Z DONE SqlQuery1
2018-10-29T09:15:02.501Z RUNNING SqlQuery3
2018-10-29T09:15:03.335Z no activity
2018-10-29T09:15:18.368Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 6 mins 16.241 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 27s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/gfx3yqldbxugc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #853
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/853/display/redirect>
------------------------------------------
[...truncated 1.43 MB...]
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.746Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.794Z: Unzipping flatten s17 for input s15.org.apache.beam.sdk.values.PCollection.<init>:402#d5569b730568cf6
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.843Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify, through flatten SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/Flatten, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.890Z: Fusing consumer SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.937Z: Fusing consumer SqlQuery3.Format into SqlQuery3/SqlQuery3.Stamp
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.980Z: Fusing consumer SqlQuery3.DevNull into SqlQuery3.Format
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.019Z: Fusing consumer SqlQuery3/SqlQuery3.Forget into SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.062Z: Fusing consumer SqlQuery3/SqlQuery3.Debug into SqlQuery3/SqlQuery3.Forget
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.108Z: Fusing consumer SqlQuery3/SqlQuery3.Stamp into SqlQuery3/SqlQuery3.Debug
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.148Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.192Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.239Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.284Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.331Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.377Z: Unzipping flatten s17-u13 for input s18-reify-value0-c11
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.414Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.446Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.485Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.524Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.571Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.611Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.654Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.701Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_33/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.748Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_30/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.787Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.834Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.872Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.917Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_33/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.955Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.983Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_30/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.028Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.067Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.113Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.571Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Create
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.667Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.850Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_33/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_30/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write
Oct 29, 2018 6:23:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:21.932Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:24.124Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:25.464Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:29.484Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:50.050Z: Workers have started successfully.
Oct 29, 2018 6:23:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:49.528Z: Workers have started successfully.
Oct 29, 2018 6:23:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:51.455Z: Workers have started successfully.
Oct 29, 2018 6:23:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:58.277Z: Workers have started successfully.
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:07.903Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:07.938Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:08.094Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:08.123Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:11.072Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:11.100Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:12.329Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:12.367Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:13.828Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:13.865Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:13.650Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:16.806Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:18.145Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:19.283Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:19.316Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:20.244Z: Workers have started successfully.
Oct 29, 2018 6:24:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:20.665Z: Workers have started successfully.
Oct 29, 2018 6:24:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:22.816Z: Workers have started successfully.
Oct 29, 2018 6:24:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:29.543Z: Workers have started successfully.
Oct 29, 2018 6:24:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:30.515Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:46.648Z: Cleaning up.
Oct 29, 2018 6:24:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:46.826Z: Stopping worker pool...
Oct 29, 2018 6:25:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:21.528Z: Cleaning up.
Oct 29, 2018 6:25:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:21.631Z: Stopping worker pool...
Oct 29, 2018 6:25:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:33.697Z: Cleaning up.
Oct 29, 2018 6:25:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:33.813Z: Stopping worker pool...
Oct 29, 2018 6:25:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:47.181Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close
Oct 29, 2018 6:25:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:47.275Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 6:25:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:51.445Z: Cleaning up.
Oct 29, 2018 6:25:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:51.556Z: Stopping worker pool...
Oct 29, 2018 6:27:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:04.924Z Waiting for main pipeline to 'finish'
2018-10-29T06:27:04.955Z RUNNING SqlQuery1
Oct 29, 2018 6:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T06:27:05.106Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:05.106Z Waiting for main pipeline to 'finish'
Oct 29, 2018 6:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:05.148Z RUNNING SqlQuery0
2018-10-29T06:27:05.149Z RUNNING SqlQuery2
Oct 29, 2018 6:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T06:27:05.180Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:05.217Z RUNNING SqlQuery3
2018-10-29T06:27:05.809Z new perf {"snapshots":null,"runtimeSec":84.003,"numEvents":10000000,"eventsPerSec":119043.3674987798,"eventBytesPerSec":1.5279988774210446E7,"numResults":9200000,"resultsPerSec":109519.89809887743,"resultBytesPerSec":1.1006684832684547E7,"startupDelaySec":-175.444,"processingDelaySec":0.812,"shutdownDelaySec":91.441,"timeDilation":11.903741533040487,"errors":null,"jobId":null}
2018-10-29T06:27:06.016Z new perf {"snapshots":null,"runtimeSec":44.982,"numEvents":10000000,"eventsPerSec":222311.14668089457,"eventBytesPerSec":2.8535078409141436E7,"numResults":83527,"resultsPerSec":1856.8983148815082,"resultBytesPerSec":29710.37303810413,"startupDelaySec":-184.721,"processingDelaySec":1.147,"shutdownDelaySec":139.748,"timeDilation":22.229780801209372,"errors":null,"jobId":null}
2018-10-29T06:27:06.049Z new perf {"snapshots":null,"runtimeSec":76.84,"numEvents":10000000,"eventsPerSec":130140.55179593961,"eventBytesPerSec":1.670438439614784E7,"numResults":9200000,"resultsPerSec":119729.30765226444,"resultBytesPerSec":1.2032724440395627E7,"startupDelaySec":-181.674,"processingDelaySec":0.614,"shutdownDelaySec":104.834,"timeDilation":13.013404476834982,"errors":null,"jobId":null}
2018-10-29T06:27:06.175Z new perf {"snapshots":null,"runtimeSec":46.771,"numEvents":10000000,"eventsPerSec":213807.70135340275,"eventBytesPerSec":2.7443606016548716E7,"numResults":9054,"resultsPerSec":193.58149280537086,"resultBytesPerSec":6182.570396185671,"startupDelaySec":-120.733,"processingDelaySec":43.514,"shutdownDelaySec":73.962,"timeDilation":21.16696243398687,"errors":null,"jobId":null}
2018-10-29T06:27:20.891Z RUNNING SqlQuery1
2018-10-29T06:27:21.052Z RUNNING SqlQuery2
2018-10-29T06:27:21.085Z RUNNING SqlQuery0
2018-10-29T06:27:21.202Z RUNNING SqlQuery3
2018-10-29T06:27:21.866Z no activity
2018-10-29T06:27:21.969Z no activity
2018-10-29T06:27:21.997Z no activity
2018-10-29T06:27:22.198Z no activity
2018-10-29T06:27:36.900Z RUNNING SqlQuery1
2018-10-29T06:27:36.994Z RUNNING SqlQuery0
2018-10-29T06:27:37.023Z RUNNING SqlQuery2
2018-10-29T06:27:37.227Z RUNNING SqlQuery3
2018-10-29T06:27:37.625Z no activity
2018-10-29T06:27:37.678Z no activity
2018-10-29T06:27:37.732Z no activity
2018-10-29T06:27:38.039Z no activity
2018-10-29T06:27:52.663Z RUNNING SqlQuery1
2018-10-29T06:27:52.706Z RUNNING SqlQuery2
2018-10-29T06:27:52.759Z RUNNING SqlQuery0
2018-10-29T06:27:53.072Z RUNNING SqlQuery3
2018-10-29T06:27:53.369Z no activity
2018-10-29T06:27:53.391Z no activity
2018-10-29T06:27:53.426Z no activity
2018-10-29T06:27:53.781Z no activity
2018-10-29T06:28:08.406Z RUNNING SqlQuery1
2018-10-29T06:28:08.415Z RUNNING SqlQuery2
2018-10-29T06:28:08.461Z RUNNING SqlQuery0
2018-10-29T06:28:08.822Z RUNNING SqlQuery3
2018-10-29T06:28:09.053Z no activity
2018-10-29T06:28:09.068Z no activity
2018-10-29T06:28:09.113Z no activity
2018-10-29T06:28:09.666Z no activity
2018-10-29T06:28:24.100Z DONE SqlQuery2
2018-10-29T06:28:24.106Z RUNNING SqlQuery1
2018-10-29T06:28:24.149Z RUNNING SqlQuery0
2018-10-29T06:28:24.700Z RUNNING SqlQuery3
2018-10-29T06:28:24.839Z no activity
2018-10-29T06:28:24.899Z no activity
2018-10-29T06:28:25.526Z no activity
2018-10-29T06:28:39.909Z RUNNING SqlQuery1
2018-10-29T06:28:39.929Z RUNNING SqlQuery0
2018-10-29T06:28:40.559Z RUNNING SqlQuery3
2018-10-29T06:28:40.592Z no activity
2018-10-29T06:28:40.673Z no activity
2018-10-29T06:28:41.343Z no activity
2018-10-29T06:28:55.636Z RUNNING SqlQuery1
2018-10-29T06:28:55.706Z DONE SqlQuery0
2018-10-29T06:28:55.794Z no activity
2018-10-29T06:28:56.377Z RUNNING SqlQuery3
2018-10-29T06:28:57.200Z no activity
2018-10-29T06:29:10.795Z DONE SqlQuery1
2018-10-29T06:29:12.224Z RUNNING SqlQuery3
2018-10-29T06:29:12.986Z no activity
2018-10-29T06:29:28.033Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 6 mins 31.767 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 42s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/fahy2ru4dxlsi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #852
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/852/display/redirect?page=changes>
Changes:
[klk] [BEAM-5887] Fix classifier for unshaded tests
[klk] Re-enable parallel build of Java PreCommit
------------------------------------------
[...truncated 1.48 MB...]
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.025Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/right_ExtractJoinFields/Map
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.068Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_24/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.116Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_486/ParDo(Calc)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.163Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.210Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.728Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Create
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.831Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:10.029Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_487/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_24/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_486/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Write
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T02:09:00.348Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:03.082Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:06.722Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.311Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.359Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.406Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.512Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.562Z: Fusing consumer SqlQuery2/SqlQuery2.Monitor into SqlQuery2.ReadBounded
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.612Z: Fusing consumer SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous) into SqlQuery2/SqlQuery2.Snoop
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.654Z: Fusing consumer SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_251/ParDo(Calc)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.700Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_251/ParDo(Calc) into SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.743Z: Fusing consumer SqlQuery2.DevNull into SqlQuery2.Format
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.769Z: Fusing consumer SqlQuery2.Format into SqlQuery2/SqlQuery2.Stamp
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.817Z: Fusing consumer SqlQuery2/SqlQuery2.Stamp into SqlQuery2/SqlQuery2.Debug
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.866Z: Fusing consumer SqlQuery2/SqlQuery2.Debug into SqlQuery2/SqlQuery2.Forget
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.912Z: Fusing consumer SqlQuery2/SqlQuery2.Forget into SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.943Z: Fusing consumer SqlQuery2/SqlQuery2.Snoop into SqlQuery2/SqlQuery2.Monitor
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.992Z: Fusing consumer SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous) into SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:08.041Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:08.514Z: Executing operation SqlQuery2.ReadBounded+SqlQuery2/SqlQuery2.Monitor+SqlQuery2/SqlQuery2.Snoop+SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_251/ParDo(Calc)+SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2.Forget+SqlQuery2/SqlQuery2.Debug+SqlQuery2/SqlQuery2.Stamp+SqlQuery2.Format+SqlQuery2.DevNull
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:08.616Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 2:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:19.180Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:20.346Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:23.607Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:25.370Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:46.437Z: Workers have started successfully.
Oct 29, 2018 2:09:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:47.453Z: Workers have started successfully.
Oct 29, 2018 2:09:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:55.986Z: Workers have started successfully.
Oct 29, 2018 2:09:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:58.775Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:58.827Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:01.779Z: Workers have started successfully.
Oct 29, 2018 2:10:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:01.392Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:01.442Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:04.406Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:04.452Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:17.925Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:17.967Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:17.667Z: Workers have started successfully.
Oct 29, 2018 2:10:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:18.644Z: Workers have started successfully.
Oct 29, 2018 2:10:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:21.783Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:21.440Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:21.479Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.339Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.380Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.068Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.113Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:27.006Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:27.054Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:27.307Z: Workers have started successfully.
Oct 29, 2018 2:10:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:29.275Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:28.752Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:33.057Z: Workers have started successfully.
Oct 29, 2018 2:10:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:44.154Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:11:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:02.275Z: Cleaning up.
Oct 29, 2018 2:11:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:02.367Z: Stopping worker pool...
Oct 29, 2018 2:11:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:21.115Z: Cleaning up.
Oct 29, 2018 2:11:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:21.235Z: Stopping worker pool...
Oct 29, 2018 2:11:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:27.677Z: Cleaning up.
Oct 29, 2018 2:11:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:27.796Z: Stopping worker pool...
Oct 29, 2018 2:11:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:43.611Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Close
Oct 29, 2018 2:11:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:43.722Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_489/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 2:11:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:48.411Z: Cleaning up.
Oct 29, 2018 2:11:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:48.517Z: Stopping worker pool...
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.234Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T02:13:01.268Z RUNNING SqlQuery2
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.285Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.306Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T02:13:01.314Z RUNNING SqlQuery1
2018-10-29T02:13:01.341Z RUNNING SqlQuery0
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.561Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T02:13:01.589Z RUNNING SqlQuery3
2018-10-29T02:13:02.229Z new perf {"snapshots":null,"runtimeSec":72.556,"numEvents":10000000,"eventsPerSec":137824.57687854898,"eventBytesPerSec":1.7690678882518332E7,"numResults":9200000,"resultsPerSec":126798.61072826506,"resultBytesPerSec":1.274318520866641E7,"startupDelaySec":-167.425,"processingDelaySec":0.741,"shutdownDelaySec":94.869,"timeDilation":13.781768564970507,"errors":null,"jobId":null}
2018-10-29T02:13:02.251Z new perf {"snapshots":null,"runtimeSec":52.853,"numEvents":10000000,"eventsPerSec":189204.01869335704,"eventBytesPerSec":2.428556367661249E7,"numResults":83527,"resultsPerSec":1580.3644069400034,"resultBytesPerSec":25285.830511040054,"startupDelaySec":-172.772,"processingDelaySec":1.034,"shutdownDelaySec":119.919,"timeDilation":18.919266645223544,"errors":null,"jobId":null}
2018-10-29T02:13:02.327Z new perf {"snapshots":null,"runtimeSec":81.636,"numEvents":10000000,"eventsPerSec":122494.97770591406,"eventBytesPerSec":1.5723025344210887E7,"numResults":9200000,"resultsPerSec":112695.37948944094,"resultBytesPerSec":1.1325818829927973E7,"startupDelaySec":-182.109,"processingDelaySec":0.834,"shutdownDelaySec":100.473,"timeDilation":12.248885295702877,"errors":null,"jobId":null}
2018-10-29T02:13:02.653Z new perf {"snapshots":null,"runtimeSec":76.655,"numEvents":10000000,"eventsPerSec":130454.6344008871,"eventBytesPerSec":1.674469893679473E7,"numResults":9054,"resultsPerSec":118.11362598656316,"resultBytesPerSec":3772.2914356532515,"startupDelaySec":-150.028,"processingDelaySec":72.905,"shutdownDelaySec":73.373,"timeDilation":12.915008805687823,"errors":null,"jobId":null}
2018-10-29T02:13:17.279Z RUNNING SqlQuery1
2018-10-29T02:13:17.288Z RUNNING SqlQuery2
2018-10-29T02:13:17.361Z RUNNING SqlQuery0
2018-10-29T02:13:17.692Z RUNNING SqlQuery3
2018-10-29T02:13:18.135Z no activity
2018-10-29T02:13:18.182Z no activity
2018-10-29T02:13:18.261Z no activity
2018-10-29T02:13:18.603Z no activity
2018-10-29T02:13:33.174Z RUNNING SqlQuery1
2018-10-29T02:13:33.224Z RUNNING SqlQuery2
2018-10-29T02:13:33.294Z RUNNING SqlQuery0
2018-10-29T02:13:33.635Z RUNNING SqlQuery3
2018-10-29T02:13:33.885Z no activity
2018-10-29T02:13:33.904Z no activity
2018-10-29T02:13:34.018Z no activity
2018-10-29T02:13:34.458Z no activity
2018-10-29T02:13:48.929Z RUNNING SqlQuery1
2018-10-29T02:13:48.930Z RUNNING SqlQuery2
2018-10-29T02:13:49.064Z RUNNING SqlQuery0
2018-10-29T02:13:49.485Z RUNNING SqlQuery3
2018-10-29T02:13:49.642Z no activity
2018-10-29T02:13:49.774Z no activity
2018-10-29T02:13:49.858Z no activity
2018-10-29T02:13:50.262Z no activity
2018-10-29T02:14:04.674Z RUNNING SqlQuery2
2018-10-29T02:14:04.812Z RUNNING SqlQuery1
2018-10-29T02:14:04.909Z RUNNING SqlQuery0
2018-10-29T02:14:05.307Z RUNNING SqlQuery3
2018-10-29T02:14:05.514Z no activity
2018-10-29T02:14:05.629Z no activity
2018-10-29T02:14:05.727Z no activity
2018-10-29T02:14:06.203Z no activity
2018-10-29T02:14:20.560Z RUNNING SqlQuery2
2018-10-29T02:14:20.666Z RUNNING SqlQuery1
2018-10-29T02:14:20.769Z RUNNING SqlQuery0
2018-10-29T02:14:21.242Z RUNNING SqlQuery3
2018-10-29T02:14:21.244Z no activity
2018-10-29T02:14:21.388Z no activity
2018-10-29T02:14:21.549Z no activity
2018-10-29T02:14:22.084Z no activity
2018-10-29T02:14:36.277Z RUNNING SqlQuery2
2018-10-29T02:14:36.419Z RUNNING SqlQuery1
2018-10-29T02:14:36.580Z RUNNING SqlQuery0
2018-10-29T02:14:37.011Z no activity
2018-10-29T02:14:37.122Z RUNNING SqlQuery3
2018-10-29T02:14:37.168Z no activity
2018-10-29T02:14:37.367Z no activity
2018-10-29T02:14:38.049Z no activity
2018-10-29T02:14:52.051Z RUNNING SqlQuery2
2018-10-29T02:14:52.202Z RUNNING SqlQuery1
2018-10-29T02:14:52.410Z DONE SqlQuery0
2018-10-29T02:14:52.828Z no activity
2018-10-29T02:14:52.923Z no activity
2018-10-29T02:14:53.079Z RUNNING SqlQuery3
2018-10-29T02:14:53.932Z no activity
2018-10-29T02:15:07.860Z DONE SqlQuery2
2018-10-29T02:15:07.964Z DONE SqlQuery1
2018-10-29T02:15:08.969Z RUNNING SqlQuery3
2018-10-29T02:15:09.874Z no activity
2018-10-29T02:15:24.993Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 6 mins 32.992 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 45s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/ff6o5johwrfg2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #851
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/851/display/redirect>
------------------------------------------
[...truncated 1.40 MB...]
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:07.871Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.121Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.708Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.782Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.826Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.929Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.967Z: Fusing consumer SqlQuery0/SqlQuery0.Monitor into SqlQuery0.ReadBounded
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.014Z: Fusing consumer SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous) into SqlQuery0/SqlQuery0.Snoop
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.060Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_175/ParDo(Calc) into SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_21/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.108Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_21/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlQuery0.Serialize
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.149Z: Fusing consumer SqlQuery0.Format into SqlQuery0/SqlQuery0.Stamp
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.193Z: Fusing consumer SqlQuery0.DevNull into SqlQuery0.Format
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.230Z: Fusing consumer SqlQuery0/SqlQuery0.Stamp into SqlQuery0/SqlQuery0.Debug
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.276Z: Fusing consumer SqlQuery0/SqlQuery0.Debug into SqlQuery0/SqlQuery0.Forget
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.314Z: Fusing consumer SqlQuery0/SqlQuery0.Forget into SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.362Z: Fusing consumer SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_175/ParDo(Calc)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.410Z: Fusing consumer SqlQuery0/SqlQuery0.Snoop into SqlQuery0/SqlQuery0.Monitor
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.458Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous) into SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.507Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.Serialize into SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.964Z: Executing operation SqlQuery0.ReadBounded+SqlQuery0/SqlQuery0.Monitor+SqlQuery0/SqlQuery0.Snoop+SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.Serialize+SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_21/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_175/ParDo(Calc)+SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0.Forget+SqlQuery0/SqlQuery0.Debug+SqlQuery0/SqlQuery0.Stamp+SqlQuery0.Format+SqlQuery0.DevNull
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.063Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T00:23:05.093Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:08.452Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.611Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.187Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.249Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.308Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.417Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.476Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor into SqlQuery1.ReadBounded
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.527Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.580Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_176/ParDo(Calc)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.626Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_176/ParDo(Calc) into SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.666Z: Fusing consumer SqlQuery1.DevNull into SqlQuery1.Format
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.713Z: Fusing consumer SqlQuery1.Format into SqlQuery1/SqlQuery1.Stamp
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.762Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp into SqlQuery1/SqlQuery1.Debug
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.812Z: Fusing consumer SqlQuery1/SqlQuery1.Debug into SqlQuery1/SqlQuery1.Forget
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.859Z: Fusing consumer SqlQuery1/SqlQuery1.Forget into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.905Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop into SqlQuery1/SqlQuery1.Monitor
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.953Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:14.012Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:14.583Z: Executing operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_176/ParDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Forget+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:14.706Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:23:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:23.952Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:24.172Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:28.652Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:34.777Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:56.749Z: Workers have started successfully.
Oct 29, 2018 12:23:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:58.461Z: Workers have started successfully.
Oct 29, 2018 12:24:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:59.950Z: Workers have started successfully.
Oct 29, 2018 12:24:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:02.437Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:02.469Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:02.821Z: Workers have started successfully.
Oct 29, 2018 12:24:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:03.824Z: Workers have started successfully.
Oct 29, 2018 12:24:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:03.676Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:03.723Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.612Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.659Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.886Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.957Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:07.887Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:07.934Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:09.207Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:14.035Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:14.386Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:26.938Z: Workers have started successfully.
Oct 29, 2018 12:24:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:28.923Z: Workers have started successfully.
Oct 29, 2018 12:24:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:29.897Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:34.001Z: Workers have started successfully.
Oct 29, 2018 12:24:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:53.585Z: Cleaning up.
Oct 29, 2018 12:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:53.676Z: Stopping worker pool...
Oct 29, 2018 12:25:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.720Z: Cleaning up.
Oct 29, 2018 12:25:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.832Z: Stopping worker pool...
Oct 29, 2018 12:25:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.783Z: Cleaning up.
Oct 29, 2018 12:25:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.900Z: Stopping worker pool...
Oct 29, 2018 12:25:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:44.285Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Close
Oct 29, 2018 12:25:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:44.377Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 12:25:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:49.109Z: Cleaning up.
Oct 29, 2018 12:25:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:49.216Z: Stopping worker pool...
Oct 29, 2018 12:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T00:27:05.988Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T00:27:06.016Z RUNNING SqlQuery1
Oct 29, 2018 12:27:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T00:27:06.025Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 29, 2018 12:27:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T00:27:06.026Z Waiting for main pipeline to 'finish'
Oct 29, 2018 12:27:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T00:27:06.041Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T00:27:06.057Z RUNNING SqlQuery2
2018-10-29T00:27:06.057Z RUNNING SqlQuery3
2018-10-29T00:27:06.076Z RUNNING SqlQuery0
2018-10-29T00:27:06.923Z new perf {"snapshots":null,"runtimeSec":78.176,"numEvents":10000000,"eventsPerSec":127916.49611133852,"eventBytesPerSec":1.6418912415575111E7,"numResults":9200000,"resultsPerSec":117683.17642243144,"resultBytesPerSec":1.182708946479738E7,"startupDelaySec":-175.844,"processingDelaySec":0.748,"shutdownDelaySec":97.668,"timeDilation":12.791010028653295,"errors":null,"jobId":null}
2018-10-29T00:27:06.936Z new perf {"snapshots":null,"runtimeSec":43.609,"numEvents":10000000,"eventsPerSec":229310.4634364466,"eventBytesPerSec":2.9433486138182484E7,"numResults":83527,"resultsPerSec":1915.3615079456074,"resultBytesPerSec":30645.78412712972,"startupDelaySec":-176.264,"processingDelaySec":1.114,"shutdownDelaySec":132.66,"timeDilation":22.929670480864043,"errors":null,"jobId":null}
2018-10-29T00:27:06.949Z new perf {"snapshots":null,"runtimeSec":76.668,"numEvents":10000000,"eventsPerSec":130432.51421714404,"eventBytesPerSec":1.6741859667657953E7,"numResults":9200000,"resultsPerSec":119997.91307977252,"resultBytesPerSec":1.2059719126623884E7,"startupDelaySec":-174.29,"processingDelaySec":0.685,"shutdownDelaySec":97.622,"timeDilation":13.04259925914332,"errors":null,"jobId":null}
2018-10-29T00:27:07.081Z new perf {"snapshots":null,"runtimeSec":93.182,"numEvents":10000000,"eventsPerSec":107316.86377197312,"eventBytesPerSec":1.3774815919383572E7,"numResults":9054,"resultsPerSec":97.16468845914447,"resultBytesPerSec":3103.228091262261,"startupDelaySec":-170.474,"processingDelaySec":89.515,"shutdownDelaySec":77.292,"timeDilation":10.62436951342534,"errors":null,"jobId":null}
2018-10-29T00:27:21.958Z RUNNING SqlQuery2
2018-10-29T00:27:21.971Z RUNNING SqlQuery0
2018-10-29T00:27:21.976Z RUNNING SqlQuery1
2018-10-29T00:27:22.116Z RUNNING SqlQuery3
2018-10-29T00:27:22.654Z no activity
2018-10-29T00:27:22.674Z no activity
2018-10-29T00:27:22.691Z no activity
2018-10-29T00:27:22.972Z no activity
2018-10-29T00:27:37.719Z RUNNING SqlQuery2
2018-10-29T00:27:37.751Z RUNNING SqlQuery0
2018-10-29T00:27:37.765Z RUNNING SqlQuery1
2018-10-29T00:27:38.005Z RUNNING SqlQuery3
2018-10-29T00:27:38.431Z no activity
2018-10-29T00:27:38.435Z no activity
2018-10-29T00:27:38.570Z no activity
2018-10-29T00:27:38.792Z no activity
2018-10-29T00:27:53.463Z RUNNING SqlQuery2
2018-10-29T00:27:53.465Z RUNNING SqlQuery1
2018-10-29T00:27:53.602Z RUNNING SqlQuery0
2018-10-29T00:27:53.822Z RUNNING SqlQuery3
2018-10-29T00:27:54.122Z no activity
2018-10-29T00:27:54.249Z no activity
2018-10-29T00:27:54.324Z no activity
2018-10-29T00:27:54.784Z no activity
2018-10-29T00:28:09.167Z RUNNING SqlQuery1
2018-10-29T00:28:09.292Z RUNNING SqlQuery2
2018-10-29T00:28:09.354Z RUNNING SqlQuery0
2018-10-29T00:28:09.820Z RUNNING SqlQuery3
2018-10-29T00:28:09.871Z no activity
2018-10-29T00:28:10.003Z no activity
2018-10-29T00:28:10.065Z no activity
2018-10-29T00:28:10.704Z no activity
2018-10-29T00:28:24.901Z RUNNING SqlQuery1
2018-10-29T00:28:25.047Z DONE SqlQuery2
2018-10-29T00:28:25.098Z RUNNING SqlQuery0
2018-10-29T00:28:25.650Z no activity
2018-10-29T00:28:25.743Z RUNNING SqlQuery3
2018-10-29T00:28:25.768Z no activity
2018-10-29T00:28:26.641Z no activity
2018-10-29T00:28:40.701Z RUNNING SqlQuery1
2018-10-29T00:28:40.815Z DONE SqlQuery0
2018-10-29T00:28:41.423Z no activity
2018-10-29T00:28:41.685Z RUNNING SqlQuery3
2018-10-29T00:28:42.592Z no activity
2018-10-29T00:28:56.469Z DONE SqlQuery1
2018-10-29T00:28:57.624Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 6 mins 1.035 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 15s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/qmwd2ffxm367w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #850
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/850/display/redirect?page=changes>
Changes:
[github] [BEAM-5886] Fix incorrectly formulated condition in checkState method
------------------------------------------
[...truncated 1.25 MB...]
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.056Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.133Z: Expanding GroupByKey operations into optimizable parts.
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.176Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.308Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.348Z: Unzipping flatten s17 for input s15.org.apache.beam.sdk.values.PCollection.<init>:402#c47715dbb819979d
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.394Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify, through flatten SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/Flatten, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable0
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.432Z: Fusing consumer SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.465Z: Fusing consumer SqlQuery3.Format into SqlQuery3/SqlQuery3.Stamp
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.492Z: Fusing consumer SqlQuery3.DevNull into SqlQuery3.Format
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.540Z: Fusing consumer SqlQuery3/SqlQuery3.Forget into SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.582Z: Fusing consumer SqlQuery3/SqlQuery3.Debug into SqlQuery3/SqlQuery3.Forget
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.627Z: Fusing consumer SqlQuery3/SqlQuery3.Stamp into SqlQuery3/SqlQuery3.Debug
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.673Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.713Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.757Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.805Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.849Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Read
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.888Z: Unzipping flatten s17-u13 for input s18-reify-value0-c11
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.936Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.983Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.021Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.057Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable1
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.102Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.142Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/left_ExtractJoinFields/Map
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.189Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.229Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_357/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_40/Convert.ConvertTransform/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.277Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_356/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_34/Convert.ConvertTransform/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.318Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_357/ParDo(Calc)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.366Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.403Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.454Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_40/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.500Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/right_ExtractJoinFields/Map
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.548Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_34/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.598Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_356/ParDo(Calc)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.640Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.688Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:19.171Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Create
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:19.277Z: Starting 4 workers in us-central1-b...
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:19.462Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_40/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_357/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_34/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_356/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Write
Oct 28, 2018 9:59:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:29.089Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 9:59:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:29.556Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 9:59:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:30.086Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 9:59:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:32.452Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.774Z: Workers have started successfully.
Oct 28, 2018 10:00:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.685Z: Workers have started successfully.
Oct 28, 2018 10:00:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.616Z: Workers have started successfully.
Oct 28, 2018 10:00:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.570Z: Workers have started successfully.
Oct 28, 2018 10:00:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:23.194Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:23.242Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.196Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.243Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.304Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.348Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:26.894Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:26.937Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:30.888Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:28.722Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:28.768Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:30.688Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:32.552Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.715Z: Workers have started successfully.
Oct 28, 2018 10:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.830Z: Workers have started successfully.
Oct 28, 2018 10:00:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.917Z: Workers have started successfully.
Oct 28, 2018 10:00:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.975Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:35.076Z: Workers have started successfully.
Oct 28, 2018 10:01:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:00.467Z: Cleaning up.
Oct 28, 2018 10:01:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:00.586Z: Stopping worker pool...
Oct 28, 2018 10:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:28.563Z: Cleaning up.
Oct 28, 2018 10:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:28.694Z: Stopping worker pool...
Oct 28, 2018 10:01:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:33.503Z: Cleaning up.
Oct 28, 2018 10:01:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:33.615Z: Stopping worker pool...
Oct 28, 2018 10:02:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:01.522Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Close
Oct 28, 2018 10:02:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:01.616Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 28, 2018 10:02:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:06.344Z: Cleaning up.
Oct 28, 2018 10:02:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:06.461Z: Stopping worker pool...
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T22:03:10.713Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T22:03:10.715Z Waiting for main pipeline to 'finish'
2018-10-28T22:03:10.744Z RUNNING SqlQuery2
2018-10-28T22:03:10.766Z RUNNING SqlQuery1
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T22:03:10.810Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T22:03:10.845Z RUNNING SqlQuery3
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T22:03:10.899Z Waiting for main pipeline to 'finish'
2018-10-28T22:03:10.942Z RUNNING SqlQuery0
2018-10-28T22:03:11.674Z new perf {"snapshots":null,"runtimeSec":43.917,"numEvents":10000000,"eventsPerSec":227702.2565293622,"eventBytesPerSec":2.9227062344877835E7,"numResults":83527,"resultsPerSec":1901.9286381128036,"resultBytesPerSec":30430.858209804857,"startupDelaySec":-174.373,"processingDelaySec":1.155,"shutdownDelaySec":130.456,"timeDilation":22.768859439397044,"errors":null,"jobId":null}
2018-10-28T22:03:11.813Z new perf {"snapshots":null,"runtimeSec":73.098,"numEvents":10000000,"eventsPerSec":136802.64849927495,"eventBytesPerSec":1.7559507743029904E7,"numResults":9200000,"resultsPerSec":125858.43661933295,"resultBytesPerSec":1.264869826807847E7,"startupDelaySec":-175.512,"processingDelaySec":0.715,"shutdownDelaySec":102.414,"timeDilation":13.679580836684998,"errors":null,"jobId":null}
2018-10-28T22:03:11.945Z new perf {"snapshots":null,"runtimeSec":76.89,"numEvents":10000000,"eventsPerSec":130055.92404734036,"eventBytesPerSec":1.6693521875406425E7,"numResults":9200000,"resultsPerSec":119651.45012355312,"resultBytesPerSec":1.2024899804916114E7,"startupDelaySec":-175.525,"processingDelaySec":0.726,"shutdownDelaySec":98.635,"timeDilation":13.0049421251138,"errors":null,"jobId":null}
2018-10-28T22:03:11.988Z new perf {"snapshots":null,"runtimeSec":48.892,"numEvents":10000000,"eventsPerSec":204532.43884480078,"eventBytesPerSec":2.625306587989855E7,"numResults":9054,"resultsPerSec":185.18367013008262,"resultBytesPerSec":5914.362267855681,"startupDelaySec":-113.62,"processingDelaySec":45.134,"shutdownDelaySec":64.728,"timeDilation":20.248711445635276,"errors":null,"jobId":null}
2018-10-28T22:03:26.715Z RUNNING SqlQuery2
2018-10-28T22:03:26.844Z RUNNING SqlQuery1
2018-10-28T22:03:26.984Z RUNNING SqlQuery0
2018-10-28T22:03:27.021Z RUNNING SqlQuery3
2018-10-28T22:03:27.480Z no activity
2018-10-28T22:03:27.621Z no activity
2018-10-28T22:03:27.736Z no activity
2018-10-28T22:03:27.834Z no activity
2018-10-28T22:03:42.513Z RUNNING SqlQuery2
2018-10-28T22:03:42.664Z RUNNING SqlQuery1
2018-10-28T22:03:42.792Z RUNNING SqlQuery0
2018-10-28T22:03:42.863Z RUNNING SqlQuery3
2018-10-28T22:03:43.206Z no activity
2018-10-28T22:03:43.486Z no activity
2018-10-28T22:03:43.493Z no activity
2018-10-28T22:03:43.684Z no activity
2018-10-28T22:03:58.235Z RUNNING SqlQuery2
2018-10-28T22:03:58.513Z RUNNING SqlQuery1
2018-10-28T22:03:58.526Z RUNNING SqlQuery0
2018-10-28T22:03:58.709Z RUNNING SqlQuery3
2018-10-28T22:03:58.966Z no activity
2018-10-28T22:03:59.227Z no activity
2018-10-28T22:03:59.227Z no activity
2018-10-28T22:03:59.517Z no activity
2018-10-28T22:04:14.004Z RUNNING SqlQuery2
2018-10-28T22:04:14.255Z RUNNING SqlQuery0
2018-10-28T22:04:14.255Z RUNNING SqlQuery1
2018-10-28T22:04:14.548Z RUNNING SqlQuery3
2018-10-28T22:04:14.791Z no activity
2018-10-28T22:04:14.991Z no activity
2018-10-28T22:04:15.037Z no activity
2018-10-28T22:04:15.308Z no activity
2018-10-28T22:04:29.821Z DONE SqlQuery2
2018-10-28T22:04:30.022Z RUNNING SqlQuery0
2018-10-28T22:04:30.072Z DONE SqlQuery1
2018-10-28T22:04:30.337Z RUNNING SqlQuery3
2018-10-28T22:04:30.758Z no activity
2018-10-28T22:04:31.115Z no activity
2018-10-28T22:04:45.797Z RUNNING SqlQuery0
2018-10-28T22:04:46.145Z RUNNING SqlQuery3
2018-10-28T22:04:46.534Z no activity
2018-10-28T22:04:47.137Z no activity
2018-10-28T22:05:01.562Z RUNNING SqlQuery0
2018-10-28T22:05:02.168Z RUNNING SqlQuery3
2018-10-28T22:05:02.270Z no activity
2018-10-28T22:05:02.999Z no activity
2018-10-28T22:05:17.307Z DONE SqlQuery0
2018-10-28T22:05:18.030Z RUNNING SqlQuery3
2018-10-28T22:05:18.862Z no activity
2018-10-28T22:05:33.888Z RUNNING SqlQuery3
2018-10-28T22:05:34.811Z no activity
2018-10-28T22:05:49.850Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 6 mins 48.099 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 1s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/sgrsqxo5wmsja
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #849
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/849/display/redirect?page=changes>
Changes:
[coheigea] Move array declarations after the type
------------------------------------------
[...truncated 1.05 MB...]
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.078Z: Fusing consumer Query1/Query1.Stamp into Query1/Query1.Debug
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.080Z: Fusing consumer Query1/Query1.Debug into Query1/Query1.Forget
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.082Z: Fusing consumer Query1/Query1.Monitor into Query1.ReadUnbounded/StripIds
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.085Z: Fusing consumer Query1/justBids/IsBid/ParDo(Anonymous) into Query1/Query1.Snoop
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.087Z: Fusing consumer Query1/justBids/AsBid into Query1/justBids/IsBid/ParDo(Anonymous)
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.308Z: Starting 4 workers...
Oct 28, 2018 8:54:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:56.851Z: Executing operation Query1.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query1.ReadUnbounded/StripIds+Query1/Query1.Monitor+Query1/Query1.Snoop+Query1/justBids/IsBid/ParDo(Anonymous)+Query1/justBids/AsBid+Query1/Query1.ToEuros+Query1/Query1.Forget+Query1/Query1.Debug+Query1/Query1.Stamp+Query1.Format+Query1.DevNull
Oct 28, 2018 8:55:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.247Z: Workers have started successfully.
Oct 28, 2018 8:55:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.234Z: Workers have started successfully.
Oct 28, 2018 8:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:17.756Z: Workers have started successfully.
Oct 28, 2018 8:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.387Z: Workers have started successfully.
Oct 28, 2018 8:55:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:17.936Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:18.671Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.534Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.177Z: Workers have started successfully.
Oct 28, 2018 8:55:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.769Z: Workers have started successfully.
Oct 28, 2018 8:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:25.293Z: Workers have started successfully.
Oct 28, 2018 8:55:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:27.271Z: Workers have started successfully.
Oct 28, 2018 8:55:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:28.739Z: Workers have started successfully.
Oct 28, 2018 8:55:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:30.266Z: Workers have started successfully.
Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.686Z: Cleaning up.
Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.720Z: Worker pool stopped.
Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.732Z: Stopping worker pool...
Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.529Z: Cleaning up.
Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.572Z: Worker pool stopped.
Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.590Z: Stopping worker pool...
Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.606Z: Cleaning up.
Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.661Z: Worker pool stopped.
Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.688Z: Stopping worker pool...
Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.214Z: Cleaning up.
Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.246Z: Worker pool stopped.
Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.262Z: Stopping worker pool...
Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.173Z: Cleaning up.
Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.199Z: Worker pool stopped.
Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.214Z: Stopping worker pool...
Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.500Z: Cleaning up.
Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.531Z: Worker pool stopped.
Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.545Z: Stopping worker pool...
Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.679Z: Cleaning up.
Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.732Z: Worker pool stopped.
Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.755Z: Stopping worker pool...
Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.874Z: Cleaning up.
Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.924Z: Worker pool stopped.
Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.944Z: Stopping worker pool...
Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.440Z: Cleaning up.
Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.472Z: Worker pool stopped.
Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.485Z: Stopping worker pool...
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:32.867Z: Cleaning up.
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:32.911Z: Worker pool stopped.
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.383Z Waiting for main pipeline to 'finish'
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.385Z Waiting for main pipeline to 'finish'
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.405Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.407Z RUNNING Query10
2018-10-28T20:58:33.409Z RUNNING Query0
2018-10-28T20:58:33.432Z RUNNING Query11
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.551Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.559Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.579Z RUNNING Query6
2018-10-28T20:58:33.586Z RUNNING Query2
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.595Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.599Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.616Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.625Z RUNNING Query9
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.626Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.628Z RUNNING Query12
2018-10-28T20:58:33.651Z RUNNING Query5
2018-10-28T20:58:33.661Z RUNNING Query8
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
2018-10-28T20:58:33.668Z Waiting for main pipeline to 'finish'
INFO: 2018-10-28T20:58:32.924Z: Stopping worker pool...
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.722Z RUNNING Query7
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.811Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.846Z RUNNING Query3
2018-10-28T20:58:34.107Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.190Z 1 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2018-10-28T20:54:22.980Z and ran for PT251.209S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Exception in thread "main"
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0.
0006 *** not run ***
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0007 *** at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T20:58:34.228Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.266Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.365Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.383Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.385Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.399Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.445Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.479Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.621Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 8:58:37 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:37.030Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:37.057Z RUNNING Query4
2018-10-28T20:58:37.848Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 8:58:45 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:45.809Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:45.834Z RUNNING Query1
2018-10-28T20:58:46.420Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 4 mins 24.225 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 55s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/3mwxvvkokhe3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #848
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/848/display/redirect>
------------------------------------------
[...truncated 1.09 MB...]
Oct 28, 2018 6:13:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:50.881Z: Fusing consumer Query11/justBids/AsBid into Query11/justBids/IsBid/ParDo(Anonymous)
Oct 28, 2018 6:13:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:51.212Z: Starting 4 workers...
Oct 28, 2018 6:13:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:50.641Z: Starting 4 workers...
Oct 28, 2018 6:13:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:53.683Z: Executing operation Query9/Query9/CoGroupByKey/GBK/ReadStream+Query9/Query9/CoGroupByKey/GBK/MergeBuckets+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull
Oct 28, 2018 6:13:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:53.683Z: Executing operation Query9.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query9.ReadUnbounded/StripIds+Query9/Query9.Monitor+Query9/Query9.Snoop+Query9/Filter/ParDo(Anonymous)+Query9/Query9/Window/Window.Assign+Query9/Query9/justBids/IsBid/ParDo(Anonymous)+Query9/Query9/justNewAuctions/IsNewAuction/ParDo(Anonymous)+Query9/Query9/justBids/AsBid+Query9/Query9/justNewAuctions/AsAuction+Query9/Query9/AuctionById:+Query9/Query9/CoGroupByKey/MakeUnionTable0+Query9/Query9/CoGroupByKey/GBK/WriteStream+Query9/Query9/BidByAuction+Query9/Query9/CoGroupByKey/MakeUnionTable1+Query9/Query9/CoGroupByKey/GBK/WriteStream
Oct 28, 2018 6:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:54.102Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/ReadStream+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 28, 2018 6:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:54.108Z: Executing operation Query11.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query11.ReadUnbounded/StripIds+Query11/Query11.Monitor+Query11/Query11.Snoop+Query11/justBids/IsBid/ParDo(Anonymous)+Query11/justBids/AsBid+Query11/Query11.Rekey+Query11/Window.Into()/Window.Assign+Query11/Count.PerElement/Init/Map+Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/WriteStream
Oct 28, 2018 6:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:54.645Z: Executing operation Query3/CoGroupByKey/ConstructCoGbkResultFn.out0/FromValue/ReadStream+Query3/Query3.Join+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 28, 2018 6:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:54.671Z: Executing operation Query3/CoGroupByKey/GBK/ReadStream+Query3/CoGroupByKey/GBK/MergeBuckets+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/CoGroupByKey/ConstructCoGbkResultFn.out0/FromValue/WriteStream
Oct 28, 2018 6:13:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:13:54.672Z: Executing operation Query3.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query3.ReadUnbounded/StripIds+Query3/Query3.Monitor+Query3/Query3.Snoop+Query3/Window.Into()/Window.Assign+Query3/justNewPersons/IsNewPerson/ParDo(Anonymous)+Query3/justNewAuctions/IsNewAuction/ParDo(Anonymous)+Query3/justNewPersons/AsPerson+Query3/Query3.InState/ParDo(Anonymous)+Query3/PersonById+Query3/justNewAuctions/AsAuction+Query3/CoGroupByKey/MakeUnionTable1+Query3/CoGroupByKey/GBK/WriteStream+Query3/Query3.InCategory/ParDo(Anonymous)+Query3/AuctionBySeller+Query3/CoGroupByKey/MakeUnionTable0+Query3/CoGroupByKey/GBK/WriteStream
Oct 28, 2018 6:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:09.536Z: Workers have started successfully.
Oct 28, 2018 6:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:10.279Z: Workers have started successfully.
Oct 28, 2018 6:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:09.636Z: Workers have started successfully.
Oct 28, 2018 6:14:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:11.920Z: Workers have started successfully.
Oct 28, 2018 6:14:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:13.816Z: Workers have started successfully.
Oct 28, 2018 6:14:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:14.940Z: Workers have started successfully.
Oct 28, 2018 6:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:17.420Z: Workers have started successfully.
Oct 28, 2018 6:14:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:18.842Z: Workers have started successfully.
Oct 28, 2018 6:14:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:27.869Z: Workers have started successfully.
Oct 28, 2018 6:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:33.611Z: Workers have started successfully.
Oct 28, 2018 6:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:33.926Z: Workers have started successfully.
Oct 28, 2018 6:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:33.958Z: Workers have started successfully.
Oct 28, 2018 6:14:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:14:37.107Z: Workers have started successfully.
Oct 28, 2018 6:15:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:33.643Z: Cleaning up.
Oct 28, 2018 6:15:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:33.684Z: Worker pool stopped.
Oct 28, 2018 6:15:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:33.710Z: Stopping worker pool...
Oct 28, 2018 6:15:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:43.892Z: Cleaning up.
Oct 28, 2018 6:15:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:43.926Z: Worker pool stopped.
Oct 28, 2018 6:15:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:43.956Z: Stopping worker pool...
Oct 28, 2018 6:15:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:56.007Z: Cleaning up.
Oct 28, 2018 6:15:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:56.081Z: Worker pool stopped.
Oct 28, 2018 6:15:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:15:56.119Z: Stopping worker pool...
Oct 28, 2018 6:16:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:14.013Z: Cleaning up.
Oct 28, 2018 6:16:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:14.058Z: Worker pool stopped.
Oct 28, 2018 6:16:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:14.077Z: Stopping worker pool...
Oct 28, 2018 6:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:31.438Z: Cleaning up.
Oct 28, 2018 6:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:31.470Z: Worker pool stopped.
Oct 28, 2018 6:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:31.483Z: Stopping worker pool...
Oct 28, 2018 6:16:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:45.114Z: Cleaning up.
Oct 28, 2018 6:16:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:45.136Z: Worker pool stopped.
Oct 28, 2018 6:16:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:45.147Z: Stopping worker pool...
Oct 28, 2018 6:16:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:54.475Z: Cleaning up.
Oct 28, 2018 6:16:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:54.501Z: Worker pool stopped.
Oct 28, 2018 6:16:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:16:54.514Z: Stopping worker pool...
Oct 28, 2018 6:17:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:17:00.369Z: Cleaning up.
Oct 28, 2018 6:17:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:17:00.416Z: Worker pool stopped.
Oct 28, 2018 6:17:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:17:00.433Z: Stopping worker pool...
Oct 28, 2018 6:17:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:17:22.745Z: Cleaning up.
Oct 28, 2018 6:17:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:17:22.778Z: Worker pool stopped.
Oct 28, 2018 6:17:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T18:17:22.792Z: Stopping worker pool...
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.666Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:28.697Z RUNNING Query12
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.762Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.796Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:28.796Z RUNNING Query10
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:28.812Z Waiting for main pipeline to 'finish'
2018-10-28T18:17:28.819Z RUNNING Query0
2018-10-28T18:17:28.843Z RUNNING Query2
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:28.865Z Waiting for main pipeline to 'finish'
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.872Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.878Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.887Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:28.894Z RUNNING Query6
2018-10-28T18:17:28.899Z RUNNING Query8
2018-10-28T18:17:28.910Z RUNNING Query7
2018-10-28T18:17:28.914Z RUNNING Query4
Oct 28, 2018 6:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:28.960Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:28.985Z RUNNING Query5
2018-10-28T18:17:29.442Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.512Z 1 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2018-10-28T18:13:18.339Z and ran for PT251.167S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
Exception in thread "main" ==========================================================================================
java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0.
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T18:17:29.527Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.550Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.614Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.674Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.678Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.722Z 1 samples not enough to calculate steady-state event rate
2018-10-28T18:17:29.827Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:41.666Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:41.690Z RUNNING Query1
2018-10-28T18:17:42.372Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:43 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:43.277Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:43.303Z RUNNING Query3
2018-10-28T18:17:44.142Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:44 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T18:17:44.413Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:44.444Z RUNNING Query9
2018-10-28T18:17:45.150Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:45 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T18:17:45.199Z Waiting for main pipeline to 'finish'
2018-10-28T18:17:45.227Z RUNNING Query11
2018-10-28T18:17:45.915Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 4 mins 28.945 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 2s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/capqtdsgtd47a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #847
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/847/display/redirect>
------------------------------------------
[...truncated 1022.11 KB...]
Oct 28, 2018 12:13:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:38.747Z: Executing operation Query5.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query5.ReadUnbounded/StripIds+Query5/Query5.Monitor+Query5/Query5.Snoop+Query5/justBids/IsBid/ParDo(Anonymous)+Query5/justBids/AsBid+Query5/Window.Into()/Window.Assign+Query5/BidToAuction+Query5/Count.PerElement/Init/Map+Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/WriteStream
Oct 28, 2018 12:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:40.429Z: Executing operation Query2.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query2.ReadUnbounded/StripIds+Query2/Query2.Monitor+Query2/Query2.Snoop+Query2/justBids/IsBid/ParDo(Anonymous)+Query2/justBids/AsBid+Query2/Filter/ParDo(Anonymous)+Query2/Query2.Project+Query2/Query2.Forget+Query2/Query2.Debug+Query2/Query2.Stamp+Query2.Format+Query2.DevNull
Oct 28, 2018 12:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:38.652Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/ReadStream+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull
Oct 28, 2018 12:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:38.656Z: Executing operation Query6/Query6.WinningBids/CoGroupByKey/GBK/ReadStream+Query6/Query6.WinningBids/CoGroupByKey/GBK/MergeBuckets+Query6/Query6.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query6/Query6.WinningBids/Query6.WinningBids.Join+Query6/Query6.Rekey+Query6/Window.Into()/Window.Assign+Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/WriteStream
Oct 28, 2018 12:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:38.658Z: Executing operation Query6.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query6.ReadUnbounded/StripIds+Query6/Query6.Monitor+Query6/Query6.Snoop+Query6/Filter/ParDo(Anonymous)+Query6/Query6.WinningBids/Window/Window.Assign+Query6/Query6.WinningBids/justBids/IsBid/ParDo(Anonymous)+Query6/Query6.WinningBids/justNewAuctions/IsNewAuction/ParDo(Anonymous)+Query6/Query6.WinningBids/justBids/AsBid+Query6/Query6.WinningBids/justNewAuctions/AsAuction+Query6/Query6.WinningBids/AuctionById:+Query6/Query6.WinningBids/CoGroupByKey/MakeUnionTable0+Query6/Query6.WinningBids/CoGroupByKey/GBK/WriteStream+Query6/Query6.WinningBids/BidByAuction+Query6/Query6.WinningBids/CoGroupByKey/MakeUnionTable1+Query6/Query6.WinningBids/CoGroupByKey/GBK/WriteStream
Oct 28, 2018 12:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:39.038Z: Executing operation Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/GroupByKey/ReadStream+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ParDo(StreamingPCollectionViewWriter)
Oct 28, 2018 12:13:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:41.098Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/ReadStream+Query4/Query4.WinningBids/CoGroupByKey/GBK/MergeBuckets+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/WriteStream+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/WriteStream
Oct 28, 2018 12:13:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:41.098Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/ReadStream+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/WriteStream
Oct 28, 2018 12:13:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:41.100Z: Executing operation Query4.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query4.ReadUnbounded/StripIds+Query4/Query4.Monitor+Query4/Query4.Snoop+Query4/Filter/ParDo(Anonymous)+Query4/Query4.WinningBids/Window/Window.Assign+Query4/Query4.WinningBids/justBids/IsBid/ParDo(Anonymous)+Query4/Query4.WinningBids/justNewAuctions/IsNewAuction/ParDo(Anonymous)+Query4/Query4.WinningBids/justBids/AsBid+Query4/Query4.WinningBids/justNewAuctions/AsAuction+Query4/Query4.WinningBids/BidByAuction+Query4/Query4.WinningBids/CoGroupByKey/MakeUnionTable1+Query4/Query4.WinningBids/CoGroupByKey/GBK/WriteStream+Query4/Query4.WinningBids/AuctionById:+Query4/Query4.WinningBids/CoGroupByKey/MakeUnionTable0+Query4/Query4.WinningBids/CoGroupByKey/GBK/WriteStream
Oct 28, 2018 12:13:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:13:41.140Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/ReadStream+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 28, 2018 12:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:09.981Z: Workers have started successfully.
Oct 28, 2018 12:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:10.247Z: Workers have started successfully.
Oct 28, 2018 12:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:11.369Z: Workers have started successfully.
Oct 28, 2018 12:14:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:11.547Z: Workers have started successfully.
Oct 28, 2018 12:14:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:10.947Z: Workers have started successfully.
Oct 28, 2018 12:14:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:11.259Z: Workers have started successfully.
Oct 28, 2018 12:14:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:11.847Z: Workers have started successfully.
Oct 28, 2018 12:14:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:12.104Z: Workers have started successfully.
Oct 28, 2018 12:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:11.009Z: Workers have started successfully.
Oct 28, 2018 12:14:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:13.196Z: Workers have started successfully.
Oct 28, 2018 12:14:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:12.436Z: Workers have started successfully.
Oct 28, 2018 12:14:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:13.864Z: Workers have started successfully.
Oct 28, 2018 12:14:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:14:15.157Z: Workers have started successfully.
Oct 28, 2018 12:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:15:38.621Z: Cleaning up.
Oct 28, 2018 12:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:15:38.655Z: Worker pool stopped.
Oct 28, 2018 12:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:15:38.669Z: Stopping worker pool...
Oct 28, 2018 12:15:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:15:42.599Z: Cleaning up.
Oct 28, 2018 12:15:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:15:42.634Z: Worker pool stopped.
Oct 28, 2018 12:15:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:15:42.647Z: Stopping worker pool...
Oct 28, 2018 12:16:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:02.006Z: Cleaning up.
Oct 28, 2018 12:16:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:02.034Z: Worker pool stopped.
Oct 28, 2018 12:16:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:02.045Z: Stopping worker pool...
Oct 28, 2018 12:16:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:10.590Z: Cleaning up.
Oct 28, 2018 12:16:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:10.618Z: Worker pool stopped.
Oct 28, 2018 12:16:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:10.629Z: Stopping worker pool...
Oct 28, 2018 12:16:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:10.473Z: Cleaning up.
Oct 28, 2018 12:16:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:10.504Z: Worker pool stopped.
Oct 28, 2018 12:16:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:10.517Z: Stopping worker pool...
Oct 28, 2018 12:16:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:11.029Z: Cleaning up.
Oct 28, 2018 12:16:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:11.058Z: Worker pool stopped.
Oct 28, 2018 12:16:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:11.069Z: Stopping worker pool...
Oct 28, 2018 12:16:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:13.330Z: Cleaning up.
Oct 28, 2018 12:16:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:13.363Z: Worker pool stopped.
Oct 28, 2018 12:16:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:13.377Z: Stopping worker pool...
Oct 28, 2018 12:16:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:24.023Z: Cleaning up.
Oct 28, 2018 12:16:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:24.058Z: Worker pool stopped.
Oct 28, 2018 12:16:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:16:24.070Z: Stopping worker pool...
Oct 28, 2018 12:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:17:11.682Z: Cleaning up.
Oct 28, 2018 12:17:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:17:11.701Z: Worker pool stopped.
Oct 28, 2018 12:17:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T12:17:11.712Z: Stopping worker pool...
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.604Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.604Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.606Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.607Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.623Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.627Z RUNNING Query1
2018-10-28T12:17:26.627Z RUNNING Query9
2018-10-28T12:17:26.628Z RUNNING Query8
2018-10-28T12:17:26.631Z RUNNING Query6
2018-10-28T12:17:26.651Z RUNNING Query0
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.688Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.700Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.714Z RUNNING Query5
2018-10-28T12:17:26.729Z RUNNING Query10
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.753Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.777Z RUNNING Query12
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.812Z Waiting for main pipeline to 'finish'
2018-10-28T12:17:26.837Z RUNNING Query11
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.860Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.880Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.883Z RUNNING Query4
Oct 28, 2018 12:17:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:26.901Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:26.908Z RUNNING Query7
2018-10-28T12:17:26.925Z RUNNING Query3
2018-10-28T12:17:27.259Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.274Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.327Z 1 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2018-10-28T12:13:16.022Z and ran for PT251.298S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Exception in thread "main" Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query1. 0006 *** not run ***
0007 *** not run ***
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144) 0008 *** not run ***
0009 *** not run ***
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query1.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T12:17:27.331Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.378Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.403Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.413Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.437Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.466Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.570Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.608Z 1 samples not enough to calculate steady-state event rate
2018-10-28T12:17:27.648Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 12:17:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T12:17:28.127Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T12:17:28.155Z RUNNING Query2
2018-10-28T12:17:28.748Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 4 mins 13.644 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 47s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/qdyrdwlwc5ndw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #846
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/846/display/redirect>
------------------------------------------
[...truncated 1.10 MB...]
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:12.840Z: Fusing consumer Query9/Query9/justNewAuctions/AsAuction into Query9/Query9/justNewAuctions/IsNewAuction/ParDo(Anonymous)
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:12.842Z: Fusing consumer Query9/Query9/CoGroupByKey/MakeUnionTable1 into Query9/Query9/BidByAuction
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:12.844Z: Fusing consumer Query9/Query9/BidByAuction into Query9/Query9/justBids/AsBid
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:12.847Z: Fusing consumer Query9/Query9.Monitor into Query9.ReadUnbounded/StripIds
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:12.849Z: Fusing consumer Query9/Filter/ParDo(Anonymous) into Query9/Query9.Snoop
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:12.851Z: Fusing consumer Query9/Query9/Window/Window.Assign into Query9/Filter/ParDo(Anonymous)
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:13.161Z: Starting 4 workers...
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:13.144Z: Executing operation Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/GroupByKey/ReadStream+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ParDo(StreamingPCollectionViewWriter)
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:13.148Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/ReadStream+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/WriteStream
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:13.148Z: Executing operation Query7/Window.Into()/Window.Assign.out0/FromValue/ReadStream+Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:13.149Z: Executing operation Query7.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query7.ReadUnbounded/StripIds+Query7/Query7.Monitor+Query7/Query7.Snoop+Query7/justBids/IsBid/ParDo(Anonymous)+Query7/justBids/AsBid+Query7/Window.Into()/Window.Assign+Query7/BidToPrice+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/WithKeys/AddKeys/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/AddNonce+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PrepareCold/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/WriteStream+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/WriteStream+Query7/Window.Into()/Window.Assign.out0/FromValue/WriteStream
Oct 28, 2018 6:13:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:13.149Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/ReadStream+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/WithKeys/AddKeys/Map+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/GroupByKey+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)/GroupByKey/WriteStream
Oct 28, 2018 6:13:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:16.212Z: Executing operation Query9/Query9/CoGroupByKey/GBK/ReadStream+Query9/Query9/CoGroupByKey/GBK/MergeBuckets+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull
Oct 28, 2018 6:13:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:16.215Z: Executing operation Query9.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query9.ReadUnbounded/StripIds+Query9/Query9.Monitor+Query9/Query9.Snoop+Query9/Filter/ParDo(Anonymous)+Query9/Query9/Window/Window.Assign+Query9/Query9/justBids/IsBid/ParDo(Anonymous)+Query9/Query9/justNewAuctions/IsNewAuction/ParDo(Anonymous)+Query9/Query9/justBids/AsBid+Query9/Query9/justNewAuctions/AsAuction+Query9/Query9/AuctionById:+Query9/Query9/CoGroupByKey/MakeUnionTable0+Query9/Query9/CoGroupByKey/GBK/WriteStream+Query9/Query9/BidByAuction+Query9/Query9/CoGroupByKey/MakeUnionTable1+Query9/Query9/CoGroupByKey/GBK/WriteStream
Oct 28, 2018 6:13:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:15.454Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/ReadStream+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull
Oct 28, 2018 6:13:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:15.456Z: Executing operation Query12.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query12.ReadUnbounded/StripIds+Query12/Query12.Monitor+Query12/Query12.Snoop+Query12/justBids/IsBid/ParDo(Anonymous)+Query12/justBids/AsBid+Query12/ParDo(Anonymous)+Query12/Window.Into()/Window.Assign+Query12/Count.PerElement/Init/Map+Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/WriteStream
Oct 28, 2018 6:13:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:29.056Z: Workers have started successfully.
Oct 28, 2018 6:13:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:29.729Z: Workers have started successfully.
Oct 28, 2018 6:13:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:29.797Z: Workers have started successfully.
Oct 28, 2018 6:13:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:34.468Z: Workers have started successfully.
Oct 28, 2018 6:13:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:36.590Z: Workers have started successfully.
Oct 28, 2018 6:13:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:37.540Z: Workers have started successfully.
Oct 28, 2018 6:13:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:38.873Z: Workers have started successfully.
Oct 28, 2018 6:13:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:41.230Z: Workers have started successfully.
Oct 28, 2018 6:13:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:43.746Z: Workers have started successfully.
Oct 28, 2018 6:13:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:44.338Z: Workers have started successfully.
Oct 28, 2018 6:13:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:43.394Z: Workers have started successfully.
Oct 28, 2018 6:13:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:47.948Z: Workers have started successfully.
Oct 28, 2018 6:13:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:13:48.138Z: Workers have started successfully.
Oct 28, 2018 6:15:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:14.898Z: Cleaning up.
Oct 28, 2018 6:15:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:14.920Z: Worker pool stopped.
Oct 28, 2018 6:15:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:14.932Z: Stopping worker pool...
Oct 28, 2018 6:15:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:15.771Z: Cleaning up.
Oct 28, 2018 6:15:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:15.791Z: Worker pool stopped.
Oct 28, 2018 6:15:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:15.802Z: Stopping worker pool...
Oct 28, 2018 6:15:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:45.283Z: Cleaning up.
Oct 28, 2018 6:15:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:45.304Z: Worker pool stopped.
Oct 28, 2018 6:15:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:45.315Z: Stopping worker pool...
Oct 28, 2018 6:15:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:50.222Z: Cleaning up.
Oct 28, 2018 6:15:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:50.246Z: Worker pool stopped.
Oct 28, 2018 6:15:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:15:50.258Z: Stopping worker pool...
Oct 28, 2018 6:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:02.234Z: Cleaning up.
Oct 28, 2018 6:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:02.265Z: Worker pool stopped.
Oct 28, 2018 6:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:02.279Z: Stopping worker pool...
Oct 28, 2018 6:16:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:11.650Z: Cleaning up.
Oct 28, 2018 6:16:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:11.680Z: Worker pool stopped.
Oct 28, 2018 6:16:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:11.692Z: Stopping worker pool...
Oct 28, 2018 6:16:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:23.051Z: Cleaning up.
Oct 28, 2018 6:16:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:23.101Z: Worker pool stopped.
Oct 28, 2018 6:16:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T06:16:23.130Z: Stopping worker pool...
Oct 28, 2018 6:16:47 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:47.491Z Waiting for main pipeline to 'finish'
Oct 28, 2018 6:16:47 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:47.494Z Waiting for main pipeline to 'finish'
Oct 28, 2018 6:16:47 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:47.495Z Waiting for main pipeline to 'finish'
2018-10-28T06:16:47.519Z RUNNING Query8
2018-10-28T06:16:47.521Z RUNNING Query4
2018-10-28T06:16:47.536Z RUNNING Query3
Oct 28, 2018 6:16:47 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:47.588Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 6:16:47 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:47.608Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:47.613Z RUNNING Query5
2018-10-28T06:16:47.632Z RUNNING Query6
2018-10-28T06:16:48.304Z 1 samples not enough to calculate steady-state event rate
2018-10-28T06:16:48.326Z 1 samples not enough to calculate steady-state event rate
2018-10-28T06:16:48.368Z 1 samples not enough to calculate steady-state event rate
2018-10-28T06:16:48.369Z 1 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2018-10-28T06:12:36.544Z and ran for PT251.826S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 ***java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query8.
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
not run ***
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query8.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T06:16:48.450Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:16:52 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:52.916Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:52.944Z RUNNING Query11
2018-10-28T06:16:53.640Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:16:54 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:54.901Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:54.926Z RUNNING Query1
2018-10-28T06:16:55.603Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:16:56 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:56.365Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:56.389Z RUNNING Query7
2018-10-28T06:16:57.141Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:16:59 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:59.593Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:59.618Z RUNNING Query2
Oct 28, 2018 6:16:59 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:16:59.843Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:16:59.870Z RUNNING Query0
2018-10-28T06:17:00.242Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:00 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:17:00.355Z Waiting for main pipeline to 'finish'
2018-10-28T06:17:00.388Z RUNNING Query10
2018-10-28T06:17:00.493Z 1 samples not enough to calculate steady-state event rate
2018-10-28T06:17:01.042Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:02 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:17:02.871Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:17:02.899Z RUNNING Query12
2018-10-28T06:17:03.562Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 6:17:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T06:17:05.984Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T06:17:06.011Z RUNNING Query9
2018-10-28T06:17:06.928Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Daemon worker,5,main]) completed. Took 4 mins 31.253 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 4s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/ww4c3ylincgwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #845
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/845/display/redirect>
------------------------------------------
[...truncated 1.15 MB...]
Oct 28, 2018 12:14:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Query1/Query1.Debug as step s9
Oct 28, 2018 12:14:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Query1/Query1.Stamp as step s10
Oct 28, 2018 12:14:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Query1.Format as step s11
Oct 28, 2018 12:14:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Query1.DevNull as step s12
Oct 28, 2018 12:14:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-perf-tests/nexmark/staging/
Oct 28, 2018 12:14:53 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <39613 bytes, hash VLaxU3WcCKEo7UpRgChWfg> to gs://temp-storage-for-perf-tests/nexmark/staging/pipeline-VLaxU3WcCKEo7UpRgChWfg.pb
Dataflow SDK version: 2.9.0-SNAPSHOT
Oct 28, 2018 12:14:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
Submitted job: 2018-10-27_17_14_53-884993445729491414
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-10-27_17_14_53-884993445729491414?project=apache-beam-testing
Oct 28, 2018 12:14:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-10-27_17_14_53-884993445729491414
Oct 28, 2018 12:14:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:14:55.199Z: Workers have started successfully.
Oct 28, 2018 12:14:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:14:56.479Z: Workers have started successfully.
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:14:56.732Z: Checking permissions granted to controller Service Account.
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.093Z: Worker configuration: n1-standard-4 in us-central1-b.
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.561Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.567Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.570Z: Expanding GroupByKey operations into streaming Read/Write steps
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.573Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.593Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.596Z: Fusing consumer Query1.ReadUnbounded/StripIds into Query1.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.598Z: Fusing consumer Query1/Query1.Snoop into Query1/Query1.Monitor
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.601Z: Fusing consumer Query1/Query1.Forget into Query1/Query1.ToEuros
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.603Z: Fusing consumer Query1/Query1.ToEuros into Query1/justBids/AsBid
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.606Z: Fusing consumer Query1.DevNull into Query1.Format
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.608Z: Fusing consumer Query1.Format into Query1/Query1.Stamp
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.611Z: Fusing consumer Query1/Query1.Stamp into Query1/Query1.Debug
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.614Z: Fusing consumer Query1/Query1.Debug into Query1/Query1.Forget
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.616Z: Fusing consumer Query1/Query1.Monitor into Query1.ReadUnbounded/StripIds
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.618Z: Fusing consumer Query1/justBids/IsBid/ParDo(Anonymous) into Query1/Query1.Snoop
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.623Z: Fusing consumer Query1/justBids/AsBid into Query1/justBids/IsBid/ParDo(Anonymous)
Oct 28, 2018 12:15:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:00.849Z: Starting 4 workers...
Oct 28, 2018 12:15:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:06.965Z: Executing operation Query1.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query1.ReadUnbounded/StripIds+Query1/Query1.Monitor+Query1/Query1.Snoop+Query1/justBids/IsBid/ParDo(Anonymous)+Query1/justBids/AsBid+Query1/Query1.ToEuros+Query1/Query1.Forget+Query1/Query1.Debug+Query1/Query1.Stamp+Query1.Format+Query1.DevNull
Oct 28, 2018 12:15:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:15:47.453Z: Workers have started successfully.
Oct 28, 2018 12:16:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:33.792Z: Cleaning up.
Oct 28, 2018 12:16:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:33.814Z: Worker pool stopped.
Oct 28, 2018 12:16:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:33.826Z: Stopping worker pool...
Oct 28, 2018 12:16:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:34.847Z: Cleaning up.
Oct 28, 2018 12:16:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:34.878Z: Worker pool stopped.
Oct 28, 2018 12:16:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:34.894Z: Stopping worker pool...
Oct 28, 2018 12:16:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:37.328Z: Cleaning up.
Oct 28, 2018 12:16:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:37.352Z: Worker pool stopped.
Oct 28, 2018 12:16:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:37.363Z: Stopping worker pool...
Oct 28, 2018 12:16:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:46.460Z: Cleaning up.
Oct 28, 2018 12:16:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:46.482Z: Worker pool stopped.
Oct 28, 2018 12:16:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:16:46.494Z: Stopping worker pool...
Oct 28, 2018 12:17:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:17:06.861Z: Cleaning up.
Oct 28, 2018 12:17:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:17:06.978Z: Worker pool stopped.
Oct 28, 2018 12:17:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:17:07.002Z: Stopping worker pool...
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T00:17:27.373Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.375Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.376Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.392Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.395Z Waiting for main pipeline to 'finish'
2018-10-28T00:17:27.401Z RUNNING Query9
2018-10-28T00:17:27.404Z RUNNING Query5
2018-10-28T00:17:27.405Z RUNNING Query11
2018-10-28T00:17:27.418Z RUNNING Query6
2018-10-28T00:17:27.420Z RUNNING Query2
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T00:17:27.439Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.468Z RUNNING Query10
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.479Z Waiting for main pipeline to 'finish'
2018-10-28T00:17:27.509Z RUNNING Query3
2018-10-28T00:17:27.537Z Waiting for main pipeline to 'finish'
Oct 28, 2018 12:17:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:27.567Z RUNNING Query7
==========================================================================================
Run started 2018-10-28T00:13:16.646Z and ran for PT251.152S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: result.elements in namespace Query10.Results.
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name: result.elements in namespace Query10.Results.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:257)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T00:17:28.106Z 1 samples not enough to calculate steady-state event rate
2018-10-28T00:17:28.175Z 1 samples not enough to calculate steady-state event rate
2018-10-28T00:17:28.180Z 1 samples not enough to calculate steady-state event rate
2018-10-28T00:17:28.217Z 1 samples not enough to calculate steady-state event rate
2018-10-28T00:17:28.247Z 1 samples not enough to calculate steady-state event rate
2018-10-28T00:17:28.248Z 1 samples not enough to calculate steady-state event rate
2018-10-28T00:17:28.327Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 12:17:33 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T00:17:33.589Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:33.615Z RUNNING Query0
2018-10-28T00:17:34.234Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 12:17:38 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T00:17:38.680Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:38.704Z RUNNING Query8
2018-10-28T00:17:39.391Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 12:17:39 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T00:17:39.606Z WARNING: No terminal state was returned. State value RUNNING
Waiting for main pipeline to 'finish'
2018-10-28T00:17:39.636Z RUNNING Query12
2018-10-28T00:17:40.315Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 12:17:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:17:44.669Z Waiting for main pipeline to 'finish'
2018-10-28T00:17:44.702Z RUNNING Query4
Oct 28, 2018 12:18:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:18:22.233Z: Cleaning up.
Oct 28, 2018 12:18:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:18:22.295Z: Worker pool stopped.
Oct 28, 2018 12:18:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T00:18:22.331Z: Stopping worker pool...
Oct 28, 2018 12:18:54 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T00:18:54.901Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T00:18:54.930Z RUNNING Query1
2018-10-28T00:18:55.592Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 5 mins 39.752 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 12s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/2roau4bt3jqro
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #844
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/844/display/redirect?page=changes>
Changes:
[lukasz.gajowy] [BEAM-5875] Add missing dependency in test-utils module
------------------------------------------
[...truncated 1.02 MB...]
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.726Z: Fusing consumer Query0/Query0.Snoop into Query0/Query0.Monitor
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.728Z: Fusing consumer Query0/Query0.Stamp into Query0/Query0.Debug
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.730Z: Fusing consumer Query0/Query0.Debug into Query0/Query0.Forget
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.732Z: Fusing consumer Query0.DevNull into Query0.Format
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.734Z: Fusing consumer Query0.Format into Query0/Query0.Stamp
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.736Z: Fusing consumer Query0/Query0.Monitor into Query0.ReadUnbounded/StripIds
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.738Z: Fusing consumer Query0/Query0.Serialize into Query0/Query0.Snoop
Oct 27, 2018 9:49:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.740Z: Fusing consumer Query0/Query0.Forget into Query0/Query0.Serialize
Oct 27, 2018 9:49:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:52.959Z: Starting 4 workers...
Oct 27, 2018 9:50:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:49:58.841Z: Executing operation Query0.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query0.ReadUnbounded/StripIds+Query0/Query0.Monitor+Query0/Query0.Snoop+Query0/Query0.Serialize+Query0/Query0.Forget+Query0/Query0.Debug+Query0/Query0.Stamp+Query0.Format+Query0.DevNull
Oct 27, 2018 9:50:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:14.876Z: Workers have started successfully.
Oct 27, 2018 9:50:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:14.673Z: Workers have started successfully.
Oct 27, 2018 9:50:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:14.069Z: Workers have started successfully.
Oct 27, 2018 9:50:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:15.635Z: Workers have started successfully.
Oct 27, 2018 9:50:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:15.180Z: Workers have started successfully.
Oct 27, 2018 9:50:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:17.009Z: Workers have started successfully.
Oct 27, 2018 9:50:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:18.454Z: Workers have started successfully.
Oct 27, 2018 9:50:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:19.576Z: Workers have started successfully.
Oct 27, 2018 9:50:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:21.383Z: Workers have started successfully.
Oct 27, 2018 9:50:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:22.213Z: Workers have started successfully.
Oct 27, 2018 9:50:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:32.103Z: Workers have started successfully.
Oct 27, 2018 9:50:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:33.806Z: Workers have started successfully.
Oct 27, 2018 9:50:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:50:35.019Z: Workers have started successfully.
Oct 27, 2018 9:52:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:05.826Z: Cleaning up.
Oct 27, 2018 9:52:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:05.863Z: Worker pool stopped.
Oct 27, 2018 9:52:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:05.877Z: Stopping worker pool...
Oct 27, 2018 9:52:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:19.834Z: Cleaning up.
Oct 27, 2018 9:52:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:19.854Z: Worker pool stopped.
Oct 27, 2018 9:52:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:19.865Z: Stopping worker pool...
Oct 27, 2018 9:52:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:23.765Z: Cleaning up.
Oct 27, 2018 9:52:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:23.804Z: Worker pool stopped.
Oct 27, 2018 9:52:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:23.822Z: Stopping worker pool...
Oct 27, 2018 9:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:24.305Z: Cleaning up.
Oct 27, 2018 9:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:24.332Z: Worker pool stopped.
Oct 27, 2018 9:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:24.344Z: Stopping worker pool...
Oct 27, 2018 9:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:26.353Z: Cleaning up.
Oct 27, 2018 9:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:26.382Z: Worker pool stopped.
Oct 27, 2018 9:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:26.394Z: Stopping worker pool...
Oct 27, 2018 9:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:34.049Z: Cleaning up.
Oct 27, 2018 9:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:34.078Z: Worker pool stopped.
Oct 27, 2018 9:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:34.092Z: Stopping worker pool...
Oct 27, 2018 9:52:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:34.763Z: Cleaning up.
Oct 27, 2018 9:52:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:34.795Z: Worker pool stopped.
Oct 27, 2018 9:52:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:52:34.811Z: Stopping worker pool...
Oct 27, 2018 9:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:53:01.784Z: Cleaning up.
Oct 27, 2018 9:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:53:01.812Z: Worker pool stopped.
Oct 27, 2018 9:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:53:01.825Z: Stopping worker pool...
Oct 27, 2018 9:53:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:53:27.904Z: Cleaning up.
Oct 27, 2018 9:53:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:53:27.936Z: Worker pool stopped.
Oct 27, 2018 9:53:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T21:53:27.949Z: Stopping worker pool...
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:32.751Z Waiting for main pipeline to 'finish'
2018-10-27T21:53:32.781Z RUNNING Query8
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:32.788Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:32.818Z RUNNING Query11
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:32.870Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:32.894Z RUNNING Query4
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:32.943Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:32.944Z Waiting for main pipeline to 'finish'
2018-10-27T21:53:32.967Z RUNNING Query10
2018-10-27T21:53:32.967Z RUNNING Query1
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:32.989Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 9:53:32 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:32.995Z Waiting for main pipeline to 'finish'
2018-10-27T21:53:33.023Z RUNNING Query5
2018-10-27T21:53:33.026Z RUNNING Query9
Oct 27, 2018 9:53:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:33.049Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:33.077Z RUNNING Query3
2018-10-27T21:53:33.563Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:33.584Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:33.592Z 1 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2018-10-27T21:49:22.179Z and ran for PT251.450S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query11.
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query11.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-27T21:53:33.645Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:33.689Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:33.717Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:33.766Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:33.788Z 1 samples not enough to calculate steady-state event rate
Oct 27, 2018 9:53:34 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:34.507Z Waiting for main pipeline to 'finish'
2018-10-27T21:53:34.539Z RUNNING Query7
2018-10-27T21:53:35.259Z 1 samples not enough to calculate steady-state event rate
Oct 27, 2018 9:53:36 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:36.474Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:36.502Z RUNNING Query6
2018-10-27T21:53:37.221Z 1 samples not enough to calculate steady-state event rate
2018-10-27T21:53:39.776Z Waiting for main pipeline to 'finish'
Oct 27, 2018 9:53:39 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:39.800Z RUNNING Query12
2018-10-27T21:53:40.488Z 1 samples not enough to calculate steady-state event rate
Oct 27, 2018 9:53:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:40.567Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:40.589Z RUNNING Query2
2018-10-27T21:53:41.159Z 1 samples not enough to calculate steady-state event rate
Oct 27, 2018 9:53:47 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T21:53:47.371Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T21:53:47.400Z RUNNING Query0
2018-10-27T21:53:48.184Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 4 mins 26.796 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 2s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/fwmfgjfi7vxh4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #843
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/843/display/redirect>
------------------------------------------
[...truncated 623.99 KB...]
INFO: 2018-10-27T18:05:40.532Z: Cleaning up.
Oct 27, 2018 6:05:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:40.652Z: Stopping worker pool...
Oct 27, 2018 6:05:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:43.369Z: Cleaning up.
Oct 27, 2018 6:05:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:43.463Z: Stopping worker pool...
Oct 27, 2018 6:05:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:52.688Z: Executing operation Query3/CoGroupByKey/GBK/Close
Oct 27, 2018 6:05:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:52.779Z: Executing operation Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 27, 2018 6:05:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:53.187Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 6:05:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:53.292Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull
Oct 27, 2018 6:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:57.311Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 27, 2018 6:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:57.404Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 27, 2018 6:05:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:57.346Z: Cleaning up.
Oct 27, 2018 6:05:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:05:57.451Z: Stopping worker pool...
Oct 27, 2018 6:06:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:01.296Z: Cleaning up.
Oct 27, 2018 6:06:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:01.418Z: Stopping worker pool...
Oct 27, 2018 6:06:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:03.765Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 6:06:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:03.864Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 27, 2018 6:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:04.827Z: Executing operation Query10/Query10.GroupByKey/Close
Oct 27, 2018 6:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:04.922Z: Executing operation Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 27, 2018 6:06:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:12.740Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Close
Oct 27, 2018 6:06:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:12.840Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Read+Query9/Query9/CoGroupByKey/GBK/GroupByWindow+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull
Oct 27, 2018 6:06:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:14.196Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 6:06:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:14.339Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 6:06:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:16.929Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 6:06:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:17.016Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 27, 2018 6:06:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:17.413Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Close
Oct 27, 2018 6:06:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:17.526Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Read+Query4/Query4.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 6:06:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:19.661Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 27, 2018 6:06:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:19.770Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 27, 2018 6:06:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:21.030Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 27, 2018 6:06:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:21.139Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 27, 2018 6:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:21.643Z: Cleaning up.
Oct 27, 2018 6:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:21.761Z: Stopping worker pool...
Oct 27, 2018 6:06:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:24.674Z: Executing operation Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 27, 2018 6:06:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:24.890Z: Executing operation Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 27, 2018 6:06:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:31.368Z: Cleaning up.
Oct 27, 2018 6:06:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:31.606Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 6:06:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:31.476Z: Stopping worker pool...
Oct 27, 2018 6:06:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:31.734Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 27, 2018 6:06:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:34.700Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 6:06:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:34.857Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write
Oct 27, 2018 6:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:36.955Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close
Oct 27, 2018 6:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:37.091Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 27, 2018 6:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:37.881Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 27, 2018 6:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:37.966Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 27, 2018 6:06:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:38.916Z: Cleaning up.
Oct 27, 2018 6:06:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:39.018Z: Stopping worker pool...
Oct 27, 2018 6:06:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:40.773Z: Executing operation Query10/Query10.GroupByKey2/Close
Oct 27, 2018 6:06:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:40.871Z: Executing operation Query10/Query10.GroupByKey2/Read+Query10/Query10.GroupByKey2/GroupByWindow+Query10/Query10.Index+Query10/Query10.Forget+Query10/Query10.Debug+Query10/Query10.Stamp+Query10.Format+Query10.DevNull
Oct 27, 2018 6:06:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:39.197Z: Cleaning up.
Oct 27, 2018 6:06:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:39.415Z: Stopping worker pool...
Oct 27, 2018 6:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:42.301Z: Cleaning up.
Oct 27, 2018 6:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:42.412Z: Stopping worker pool...
Oct 27, 2018 6:06:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:52.615Z: Cleaning up.
Oct 27, 2018 6:06:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T18:06:52.754Z: Stopping worker pool...
Oct 27, 2018 6:07:07 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:07.659Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 6:07:07 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:07.679Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:07.697Z RUNNING Query1
2018-10-27T18:07:07.713Z RUNNING Query12
==========================================================================================
Run started 2018-10-27T18:02:55.367Z and ran for PT252.455S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
Oct 27, 2018 6:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:08.136Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:08.169Z RUNNING Query4
Oct 27, 2018 6:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:08.398Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:08.443Z RUNNING Query7
Oct 27, 2018 6:07:16 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:16.996Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 6:07:17 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:17.024Z RUNNING Query10
2018-10-27T18:07:17.024Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:17.060Z RUNNING Query3
Oct 27, 2018 6:07:18 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:18.127Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:18.157Z RUNNING Query11
Oct 27, 2018 6:07:18 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:18.280Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:18.314Z RUNNING Query8
2018-10-27T18:07:21.191Z Waiting for main pipeline to 'finish'
Oct 27, 2018 6:07:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:21.225Z RUNNING Query2
Oct 27, 2018 6:07:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:21.619Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:21.647Z RUNNING Query0
Oct 27, 2018 6:07:23 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:23.087Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 6:07:23 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:23.115Z Waiting for main pipeline to 'finish'
2018-10-27T18:07:23.118Z RUNNING Query5
2018-10-27T18:07:23.144Z RUNNING Query9
Oct 27, 2018 6:07:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T18:07:33.691Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T18:07:33.730Z RUNNING Query6
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 4 mins 39.693 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 27s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ecppf5kmajfd6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #842
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/842/display/redirect>
------------------------------------------
[...truncated 548.28 KB...]
INFO: 2018-10-27T12:06:02.141Z: Executing operation Query3/CoGroupByKey/GBK/Close
Oct 27, 2018 12:06:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:02.225Z: Executing operation Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 27, 2018 12:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:07.186Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 27, 2018 12:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:07.272Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 27, 2018 12:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:05.300Z: Executing operation Query8/CoGroupByKey/GBK/Close
Oct 27, 2018 12:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:05.383Z: Executing operation Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:09.503Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Close
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:09.587Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Read+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Extract+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:11.433Z: Cleaning up.
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:11.530Z: Stopping worker pool...
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:11.684Z: Cleaning up.
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:11.786Z: Stopping worker pool...
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:10.757Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:10.853Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:09.725Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 12:06:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:09.876Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 27, 2018 12:06:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:13.486Z: Cleaning up.
Oct 27, 2018 12:06:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:13.597Z: Stopping worker pool...
Oct 27, 2018 12:06:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:13.802Z: Cleaning up.
Oct 27, 2018 12:06:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:13.905Z: Stopping worker pool...
Oct 27, 2018 12:06:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:14.731Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 12:06:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:14.838Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write
Oct 27, 2018 12:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:17.877Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 12:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:17.996Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull
Oct 27, 2018 12:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:16.831Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close
Oct 27, 2018 12:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:16.932Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 27, 2018 12:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:17.713Z: Cleaning up.
Oct 27, 2018 12:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:17.852Z: Stopping worker pool...
Oct 27, 2018 12:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:21.535Z: Cleaning up.
Oct 27, 2018 12:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:21.663Z: Stopping worker pool...
Oct 27, 2018 12:06:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:28.176Z: Cleaning up.
Oct 27, 2018 12:06:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:28.288Z: Stopping worker pool...
Oct 27, 2018 12:06:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:29.642Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 12:06:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:29.734Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 27, 2018 12:06:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:35.458Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 27, 2018 12:06:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:35.546Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 27, 2018 12:06:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:37.313Z: Cleaning up.
Oct 27, 2018 12:06:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:37.417Z: Stopping worker pool...
Oct 27, 2018 12:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:37.153Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 12:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:37.246Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 27, 2018 12:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:38.561Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 27, 2018 12:06:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:38.654Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 27, 2018 12:06:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:38.594Z: Executing operation Query10/Query10.GroupByKey/Close
Oct 27, 2018 12:06:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:38.699Z: Executing operation Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 27, 2018 12:06:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:40.159Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 27, 2018 12:06:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:40.258Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 27, 2018 12:06:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:44.943Z: Executing operation Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 27, 2018 12:06:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:06:45.156Z: Executing operation Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.191Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:08.222Z RUNNING Query2
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.268Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:08.294Z RUNNING Query8
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.332Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
==========================================================================================
Run started 2018-10-27T12:02:55.831Z and ran for PT252.502S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Exception in thread "main"
java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
Configurations:
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
Conf Description
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
2018-10-27T12:07:08.367Z RUNNING Query5
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.414Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.420Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.439Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:08.447Z RUNNING Query0
2018-10-27T12:07:08.449Z RUNNING Query6
2018-10-27T12:07:08.462Z RUNNING Query9
Oct 27, 2018 12:07:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:08.575Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:08.605Z RUNNING Query3
Oct 27, 2018 12:07:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:07:12.661Z: Cleaning up.
Oct 27, 2018 12:07:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:07:12.779Z: Stopping worker pool...
Oct 27, 2018 12:07:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:07:12.449Z: Executing operation Query10/Query10.GroupByKey2/Close
Oct 27, 2018 12:07:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:07:12.551Z: Executing operation Query10/Query10.GroupByKey2/Read+Query10/Query10.GroupByKey2/GroupByWindow+Query10/Query10.Index+Query10/Query10.Forget+Query10/Query10.Debug+Query10/Query10.Stamp+Query10.Format+Query10.DevNull
Oct 27, 2018 12:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:14.588Z Waiting for main pipeline to 'finish'
2018-10-27T12:07:14.618Z RUNNING Query12
Oct 27, 2018 12:07:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:07:14.799Z: Cleaning up.
Oct 27, 2018 12:07:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T12:07:14.922Z: Stopping worker pool...
Oct 27, 2018 12:07:15 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:15.340Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:15.366Z RUNNING Query1
Oct 27, 2018 12:07:15 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:15.423Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:15.451Z RUNNING Query10
Oct 27, 2018 12:07:18 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:18.251Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:18.281Z RUNNING Query11
Oct 27, 2018 12:07:19 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:19.397Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:19.447Z RUNNING Query4
Oct 27, 2018 12:07:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T12:07:26.177Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T12:07:26.212Z RUNNING Query7
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 4 mins 31.326 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 20s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/nkqny5bazmlke
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #841
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/841/display/redirect>
------------------------------------------
[...truncated 589.25 KB...]
INFO: 2018-10-27T06:05:46.872Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Close
Oct 27, 2018 6:05:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:46.971Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Read+Query4/Query4.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 6:05:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:50.885Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 6:05:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:51.009Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull
Oct 27, 2018 6:05:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:53.968Z: Executing operation Query8/CoGroupByKey/GBK/Close
Oct 27, 2018 6:05:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:54.052Z: Executing operation Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull
Oct 27, 2018 6:05:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:55.052Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 6:05:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:55.166Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 6:05:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:55.799Z: Cleaning up.
Oct 27, 2018 6:05:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:55.912Z: Stopping worker pool...
Oct 27, 2018 6:05:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:55.422Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 6:05:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:55.541Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 27, 2018 6:05:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:57.394Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Close
Oct 27, 2018 6:05:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:05:57.480Z: Executing operation Query6/Combine.perKey(MovingMeanSellingPrice)/GroupByKey/Read+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues+Query6/Combine.perKey(MovingMeanSellingPrice)/Combine.GroupedValues/Extract+Query6/Query6.Select+Query6/Query6.Forget+Query6/Query6.Debug+Query6/Query6.Stamp+Query6.Format+Query6.DevNull
Oct 27, 2018 6:06:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:00.375Z: Cleaning up.
Oct 27, 2018 6:06:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:00.484Z: Stopping worker pool...
Oct 27, 2018 6:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:00.884Z: Cleaning up.
Oct 27, 2018 6:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:00.989Z: Stopping worker pool...
Oct 27, 2018 6:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:01.345Z: Executing operation Query3/CoGroupByKey/GBK/Close
Oct 27, 2018 6:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:01.449Z: Executing operation Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 27, 2018 6:06:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:03.452Z: Cleaning up.
Oct 27, 2018 6:06:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:03.567Z: Stopping worker pool...
Oct 27, 2018 6:06:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:03.413Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 6:06:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:03.509Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write
Oct 27, 2018 6:06:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:04.927Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close
Oct 27, 2018 6:06:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:05.044Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 27, 2018 6:06:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:07.554Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 27, 2018 6:06:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:07.641Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 27, 2018 6:06:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:06.699Z: Cleaning up.
Oct 27, 2018 6:06:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:06.809Z: Stopping worker pool...
Oct 27, 2018 6:06:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:11.412Z: Cleaning up.
Oct 27, 2018 6:06:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:11.514Z: Stopping worker pool...
Oct 27, 2018 6:06:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:14.303Z: Cleaning up.
Oct 27, 2018 6:06:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:14.416Z: Stopping worker pool...
Oct 27, 2018 6:06:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:13.249Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 6:06:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:13.359Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 27, 2018 6:06:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:17.491Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 27, 2018 6:06:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:17.618Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 27, 2018 6:06:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:19.345Z: Cleaning up.
Oct 27, 2018 6:06:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:19.465Z: Stopping worker pool...
Oct 27, 2018 6:06:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:26.467Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 6:06:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:26.578Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 27, 2018 6:06:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:29.168Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 27, 2018 6:06:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:29.265Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 27, 2018 6:06:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:29.768Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 27, 2018 6:06:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:29.873Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 27, 2018 6:06:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:33.454Z: Executing operation Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 27, 2018 6:06:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:33.645Z: Executing operation Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 27, 2018 6:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:35.623Z: Executing operation Query10/Query10.GroupByKey/Close
Oct 27, 2018 6:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:06:35.741Z: Executing operation Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 27, 2018 6:07:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:07:00.184Z: Cleaning up.
Oct 27, 2018 6:07:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:07:00.287Z: Stopping worker pool...
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:07.359Z Waiting for main pipeline to 'finish'
2018-10-27T06:07:07.388Z RUNNING Query11
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:07:06.879Z: Executing operation Query10/Query10.GroupByKey2/Close
2018-10-27T06:07:07.427Z Waiting for main pipeline to 'finish'
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T06:07:07.001Z: Executing operation Query10/Query10.GroupByKey2/Read+Query10/Query10.GroupByKey2/GroupByWindow+Query10/Query10.Index+Query10/Query10.Forget+Query10/Query10.Debug+Query10/Query10.Stamp+Query10.Format+Query10.DevNull
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:07.454Z RUNNING Query10
==========================================================================================
Run started 2018-10-27T06:02:55.543Z and ran for PT251.956S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:07.527Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:07.555Z RUNNING Query6
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:07.586Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:07.611Z RUNNING Query12
Oct 27, 2018 6:07:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:07.874Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:07.902Z RUNNING Query4
Oct 27, 2018 6:07:08 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:08.047Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:08.073Z RUNNING Query1
Oct 27, 2018 6:07:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:11.116Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:11.143Z RUNNING Query2
2018-10-27T06:07:14.956Z Waiting for main pipeline to 'finish'
Oct 27, 2018 6:07:14 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:14.985Z RUNNING Query7
Oct 27, 2018 6:07:16 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:16.285Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:16.318Z RUNNING Query5
Oct 27, 2018 6:07:16 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:16.509Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:16.543Z RUNNING Query9
Oct 27, 2018 6:07:19 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:19.025Z Waiting for main pipeline to 'finish'
2018-10-27T06:07:19.214Z RUNNING Query0
Oct 27, 2018 6:07:20 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T06:07:20.090Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:20.122Z RUNNING Query3
2018-10-27T06:07:24.107Z Waiting for main pipeline to 'finish'
Oct 27, 2018 6:07:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T06:07:24.147Z RUNNING Query8
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 4 mins 29.548 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 18s
68 actionable tasks: 64 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/tuqtjvqdvxsf4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #840
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/840/display/redirect?page=changes>
Changes:
[relax] Switch SQL over to use the new Beam Group transform.
------------------------------------------
[...truncated 675.36 KB...]
INFO: 2018-10-27T05:47:12.917Z: Executing operation Query3/CoGroupByKey/GBK/Close
Oct 27, 2018 5:47:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:13.023Z: Executing operation Query3/CoGroupByKey/GBK/Read+Query3/CoGroupByKey/GBK/GroupByWindow+Query3/CoGroupByKey/ConstructCoGbkResultFn+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/ReifyWindows+Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Write
Oct 27, 2018 5:47:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:17.244Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Close
Oct 27, 2018 5:47:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:17.940Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Close
Oct 27, 2018 5:47:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:18.043Z: Executing operation Query3/Query3.Join/BatchStatefulParDoOverrides.GbkBeforeStatefulParDo/PartitionKeys/Read+Query3/Query3.Join/ParDo(BatchStateful)+Query3/Query3.Project+Query3/Query3.Forget+Query3/Query3.Debug+Query3/Query3.Stamp+Query3.Format+Query3.DevNull
Oct 27, 2018 5:47:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:17.339Z: Executing operation Query4/Query4.WinningBids/CoGroupByKey/GBK/Read+Query4/Query4.WinningBids/CoGroupByKey/GBK/GroupByWindow+Query4/Query4.WinningBids/CoGroupByKey/ConstructCoGbkResultFn+Query4/Query4.WinningBids/Query4.WinningBids.Join+Query4/Query4.WinningBidsMonitor+Query4/Query4.Rekey+Query4/Window.Into()/Window.Assign+Query4/Combine.perKeyWithFanout(Mean)/AddNonce+Query4/Combine.perKeyWithFanout(Mean)/PrepareCold/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 5:47:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:23.074Z: Cleaning up.
Oct 27, 2018 5:47:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:23.745Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Close
Oct 27, 2018 5:47:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:23.843Z: Executing operation Query9/Query9/CoGroupByKey/GBK/Read+Query9/Query9/CoGroupByKey/GBK/GroupByWindow+Query9/Query9/CoGroupByKey/ConstructCoGbkResultFn+Query9/Query9/Query9.Join+Query9/Query9.Forget+Query9/Query9.Debug+Query9/Query9.Stamp+Query9.Format+Query9.DevNull
Oct 27, 2018 5:47:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:23.177Z: Stopping worker pool...
Oct 27, 2018 5:47:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:26.877Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 5:47:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:26.993Z: Executing operation Query12/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query12/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+Query12/Query12.ToResult+Query12/Query12.Forget+Query12/Query12.Debug+Query12/Query12.Stamp+Query12.Format+Query12.DevNull
Oct 27, 2018 5:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:28.409Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 5:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:28.503Z: Executing operation Query5/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query5/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query5/Query5.ToSingletons+Query5/Combine.globally(Anonymous)/WithKeys/AddKeys/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/AddNonce+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PrepareCold/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Write
Oct 27, 2018 5:47:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:29.442Z: Executing operation Query8/CoGroupByKey/GBK/Close
Oct 27, 2018 5:47:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:29.548Z: Executing operation Query8/CoGroupByKey/GBK/Read+Query8/CoGroupByKey/GBK/GroupByWindow+Query8/CoGroupByKey/ConstructCoGbkResultFn+Query8/Query8.Select+Query8/Query8.Forget+Query8/Query8.Debug+Query8/Query8.Stamp+Query8.Format+Query8.DevNull
Oct 27, 2018 5:47:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:30.739Z: Cleaning up.
Oct 27, 2018 5:47:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:30.856Z: Stopping worker pool...
Oct 27, 2018 5:47:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:32.865Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Oct 27, 2018 5:47:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:32.977Z: Executing operation Query11/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+Query11/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+Query11/Query11.ToResult+Query11/Query11.Forget+Query11/Query11.Debug+Query11/Query11.Stamp+Query11.Format+Query11.DevNull
Oct 27, 2018 5:47:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:34.031Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 5:47:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:34.125Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PreCombineHot/Combine.GroupedValues+Query4/Combine.perKeyWithFanout(Mean)/StripNonce/Map+Query4/Combine.perKeyWithFanout(Mean)/Window.Remerge/Identity/Map+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Reify+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Write
Oct 27, 2018 5:47:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:35.758Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Close
Oct 27, 2018 5:47:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:35.850Z: Executing operation Query4/Combine.perKeyWithFanout(Mean)/PostCombine/GroupByKey/Read+Query4/Combine.perKeyWithFanout(Mean)/PostCombine/Combine.GroupedValues+Query4/Query4.Project+Query4/Query4.Forget+Query4/Query4.Debug+Query4/Query4.Stamp+Query4.Format+Query4.DevNull
Oct 27, 2018 5:47:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:36.623Z: Cleaning up.
Oct 27, 2018 5:47:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:36.731Z: Stopping worker pool...
Oct 27, 2018 5:47:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:38.789Z: Cleaning up.
Oct 27, 2018 5:47:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:38.892Z: Stopping worker pool...
Oct 27, 2018 5:47:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:40.783Z: Cleaning up.
Oct 27, 2018 5:47:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:40.880Z: Stopping worker pool...
Oct 27, 2018 5:47:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:47.456Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 5:47:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:47.583Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PreCombineHot/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/StripNonce/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/Window.Remerge/Identity/Map+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Partial+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Reify+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Write
Oct 27, 2018 5:47:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:46.446Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Close
Oct 27, 2018 5:47:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:46.573Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PreCombineHot/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/StripNonce/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/Window.Remerge/Identity/Map+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Reify+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Write
Oct 27, 2018 5:47:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:49.340Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Close
Oct 27, 2018 5:47:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:49.455Z: Executing operation Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/GroupByKey/Read+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Combine.perKeyWithFanout(MaxLong)/PostCombine/Combine.GroupedValues/Extract+Query7/Combine.GloballyAsSingletonView/Combine.globally(MaxLong)/Values/Values/Map+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Oct 27, 2018 5:47:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:50.908Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Oct 27, 2018 5:47:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:51.014Z: Executing operation Query7/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+Query7/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Oct 27, 2018 5:47:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:53.155Z: Cleaning up.
Oct 27, 2018 5:47:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:52.339Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Close
Oct 27, 2018 5:47:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:52.430Z: Executing operation Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/GroupByKey/Read+Query5/Combine.globally(Anonymous)/Combine.perKeyWithFanout(Anonymous)/PostCombine/Combine.GroupedValues+Query5/Combine.globally(Anonymous)/Values/Values/Map+Query5/Query5.Select+Query5/Query5.Forget+Query5/Query5.Debug+Query5/Query5.Stamp+Query5.Format+Query5.DevNull
Oct 27, 2018 5:47:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:54.348Z: Cleaning up.
Oct 27, 2018 5:47:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:54.456Z: Stopping worker pool...
Oct 27, 2018 5:47:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:53.276Z: Stopping worker pool...
Oct 27, 2018 5:47:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:55.687Z: Executing operation Query7/Combine.GloballyAsSingletonView/CreateDataflowView
Oct 27, 2018 5:47:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:55.893Z: Executing operation Query7/Query7.Select+Query7/Query7.Forget+Query7/Query7.Debug+Query7/Query7.Stamp+Query7.Format+Query7.DevNull
Oct 27, 2018 5:48:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:58.862Z: Executing operation Query10/Query10.GroupByKey/Close
Oct 27, 2018 5:48:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:47:58.956Z: Executing operation Query10/Query10.GroupByKey/Read+Query10/Query10.GroupByKey/GroupByWindow+Query10/Query10.CheckForLateEvents+Query10/Query10.UploadEvents+Query10/Query10.WindowLogFiles/Window.Assign+Query10/Query10.GroupByKey2/Reify+Query10/Query10.GroupByKey2/Write
Oct 27, 2018 5:48:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:48:22.953Z: Cleaning up.
Oct 27, 2018 5:48:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:48:23.061Z: Stopping worker pool...
Oct 27, 2018 5:48:30 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:30.613Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:30.649Z RUNNING Query4
==========================================================================================
Run started 2018-10-27T05:44:16.688Z and ran for PT254.098S
Exception in thread "main" Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
Configurations:
at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.NoClassDefFoundError: org/apache/beam/repackaged/beam_sdks_java_test_utils/com/google/common/collect/Iterables
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:128)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.currentPerf(NexmarkLauncher.java:250)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:435)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.collect.Iterables
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 13 more
Oct 27, 2018 5:48:30 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:30.812Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:30.835Z RUNNING Query0
Oct 27, 2018 5:48:30 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:30.849Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:30.875Z RUNNING Query5
Oct 27, 2018 5:48:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:48:31.320Z: Executing operation Query10/Query10.GroupByKey2/Close
Oct 27, 2018 5:48:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:48:31.414Z: Executing operation Query10/Query10.GroupByKey2/Read+Query10/Query10.GroupByKey2/GroupByWindow+Query10/Query10.Index+Query10/Query10.Forget+Query10/Query10.Debug+Query10/Query10.Stamp+Query10.Format+Query10.DevNull
Oct 27, 2018 5:48:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:48:34.110Z: Cleaning up.
Oct 27, 2018 5:48:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-27T05:48:34.201Z: Stopping worker pool...
Oct 27, 2018 5:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:34.830Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:34.867Z RUNNING Query2
Oct 27, 2018 5:48:39 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:39.121Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:39.151Z RUNNING Query7
Oct 27, 2018 5:48:40 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:40.125Z Waiting for main pipeline to 'finish'
2018-10-27T05:48:40.155Z RUNNING Query1
Oct 27, 2018 5:48:41 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:41.090Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:41.120Z RUNNING Query11
Oct 27, 2018 5:48:41 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:41.214Z Waiting for main pipeline to 'finish'
2018-10-27T05:48:41.244Z RUNNING Query8
Oct 27, 2018 5:48:43 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:43.081Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:43.106Z RUNNING Query10
Oct 27, 2018 5:48:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:44.168Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:44.197Z RUNNING Query6
Oct 27, 2018 5:48:45 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:45.859Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:45.888Z RUNNING Query9
Oct 27, 2018 5:48:45 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:45.986Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:46.027Z RUNNING Query12
Oct 27, 2018 5:48:46 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-27T05:48:46.762Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-27T05:48:46.793Z RUNNING Query3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 4 mins 31.108 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 36s
68 actionable tasks: 65 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/zwyq6b4evjnak
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #839
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/839/display/redirect>
------------------------------------------
Started by user kenn
[EnvInject] - Loading node environment variables.
Building remotely on beam12 (beam) in workspace <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse refs/remotes/origin/pr/6858/head^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/pr/6858/head^{commit} # timeout=10
> git rev-parse origin/pr/6858/head^{commit} # timeout=10
ERROR: Couldn't find any revision to build. Verify the repository and branch configuration for this job.
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse refs/remotes/origin/pr/6858/head^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/pr/6858/head^{commit} # timeout=10
> git rev-parse origin/pr/6858/head^{commit} # timeout=10
ERROR: Couldn't find any revision to build. Verify the repository and branch configuration for this job.
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse refs/remotes/origin/pr/6858/head^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/pr/6858/head^{commit} # timeout=10
> git rev-parse origin/pr/6858/head^{commit} # timeout=10
ERROR: Couldn't find any revision to build. Verify the repository and branch configuration for this job.
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org