You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/10/28 20:58:48 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #849
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/849/display/redirect?page=changes>
Changes:
[coheigea] Move array declarations after the type
------------------------------------------
[...truncated 1.05 MB...]
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.078Z: Fusing consumer Query1/Query1.Stamp into Query1/Query1.Debug
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.080Z: Fusing consumer Query1/Query1.Debug into Query1/Query1.Forget
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.082Z: Fusing consumer Query1/Query1.Monitor into Query1.ReadUnbounded/StripIds
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.085Z: Fusing consumer Query1/justBids/IsBid/ParDo(Anonymous) into Query1/Query1.Snoop
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.087Z: Fusing consumer Query1/justBids/AsBid into Query1/justBids/IsBid/ParDo(Anonymous)
Oct 28, 2018 8:54:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:51.308Z: Starting 4 workers...
Oct 28, 2018 8:54:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:54:56.851Z: Executing operation Query1.ReadUnbounded/DataflowRunner.StreamingUnboundedRead.ReadWithIds+Query1.ReadUnbounded/StripIds+Query1/Query1.Monitor+Query1/Query1.Snoop+Query1/justBids/IsBid/ParDo(Anonymous)+Query1/justBids/AsBid+Query1/Query1.ToEuros+Query1/Query1.Forget+Query1/Query1.Debug+Query1/Query1.Stamp+Query1.Format+Query1.DevNull
Oct 28, 2018 8:55:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.247Z: Workers have started successfully.
Oct 28, 2018 8:55:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.234Z: Workers have started successfully.
Oct 28, 2018 8:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:17.756Z: Workers have started successfully.
Oct 28, 2018 8:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:16.387Z: Workers have started successfully.
Oct 28, 2018 8:55:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:17.936Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:18.671Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.534Z: Workers have started successfully.
Oct 28, 2018 8:55:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.177Z: Workers have started successfully.
Oct 28, 2018 8:55:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:19.769Z: Workers have started successfully.
Oct 28, 2018 8:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:25.293Z: Workers have started successfully.
Oct 28, 2018 8:55:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:27.271Z: Workers have started successfully.
Oct 28, 2018 8:55:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:28.739Z: Workers have started successfully.
Oct 28, 2018 8:55:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:55:30.266Z: Workers have started successfully.
Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.686Z: Cleaning up.
Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.720Z: Worker pool stopped.
Oct 28, 2018 8:57:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:04.732Z: Stopping worker pool...
Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.529Z: Cleaning up.
Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.572Z: Worker pool stopped.
Oct 28, 2018 8:57:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:09.590Z: Stopping worker pool...
Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.606Z: Cleaning up.
Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.661Z: Worker pool stopped.
Oct 28, 2018 8:57:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:18.688Z: Stopping worker pool...
Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.214Z: Cleaning up.
Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.246Z: Worker pool stopped.
Oct 28, 2018 8:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:29.262Z: Stopping worker pool...
Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.173Z: Cleaning up.
Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.199Z: Worker pool stopped.
Oct 28, 2018 8:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:35.214Z: Stopping worker pool...
Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.500Z: Cleaning up.
Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.531Z: Worker pool stopped.
Oct 28, 2018 8:57:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:36.545Z: Stopping worker pool...
Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.679Z: Cleaning up.
Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.732Z: Worker pool stopped.
Oct 28, 2018 8:57:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:39.755Z: Stopping worker pool...
Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.874Z: Cleaning up.
Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.924Z: Worker pool stopped.
Oct 28, 2018 8:57:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:57:54.944Z: Stopping worker pool...
Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.440Z: Cleaning up.
Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.472Z: Worker pool stopped.
Oct 28, 2018 8:58:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:19.485Z: Stopping worker pool...
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:32.867Z: Cleaning up.
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T20:58:32.911Z: Worker pool stopped.
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.383Z Waiting for main pipeline to 'finish'
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.385Z Waiting for main pipeline to 'finish'
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.405Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.407Z RUNNING Query10
2018-10-28T20:58:33.409Z RUNNING Query0
2018-10-28T20:58:33.432Z RUNNING Query11
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.551Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.559Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.579Z RUNNING Query6
2018-10-28T20:58:33.586Z RUNNING Query2
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.595Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.599Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.616Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.625Z RUNNING Query9
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.626Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.628Z RUNNING Query12
2018-10-28T20:58:33.651Z RUNNING Query5
2018-10-28T20:58:33.661Z RUNNING Query8
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
2018-10-28T20:58:33.668Z Waiting for main pipeline to 'finish'
INFO: 2018-10-28T20:58:32.924Z: Stopping worker pool...
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.722Z RUNNING Query7
Oct 28, 2018 8:58:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:33.811Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:33.846Z RUNNING Query3
2018-10-28T20:58:34.107Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.190Z 1 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2018-10-28T20:54:22.980Z and ran for PT251.209S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Exception in thread "main"
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:1; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:2; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:3; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:4; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:5; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:6; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:7; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:8; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:9; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:10; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:11; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:12; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
java.lang.RuntimeException: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0.
0006 *** not run ***
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:144)
0007 *** at org.apache.beam.sdk.nexmark.Main.main(Main.java:477)
not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
==========================================================================================
Caused by: java.lang.IllegalStateException: More than one metric matches name: fatal in namespace Query0.
at org.apache.beam.repackaged.beam_sdks_java_test_utils.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.checkIfMetricResultIsUnique(MetricsReader.java:127)
at org.apache.beam.sdk.testutils.metrics.MetricsReader.getCounterMetric(MetricsReader.java:65)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.monitor(NexmarkLauncher.java:447)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1156)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:108)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:96)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-28T20:58:34.228Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.266Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.365Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.383Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.385Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.399Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.445Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.479Z 1 samples not enough to calculate steady-state event rate
2018-10-28T20:58:34.621Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 8:58:37 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:37.030Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:37.057Z RUNNING Query4
2018-10-28T20:58:37.848Z 1 samples not enough to calculate steady-state event rate
Oct 28, 2018 8:58:45 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T20:58:45.809Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T20:58:45.834Z RUNNING Query1
2018-10-28T20:58:46.420Z 1 samples not enough to calculate steady-state event rate
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 4 mins 24.225 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 55s
68 actionable tasks: 15 executed, 53 up-to-date
Publishing build scan...
https://gradle.com/s/3mwxvvkokhe3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #856
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/856/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #855
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/855/display/redirect>
------------------------------------------
[...truncated 1.44 MB...]
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.884Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.922Z: Fusing consumer SqlQuery0/SqlQuery0.Monitor into SqlQuery0.ReadBounded
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.953Z: Fusing consumer SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous) into SqlQuery0/SqlQuery0.Snoop
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.992Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_178/ParDo(Calc) into SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.028Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlQuery0.Serialize
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.059Z: Fusing consumer SqlQuery0.Format into SqlQuery0/SqlQuery0.Stamp
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.091Z: Fusing consumer SqlQuery0.DevNull into SqlQuery0.Format
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.121Z: Fusing consumer SqlQuery0/SqlQuery0.Stamp into SqlQuery0/SqlQuery0.Debug
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.151Z: Fusing consumer SqlQuery0/SqlQuery0.Debug into SqlQuery0/SqlQuery0.Forget
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.181Z: Fusing consumer SqlQuery0/SqlQuery0.Forget into SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.206Z: Fusing consumer SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_178/ParDo(Calc)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.242Z: Fusing consumer SqlQuery0/SqlQuery0.Snoop into SqlQuery0/SqlQuery0.Monitor
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.279Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous) into SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.319Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.Serialize into SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.671Z: Executing operation SqlQuery0.ReadBounded+SqlQuery0/SqlQuery0.Monitor+SqlQuery0/SqlQuery0.Snoop+SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.Serialize+SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_178/ParDo(Calc)+SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0.Forget+SqlQuery0/SqlQuery0.Debug+SqlQuery0/SqlQuery0.Stamp+SqlQuery0.Format+SqlQuery0.DevNull
Oct 29, 2018 12:24:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:19.759Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T12:24:16.168Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:18.918Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.330Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.866Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.919Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:22.967Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.075Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.113Z: Fusing consumer SqlQuery2/SqlQuery2.Monitor into SqlQuery2.ReadBounded
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.161Z: Fusing consumer SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous) into SqlQuery2/SqlQuery2.Snoop
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.200Z: Fusing consumer SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_250/ParDo(Calc)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.246Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_250/ParDo(Calc) into SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.295Z: Fusing consumer SqlQuery2.DevNull into SqlQuery2.Format
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.337Z: Fusing consumer SqlQuery2.Format into SqlQuery2/SqlQuery2.Stamp
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.382Z: Fusing consumer SqlQuery2/SqlQuery2.Stamp into SqlQuery2/SqlQuery2.Debug
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.419Z: Fusing consumer SqlQuery2/SqlQuery2.Debug into SqlQuery2/SqlQuery2.Forget
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.458Z: Fusing consumer SqlQuery2/SqlQuery2.Forget into SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.494Z: Fusing consumer SqlQuery2/SqlQuery2.Snoop into SqlQuery2/SqlQuery2.Monitor
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.523Z: Fusing consumer SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous) into SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.564Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:23.946Z: Executing operation SqlQuery2.ReadBounded+SqlQuery2/SqlQuery2.Monitor+SqlQuery2/SqlQuery2.Snoop+SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_250/ParDo(Calc)+SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2.Forget+SqlQuery2/SqlQuery2.Debug+SqlQuery2/SqlQuery2.Stamp+SqlQuery2.Format+SqlQuery2.DevNull
Oct 29, 2018 12:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:24.054Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:24:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:30.215Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:34.779Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:34.181Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:38.147Z: Workers have started successfully.
Oct 29, 2018 12:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:38.453Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:38.492Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:39.178Z: Workers have started successfully.
Oct 29, 2018 12:25:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:24:59.005Z: Workers have started successfully.
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:02.485Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:02.533Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.288Z: Workers have started successfully.
Oct 29, 2018 12:25:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.339Z: Workers have started successfully.
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:04.811Z: Workers have started successfully.
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.740Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:03.774Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:05.862Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:09.207Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:09.244Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:26.260Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:26.300Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:29.352Z: Workers have started successfully.
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:31.224Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:32.029Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:30.623Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:25:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:30.673Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:25:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:36.098Z: Workers have started successfully.
Oct 29, 2018 12:25:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:25:36.125Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:26:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:03.401Z: Cleaning up.
Oct 29, 2018 12:26:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:03.523Z: Stopping worker pool...
Oct 29, 2018 12:26:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:07.391Z: Cleaning up.
Oct 29, 2018 12:26:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:07.489Z: Stopping worker pool...
Oct 29, 2018 12:26:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:33.968Z: Cleaning up.
Oct 29, 2018 12:26:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:34.075Z: Stopping worker pool...
Oct 29, 2018 12:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:42.085Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close
Oct 29, 2018 12:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:42.185Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 12:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:47.040Z: Cleaning up.
Oct 29, 2018 12:26:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T12:26:47.142Z: Stopping worker pool...
Oct 29, 2018 12:27:49 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:27:49.778Z Waiting for main pipeline to 'finish'
2018-10-29T12:27:49.812Z RUNNING SqlQuery1
2018-10-29T12:27:50.611Z new perf {"snapshots":null,"runtimeSec":76.742,"numEvents":10000000,"eventsPerSec":130306.74207083473,"eventBytesPerSec":1.6725715996455656E7,"numResults":9200000,"resultsPerSec":119882.20270516796,"resultBytesPerSec":1.2048090302572254E7,"startupDelaySec":-179.349,"processingDelaySec":0.662,"shutdownDelaySec":102.607,"timeDilation":13.03002267337312,"errors":null,"jobId":null}
Oct 29, 2018 12:28:01 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T12:28:01.743Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:28:01.781Z RUNNING SqlQuery3
2018-10-29T12:28:02.701Z new perf {"snapshots":null,"runtimeSec":94.246,"numEvents":10000000,"eventsPerSec":106105.298898627,"eventBytesPerSec":1.3619303705197038E7,"numResults":9054,"resultsPerSec":96.06773762281689,"resultBytesPerSec":3068.1938756021477,"startupDelaySec":-169.199,"processingDelaySec":90.34,"shutdownDelaySec":74.953,"timeDilation":10.504424590964073,"errors":null,"jobId":null}
2018-10-29T12:28:05.641Z RUNNING SqlQuery1
2018-10-29T12:28:06.374Z no activity
Oct 29, 2018 12:28:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T12:28:12.633Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:28:12.663Z RUNNING SqlQuery0
2018-10-29T12:28:13.401Z new perf {"snapshots":null,"runtimeSec":79.056,"numEvents":10000000,"eventsPerSec":126492.61283141065,"eventBytesPerSec":1.6236147756021049E7,"numResults":9200000,"resultsPerSec":116373.2038048978,"resultBytesPerSec":1.169543799332119E7,"startupDelaySec":-177.947,"processingDelaySec":0.722,"shutdownDelaySec":98.891,"timeDilation":12.648628820076908,"errors":null,"jobId":null}
Oct 29, 2018 12:28:16 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T12:28:16.976Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T12:28:17.022Z RUNNING SqlQuery2
2018-10-29T12:28:17.738Z RUNNING SqlQuery3
2018-10-29T12:28:17.776Z new perf {"snapshots":null,"runtimeSec":46.041,"numEvents":10000000,"eventsPerSec":217197.71508003736,"eventBytesPerSec":2.7878736278534353E7,"numResults":83527,"resultsPerSec":1814.1873547490281,"resultBytesPerSec":29026.99767598445,"startupDelaySec":-180.686,"processingDelaySec":1.149,"shutdownDelaySec":134.649,"timeDilation":21.718468321713257,"errors":null,"jobId":null}
2018-10-29T12:28:18.605Z no activity
2018-10-29T12:28:21.403Z RUNNING SqlQuery1
2018-10-29T12:28:22.149Z no activity
2018-10-29T12:28:28.432Z RUNNING SqlQuery0
2018-10-29T12:28:29.203Z no activity
2018-10-29T12:28:32.801Z RUNNING SqlQuery2
2018-10-29T12:28:33.521Z no activity
2018-10-29T12:28:33.636Z RUNNING SqlQuery3
2018-10-29T12:28:34.540Z no activity
2018-10-29T12:28:37.183Z RUNNING SqlQuery1
2018-10-29T12:28:37.899Z no activity
2018-10-29T12:28:44.238Z RUNNING SqlQuery0
2018-10-29T12:28:44.945Z no activity
2018-10-29T12:28:48.558Z RUNNING SqlQuery2
2018-10-29T12:28:49.372Z no activity
2018-10-29T12:28:49.576Z RUNNING SqlQuery3
2018-10-29T12:28:50.396Z no activity
2018-10-29T12:28:52.934Z RUNNING SqlQuery1
2018-10-29T12:28:53.882Z no activity
2018-10-29T12:28:59.979Z RUNNING SqlQuery0
2018-10-29T12:29:00.702Z no activity
2018-10-29T12:29:04.408Z RUNNING SqlQuery2
2018-10-29T12:29:05.115Z no activity
2018-10-29T12:29:05.452Z RUNNING SqlQuery3
2018-10-29T12:29:06.285Z no activity
2018-10-29T12:29:08.922Z RUNNING SqlQuery1
2018-10-29T12:29:09.695Z no activity
2018-10-29T12:29:15.744Z RUNNING SqlQuery0
2018-10-29T12:29:16.667Z no activity
2018-10-29T12:29:20.146Z RUNNING SqlQuery2
2018-10-29T12:29:21.028Z no activity
2018-10-29T12:29:21.316Z RUNNING SqlQuery3
2018-10-29T12:29:22.190Z no activity
2018-10-29T12:29:24.781Z RUNNING SqlQuery1
2018-10-29T12:29:25.840Z no activity
2018-10-29T12:29:31.698Z RUNNING SqlQuery0
2018-10-29T12:29:32.535Z no activity
2018-10-29T12:29:36.107Z DONE SqlQuery2
2018-10-29T12:29:37.220Z RUNNING SqlQuery3
2018-10-29T12:29:38.324Z no activity
2018-10-29T12:29:40.876Z DONE SqlQuery1
2018-10-29T12:29:47.581Z RUNNING SqlQuery0
2018-10-29T12:29:48.328Z no activity
2018-10-29T12:29:53.364Z RUNNING SqlQuery3
2018-10-29T12:29:54.339Z no activity
2018-10-29T12:30:03.367Z RUNNING SqlQuery0
2018-10-29T12:30:04.384Z no activity
2018-10-29T12:30:09.385Z RUNNING SqlQuery3
2018-10-29T12:30:10.340Z no activity
2018-10-29T12:30:19.471Z DONE SqlQuery0
2018-10-29T12:30:25.386Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 6 mins 44.547 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 56s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/w2wwpva5qa77k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #854
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/854/display/redirect?page=changes>
Changes:
[kenn] [BEAM-5817] Use an explicit enum for naming Nexmark benchmarks
------------------------------------------
[...truncated 1.31 MB...]
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.836Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.882Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.929Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.977Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.010Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.055Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.104Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.150Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.186Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.235Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.279Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.328Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.365Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.413Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.461Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.507Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.554Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 29, 2018 9:09:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.604Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 29, 2018 9:09:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.054Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T09:09:10.189Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:12.945Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.331Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.910Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.955Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:16.991Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.095Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.141Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor into SqlQuery1.ReadBounded
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.182Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.228Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.275Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc) into SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.320Z: Fusing consumer SqlQuery1.DevNull into SqlQuery1.Format
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.366Z: Fusing consumer SqlQuery1.Format into SqlQuery1/SqlQuery1.Stamp
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.403Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp into SqlQuery1/SqlQuery1.Debug
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.451Z: Fusing consumer SqlQuery1/SqlQuery1.Debug into SqlQuery1/SqlQuery1.Forget
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.497Z: Fusing consumer SqlQuery1/SqlQuery1.Forget into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.540Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop into SqlQuery1/SqlQuery1.Monitor
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.566Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:17.612Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.055Z: Executing operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_179/ParDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Forget+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull
Oct 29, 2018 9:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:18.166Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.112Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Create
Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.215Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 9:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:19.434Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_29/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_25/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write
Oct 29, 2018 9:09:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:30.154Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:09:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:30.266Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:09:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:33.005Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:09:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:09:32.799Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:00.596Z: Workers have started successfully.
Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:01.114Z: Workers have started successfully.
Oct 29, 2018 9:10:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:00.532Z: Workers have started successfully.
Oct 29, 2018 9:10:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:04.214Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:03.009Z: Workers have started successfully.
Oct 29, 2018 9:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:04.255Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:08.916Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:08.955Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:10.043Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:12.611Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:12.657Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:13.145Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:13.185Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 9:10:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:14.936Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:18.170Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:31.422Z: Workers have started successfully.
Oct 29, 2018 9:10:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:31.830Z: Workers have started successfully.
Oct 29, 2018 9:10:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:31.780Z: Workers have started successfully.
Oct 29, 2018 9:10:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:34.152Z: Workers have started successfully.
Oct 29, 2018 9:10:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:35.890Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 9:10:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:52.962Z: Cleaning up.
Oct 29, 2018 9:10:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:10:53.097Z: Stopping worker pool...
Oct 29, 2018 9:11:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:22.914Z: Cleaning up.
Oct 29, 2018 9:11:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:23.017Z: Stopping worker pool...
Oct 29, 2018 9:11:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:31.272Z: Cleaning up.
Oct 29, 2018 9:11:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:31.368Z: Stopping worker pool...
Oct 29, 2018 9:11:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:43.719Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close
Oct 29, 2018 9:11:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:43.823Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 9:11:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:47.633Z: Cleaning up.
Oct 29, 2018 9:11:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T09:11:47.732Z: Stopping worker pool...
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T09:13:11.024Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T09:13:11.051Z RUNNING SqlQuery0
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T09:13:11.092Z Waiting for main pipeline to 'finish'
2018-10-29T09:13:11.226Z RUNNING SqlQuery1
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T09:13:11.227Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 29, 2018 9:13:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T09:13:11.257Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T09:13:11.266Z RUNNING SqlQuery2
2018-10-29T09:13:11.290Z RUNNING SqlQuery3
2018-10-29T09:13:11.954Z new perf {"snapshots":null,"runtimeSec":76.565,"numEvents":10000000,"eventsPerSec":130607.98014758702,"eventBytesPerSec":1.6764381858551558E7,"numResults":9200000,"resultsPerSec":120159.34173578006,"resultBytesPerSec":1.2075942610853523E7,"startupDelaySec":-177.634,"processingDelaySec":0.766,"shutdownDelaySec":101.069,"timeDilation":13.060144974857964,"errors":null,"jobId":null}
2018-10-29T09:13:11.998Z new perf {"snapshots":null,"runtimeSec":70.253,"numEvents":10000000,"eventsPerSec":142342.67575761888,"eventBytesPerSec":1.827060619475325E7,"numResults":9200000,"resultsPerSec":130955.26169700938,"resultBytesPerSec":1.3160926166854085E7,"startupDelaySec":-178.699,"processingDelaySec":0.631,"shutdownDelaySec":108.446,"timeDilation":14.2335558623831,"errors":null,"jobId":null}
2018-10-29T09:13:12.041Z new perf {"snapshots":null,"runtimeSec":40.904,"numEvents":10000000,"eventsPerSec":244474.86798357125,"eventBytesPerSec":3.1379935874242127E7,"numResults":83527,"resultsPerSec":2042.0252298063758,"resultBytesPerSec":32672.403676902013,"startupDelaySec":-179.503,"processingDelaySec":1.135,"shutdownDelaySec":138.599,"timeDilation":24.44601994914923,"errors":null,"jobId":null}
2018-10-29T09:13:12.114Z new perf {"snapshots":null,"runtimeSec":89.979,"numEvents":10000000,"eventsPerSec":111137.04308783161,"eventBytesPerSec":1.4265160726391714E7,"numResults":9054,"resultsPerSec":100.62347881172273,"resultBytesPerSec":3213.6943064492825,"startupDelaySec":-173.886,"processingDelaySec":87.123,"shutdownDelaySec":83.907,"timeDilation":11.00256726569533,"errors":null,"jobId":null}
2018-10-29T09:13:27.001Z RUNNING SqlQuery0
2018-10-29T09:13:27.031Z RUNNING SqlQuery1
2018-10-29T09:13:27.071Z RUNNING SqlQuery2
2018-10-29T09:13:27.146Z RUNNING SqlQuery3
2018-10-29T09:13:27.723Z no activity
2018-10-29T09:13:27.750Z no activity
2018-10-29T09:13:27.969Z no activity
2018-10-29T09:13:28.003Z no activity
2018-10-29T09:13:42.801Z RUNNING SqlQuery1
2018-10-29T09:13:42.801Z RUNNING SqlQuery0
2018-10-29T09:13:42.997Z RUNNING SqlQuery2
2018-10-29T09:13:43.030Z RUNNING SqlQuery3
2018-10-29T09:13:43.495Z no activity
2018-10-29T09:13:43.496Z no activity
2018-10-29T09:13:43.655Z no activity
2018-10-29T09:13:43.794Z no activity
2018-10-29T09:13:58.523Z RUNNING SqlQuery1
2018-10-29T09:13:58.525Z RUNNING SqlQuery0
2018-10-29T09:13:58.683Z RUNNING SqlQuery2
2018-10-29T09:13:58.822Z RUNNING SqlQuery3
2018-10-29T09:13:59.139Z no activity
2018-10-29T09:13:59.171Z no activity
2018-10-29T09:13:59.424Z no activity
2018-10-29T09:13:59.692Z no activity
2018-10-29T09:14:14.174Z RUNNING SqlQuery1
2018-10-29T09:14:14.198Z RUNNING SqlQuery0
2018-10-29T09:14:14.446Z RUNNING SqlQuery2
2018-10-29T09:14:14.723Z RUNNING SqlQuery3
2018-10-29T09:14:14.921Z no activity
2018-10-29T09:14:14.953Z no activity
2018-10-29T09:14:15.171Z no activity
2018-10-29T09:14:15.726Z no activity
2018-10-29T09:14:29.989Z RUNNING SqlQuery1
2018-10-29T09:14:29.990Z RUNNING SqlQuery0
2018-10-29T09:14:30.328Z DONE SqlQuery2
2018-10-29T09:14:30.760Z RUNNING SqlQuery3
2018-10-29T09:14:30.790Z no activity
2018-10-29T09:14:30.801Z no activity
2018-10-29T09:14:31.599Z no activity
2018-10-29T09:14:45.824Z DONE SqlQuery0
2018-10-29T09:14:45.836Z RUNNING SqlQuery1
2018-10-29T09:14:46.613Z no activity
2018-10-29T09:14:46.637Z RUNNING SqlQuery3
2018-10-29T09:14:47.473Z no activity
2018-10-29T09:15:01.656Z DONE SqlQuery1
2018-10-29T09:15:02.501Z RUNNING SqlQuery3
2018-10-29T09:15:03.335Z no activity
2018-10-29T09:15:18.368Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 6 mins 16.241 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 27s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/gfx3yqldbxugc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #853
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/853/display/redirect>
------------------------------------------
[...truncated 1.43 MB...]
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.746Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.794Z: Unzipping flatten s17 for input s15.org.apache.beam.sdk.values.PCollection.<init>:402#d5569b730568cf6
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.843Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify, through flatten SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/Flatten, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.890Z: Fusing consumer SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.937Z: Fusing consumer SqlQuery3.Format into SqlQuery3/SqlQuery3.Stamp
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:11.980Z: Fusing consumer SqlQuery3.DevNull into SqlQuery3.Format
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.019Z: Fusing consumer SqlQuery3/SqlQuery3.Forget into SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.062Z: Fusing consumer SqlQuery3/SqlQuery3.Debug into SqlQuery3/SqlQuery3.Forget
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.108Z: Fusing consumer SqlQuery3/SqlQuery3.Stamp into SqlQuery3/SqlQuery3.Debug
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.148Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.192Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.239Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.284Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.331Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.377Z: Unzipping flatten s17-u13 for input s18-reify-value0-c11
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.414Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.446Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.485Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.524Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.571Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.611Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.654Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.701Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_33/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.748Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_30/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.787Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.834Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.872Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.917Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_33/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.955Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:12.983Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_30/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.028Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.067Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.113Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.571Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Create
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.667Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 6:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:13.850Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_33/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_365/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_30/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_364/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Write
Oct 29, 2018 6:23:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:21.932Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:24.124Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:25.464Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:29.484Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:23:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:50.050Z: Workers have started successfully.
Oct 29, 2018 6:23:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:49.528Z: Workers have started successfully.
Oct 29, 2018 6:23:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:51.455Z: Workers have started successfully.
Oct 29, 2018 6:23:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:23:58.277Z: Workers have started successfully.
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:07.903Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:07.938Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:08.094Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:08.123Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:11.072Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:11.100Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:12.329Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:12.367Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:13.828Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:13.865Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:13.650Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:16.806Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:18.145Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:19.283Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:19.316Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 6:24:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:20.244Z: Workers have started successfully.
Oct 29, 2018 6:24:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:20.665Z: Workers have started successfully.
Oct 29, 2018 6:24:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:22.816Z: Workers have started successfully.
Oct 29, 2018 6:24:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:29.543Z: Workers have started successfully.
Oct 29, 2018 6:24:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:30.515Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 6:24:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:46.648Z: Cleaning up.
Oct 29, 2018 6:24:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:24:46.826Z: Stopping worker pool...
Oct 29, 2018 6:25:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:21.528Z: Cleaning up.
Oct 29, 2018 6:25:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:21.631Z: Stopping worker pool...
Oct 29, 2018 6:25:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:33.697Z: Cleaning up.
Oct 29, 2018 6:25:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:33.813Z: Stopping worker pool...
Oct 29, 2018 6:25:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:47.181Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Close
Oct 29, 2018 6:25:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:47.275Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_366/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_367/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 6:25:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:51.445Z: Cleaning up.
Oct 29, 2018 6:25:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T06:25:51.556Z: Stopping worker pool...
Oct 29, 2018 6:27:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:04.924Z Waiting for main pipeline to 'finish'
2018-10-29T06:27:04.955Z RUNNING SqlQuery1
Oct 29, 2018 6:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T06:27:05.106Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:05.106Z Waiting for main pipeline to 'finish'
Oct 29, 2018 6:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:05.148Z RUNNING SqlQuery0
2018-10-29T06:27:05.149Z RUNNING SqlQuery2
Oct 29, 2018 6:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T06:27:05.180Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T06:27:05.217Z RUNNING SqlQuery3
2018-10-29T06:27:05.809Z new perf {"snapshots":null,"runtimeSec":84.003,"numEvents":10000000,"eventsPerSec":119043.3674987798,"eventBytesPerSec":1.5279988774210446E7,"numResults":9200000,"resultsPerSec":109519.89809887743,"resultBytesPerSec":1.1006684832684547E7,"startupDelaySec":-175.444,"processingDelaySec":0.812,"shutdownDelaySec":91.441,"timeDilation":11.903741533040487,"errors":null,"jobId":null}
2018-10-29T06:27:06.016Z new perf {"snapshots":null,"runtimeSec":44.982,"numEvents":10000000,"eventsPerSec":222311.14668089457,"eventBytesPerSec":2.8535078409141436E7,"numResults":83527,"resultsPerSec":1856.8983148815082,"resultBytesPerSec":29710.37303810413,"startupDelaySec":-184.721,"processingDelaySec":1.147,"shutdownDelaySec":139.748,"timeDilation":22.229780801209372,"errors":null,"jobId":null}
2018-10-29T06:27:06.049Z new perf {"snapshots":null,"runtimeSec":76.84,"numEvents":10000000,"eventsPerSec":130140.55179593961,"eventBytesPerSec":1.670438439614784E7,"numResults":9200000,"resultsPerSec":119729.30765226444,"resultBytesPerSec":1.2032724440395627E7,"startupDelaySec":-181.674,"processingDelaySec":0.614,"shutdownDelaySec":104.834,"timeDilation":13.013404476834982,"errors":null,"jobId":null}
2018-10-29T06:27:06.175Z new perf {"snapshots":null,"runtimeSec":46.771,"numEvents":10000000,"eventsPerSec":213807.70135340275,"eventBytesPerSec":2.7443606016548716E7,"numResults":9054,"resultsPerSec":193.58149280537086,"resultBytesPerSec":6182.570396185671,"startupDelaySec":-120.733,"processingDelaySec":43.514,"shutdownDelaySec":73.962,"timeDilation":21.16696243398687,"errors":null,"jobId":null}
2018-10-29T06:27:20.891Z RUNNING SqlQuery1
2018-10-29T06:27:21.052Z RUNNING SqlQuery2
2018-10-29T06:27:21.085Z RUNNING SqlQuery0
2018-10-29T06:27:21.202Z RUNNING SqlQuery3
2018-10-29T06:27:21.866Z no activity
2018-10-29T06:27:21.969Z no activity
2018-10-29T06:27:21.997Z no activity
2018-10-29T06:27:22.198Z no activity
2018-10-29T06:27:36.900Z RUNNING SqlQuery1
2018-10-29T06:27:36.994Z RUNNING SqlQuery0
2018-10-29T06:27:37.023Z RUNNING SqlQuery2
2018-10-29T06:27:37.227Z RUNNING SqlQuery3
2018-10-29T06:27:37.625Z no activity
2018-10-29T06:27:37.678Z no activity
2018-10-29T06:27:37.732Z no activity
2018-10-29T06:27:38.039Z no activity
2018-10-29T06:27:52.663Z RUNNING SqlQuery1
2018-10-29T06:27:52.706Z RUNNING SqlQuery2
2018-10-29T06:27:52.759Z RUNNING SqlQuery0
2018-10-29T06:27:53.072Z RUNNING SqlQuery3
2018-10-29T06:27:53.369Z no activity
2018-10-29T06:27:53.391Z no activity
2018-10-29T06:27:53.426Z no activity
2018-10-29T06:27:53.781Z no activity
2018-10-29T06:28:08.406Z RUNNING SqlQuery1
2018-10-29T06:28:08.415Z RUNNING SqlQuery2
2018-10-29T06:28:08.461Z RUNNING SqlQuery0
2018-10-29T06:28:08.822Z RUNNING SqlQuery3
2018-10-29T06:28:09.053Z no activity
2018-10-29T06:28:09.068Z no activity
2018-10-29T06:28:09.113Z no activity
2018-10-29T06:28:09.666Z no activity
2018-10-29T06:28:24.100Z DONE SqlQuery2
2018-10-29T06:28:24.106Z RUNNING SqlQuery1
2018-10-29T06:28:24.149Z RUNNING SqlQuery0
2018-10-29T06:28:24.700Z RUNNING SqlQuery3
2018-10-29T06:28:24.839Z no activity
2018-10-29T06:28:24.899Z no activity
2018-10-29T06:28:25.526Z no activity
2018-10-29T06:28:39.909Z RUNNING SqlQuery1
2018-10-29T06:28:39.929Z RUNNING SqlQuery0
2018-10-29T06:28:40.559Z RUNNING SqlQuery3
2018-10-29T06:28:40.592Z no activity
2018-10-29T06:28:40.673Z no activity
2018-10-29T06:28:41.343Z no activity
2018-10-29T06:28:55.636Z RUNNING SqlQuery1
2018-10-29T06:28:55.706Z DONE SqlQuery0
2018-10-29T06:28:55.794Z no activity
2018-10-29T06:28:56.377Z RUNNING SqlQuery3
2018-10-29T06:28:57.200Z no activity
2018-10-29T06:29:10.795Z DONE SqlQuery1
2018-10-29T06:29:12.224Z RUNNING SqlQuery3
2018-10-29T06:29:12.986Z no activity
2018-10-29T06:29:28.033Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 6 mins 31.767 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 42s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/fahy2ru4dxlsi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #852
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/852/display/redirect?page=changes>
Changes:
[klk] [BEAM-5887] Fix classifier for unshaded tests
[klk] Re-enable parallel build of Java PreCommit
------------------------------------------
[...truncated 1.48 MB...]
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.025Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/right_ExtractJoinFields/Map
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.068Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_24/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.116Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_486/ParDo(Calc)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.163Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.210Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.728Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Create
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:09.831Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:10.029Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_28/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_487/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_24/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_486/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Write
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T02:09:00.348Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:03.082Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:06.722Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.311Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.359Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.406Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.512Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.562Z: Fusing consumer SqlQuery2/SqlQuery2.Monitor into SqlQuery2.ReadBounded
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.612Z: Fusing consumer SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous) into SqlQuery2/SqlQuery2.Snoop
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.654Z: Fusing consumer SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_251/ParDo(Calc)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.700Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_251/ParDo(Calc) into SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.743Z: Fusing consumer SqlQuery2.DevNull into SqlQuery2.Format
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.769Z: Fusing consumer SqlQuery2.Format into SqlQuery2/SqlQuery2.Stamp
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.817Z: Fusing consumer SqlQuery2/SqlQuery2.Stamp into SqlQuery2/SqlQuery2.Debug
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.866Z: Fusing consumer SqlQuery2/SqlQuery2.Debug into SqlQuery2/SqlQuery2.Forget
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.912Z: Fusing consumer SqlQuery2/SqlQuery2.Forget into SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.943Z: Fusing consumer SqlQuery2/SqlQuery2.Snoop into SqlQuery2/SqlQuery2.Monitor
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:07.992Z: Fusing consumer SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous) into SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:08.041Z: Fusing consumer SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:08.514Z: Executing operation SqlQuery2.ReadBounded+SqlQuery2/SqlQuery2.Monitor+SqlQuery2/SqlQuery2.Snoop+SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_23/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_251/ParDo(Calc)+SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2.Forget+SqlQuery2/SqlQuery2.Debug+SqlQuery2/SqlQuery2.Stamp+SqlQuery2.Format+SqlQuery2.DevNull
Oct 29, 2018 2:09:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:08.616Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 2:09:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:19.180Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:20.346Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:23.607Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:25.370Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:46.437Z: Workers have started successfully.
Oct 29, 2018 2:09:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:47.453Z: Workers have started successfully.
Oct 29, 2018 2:09:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:55.986Z: Workers have started successfully.
Oct 29, 2018 2:09:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:58.775Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:09:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:09:58.827Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:01.779Z: Workers have started successfully.
Oct 29, 2018 2:10:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:01.392Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:01.442Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:04.406Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:04.452Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:17.925Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:17.967Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:17.667Z: Workers have started successfully.
Oct 29, 2018 2:10:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:18.644Z: Workers have started successfully.
Oct 29, 2018 2:10:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:21.783Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:21.440Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:21.479Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.339Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.380Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.068Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:23.113Z: Resized worker pool to 2, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:27.006Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:27.054Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 2:10:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:27.307Z: Workers have started successfully.
Oct 29, 2018 2:10:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:29.275Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:28.752Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:10:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:33.057Z: Workers have started successfully.
Oct 29, 2018 2:10:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:10:44.154Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 2:11:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:02.275Z: Cleaning up.
Oct 29, 2018 2:11:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:02.367Z: Stopping worker pool...
Oct 29, 2018 2:11:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:21.115Z: Cleaning up.
Oct 29, 2018 2:11:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:21.235Z: Stopping worker pool...
Oct 29, 2018 2:11:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:27.677Z: Cleaning up.
Oct 29, 2018 2:11:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:27.796Z: Stopping worker pool...
Oct 29, 2018 2:11:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:43.611Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Close
Oct 29, 2018 2:11:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:43.722Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_488/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_489/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 2:11:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:48.411Z: Cleaning up.
Oct 29, 2018 2:11:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T02:11:48.517Z: Stopping worker pool...
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.234Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T02:13:01.268Z RUNNING SqlQuery2
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.285Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.306Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T02:13:01.314Z RUNNING SqlQuery1
2018-10-29T02:13:01.341Z RUNNING SqlQuery0
Oct 29, 2018 2:13:01 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T02:13:01.561Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T02:13:01.589Z RUNNING SqlQuery3
2018-10-29T02:13:02.229Z new perf {"snapshots":null,"runtimeSec":72.556,"numEvents":10000000,"eventsPerSec":137824.57687854898,"eventBytesPerSec":1.7690678882518332E7,"numResults":9200000,"resultsPerSec":126798.61072826506,"resultBytesPerSec":1.274318520866641E7,"startupDelaySec":-167.425,"processingDelaySec":0.741,"shutdownDelaySec":94.869,"timeDilation":13.781768564970507,"errors":null,"jobId":null}
2018-10-29T02:13:02.251Z new perf {"snapshots":null,"runtimeSec":52.853,"numEvents":10000000,"eventsPerSec":189204.01869335704,"eventBytesPerSec":2.428556367661249E7,"numResults":83527,"resultsPerSec":1580.3644069400034,"resultBytesPerSec":25285.830511040054,"startupDelaySec":-172.772,"processingDelaySec":1.034,"shutdownDelaySec":119.919,"timeDilation":18.919266645223544,"errors":null,"jobId":null}
2018-10-29T02:13:02.327Z new perf {"snapshots":null,"runtimeSec":81.636,"numEvents":10000000,"eventsPerSec":122494.97770591406,"eventBytesPerSec":1.5723025344210887E7,"numResults":9200000,"resultsPerSec":112695.37948944094,"resultBytesPerSec":1.1325818829927973E7,"startupDelaySec":-182.109,"processingDelaySec":0.834,"shutdownDelaySec":100.473,"timeDilation":12.248885295702877,"errors":null,"jobId":null}
2018-10-29T02:13:02.653Z new perf {"snapshots":null,"runtimeSec":76.655,"numEvents":10000000,"eventsPerSec":130454.6344008871,"eventBytesPerSec":1.674469893679473E7,"numResults":9054,"resultsPerSec":118.11362598656316,"resultBytesPerSec":3772.2914356532515,"startupDelaySec":-150.028,"processingDelaySec":72.905,"shutdownDelaySec":73.373,"timeDilation":12.915008805687823,"errors":null,"jobId":null}
2018-10-29T02:13:17.279Z RUNNING SqlQuery1
2018-10-29T02:13:17.288Z RUNNING SqlQuery2
2018-10-29T02:13:17.361Z RUNNING SqlQuery0
2018-10-29T02:13:17.692Z RUNNING SqlQuery3
2018-10-29T02:13:18.135Z no activity
2018-10-29T02:13:18.182Z no activity
2018-10-29T02:13:18.261Z no activity
2018-10-29T02:13:18.603Z no activity
2018-10-29T02:13:33.174Z RUNNING SqlQuery1
2018-10-29T02:13:33.224Z RUNNING SqlQuery2
2018-10-29T02:13:33.294Z RUNNING SqlQuery0
2018-10-29T02:13:33.635Z RUNNING SqlQuery3
2018-10-29T02:13:33.885Z no activity
2018-10-29T02:13:33.904Z no activity
2018-10-29T02:13:34.018Z no activity
2018-10-29T02:13:34.458Z no activity
2018-10-29T02:13:48.929Z RUNNING SqlQuery1
2018-10-29T02:13:48.930Z RUNNING SqlQuery2
2018-10-29T02:13:49.064Z RUNNING SqlQuery0
2018-10-29T02:13:49.485Z RUNNING SqlQuery3
2018-10-29T02:13:49.642Z no activity
2018-10-29T02:13:49.774Z no activity
2018-10-29T02:13:49.858Z no activity
2018-10-29T02:13:50.262Z no activity
2018-10-29T02:14:04.674Z RUNNING SqlQuery2
2018-10-29T02:14:04.812Z RUNNING SqlQuery1
2018-10-29T02:14:04.909Z RUNNING SqlQuery0
2018-10-29T02:14:05.307Z RUNNING SqlQuery3
2018-10-29T02:14:05.514Z no activity
2018-10-29T02:14:05.629Z no activity
2018-10-29T02:14:05.727Z no activity
2018-10-29T02:14:06.203Z no activity
2018-10-29T02:14:20.560Z RUNNING SqlQuery2
2018-10-29T02:14:20.666Z RUNNING SqlQuery1
2018-10-29T02:14:20.769Z RUNNING SqlQuery0
2018-10-29T02:14:21.242Z RUNNING SqlQuery3
2018-10-29T02:14:21.244Z no activity
2018-10-29T02:14:21.388Z no activity
2018-10-29T02:14:21.549Z no activity
2018-10-29T02:14:22.084Z no activity
2018-10-29T02:14:36.277Z RUNNING SqlQuery2
2018-10-29T02:14:36.419Z RUNNING SqlQuery1
2018-10-29T02:14:36.580Z RUNNING SqlQuery0
2018-10-29T02:14:37.011Z no activity
2018-10-29T02:14:37.122Z RUNNING SqlQuery3
2018-10-29T02:14:37.168Z no activity
2018-10-29T02:14:37.367Z no activity
2018-10-29T02:14:38.049Z no activity
2018-10-29T02:14:52.051Z RUNNING SqlQuery2
2018-10-29T02:14:52.202Z RUNNING SqlQuery1
2018-10-29T02:14:52.410Z DONE SqlQuery0
2018-10-29T02:14:52.828Z no activity
2018-10-29T02:14:52.923Z no activity
2018-10-29T02:14:53.079Z RUNNING SqlQuery3
2018-10-29T02:14:53.932Z no activity
2018-10-29T02:15:07.860Z DONE SqlQuery2
2018-10-29T02:15:07.964Z DONE SqlQuery1
2018-10-29T02:15:08.969Z RUNNING SqlQuery3
2018-10-29T02:15:09.874Z no activity
2018-10-29T02:15:24.993Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 6 mins 32.992 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 45s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/ff6o5johwrfg2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #851
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/851/display/redirect>
------------------------------------------
[...truncated 1.40 MB...]
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:07.871Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.121Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.708Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.782Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.826Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.929Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:11.967Z: Fusing consumer SqlQuery0/SqlQuery0.Monitor into SqlQuery0.ReadBounded
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.014Z: Fusing consumer SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous) into SqlQuery0/SqlQuery0.Snoop
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.060Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_175/ParDo(Calc) into SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_21/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.108Z: Fusing consumer SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_21/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlQuery0.Serialize
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.149Z: Fusing consumer SqlQuery0.Format into SqlQuery0/SqlQuery0.Stamp
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.193Z: Fusing consumer SqlQuery0.DevNull into SqlQuery0.Format
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.230Z: Fusing consumer SqlQuery0/SqlQuery0.Stamp into SqlQuery0/SqlQuery0.Debug
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.276Z: Fusing consumer SqlQuery0/SqlQuery0.Debug into SqlQuery0/SqlQuery0.Forget
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.314Z: Fusing consumer SqlQuery0/SqlQuery0.Forget into SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.362Z: Fusing consumer SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_175/ParDo(Calc)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.410Z: Fusing consumer SqlQuery0/SqlQuery0.Snoop into SqlQuery0/SqlQuery0.Monitor
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.458Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous) into SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.507Z: Fusing consumer SqlQuery0/SqlQuery0/SqlQuery0.Serialize into SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.964Z: Executing operation SqlQuery0.ReadBounded+SqlQuery0/SqlQuery0.Monitor+SqlQuery0/SqlQuery0.Snoop+SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.Serialize+SqlQuery0/SqlQuery0/SqlTransform/BeamIOSourceRel_21/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlTransform/BeamCalcRel_175/ParDo(Calc)+SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0.Forget+SqlQuery0/SqlQuery0.Debug+SqlQuery0/SqlQuery0.Stamp+SqlQuery0.Format+SqlQuery0.DevNull
Oct 29, 2018 12:23:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.063Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-10-29T00:23:05.093Z: The requested max number of workers (4) is ignored as autoscaling is explicitly disabled (autoscalingAlgorithm=NONE).
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:08.452Z: Checking permissions granted to controller Service Account.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:12.611Z: Worker configuration: n1-standard-1 in us-central1-b.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.187Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.249Z: Expanding GroupByKey operations into optimizable parts.
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.308Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.417Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.476Z: Fusing consumer SqlQuery1/SqlQuery1.Monitor into SqlQuery1.ReadBounded
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.527Z: Fusing consumer SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous) into SqlQuery1/SqlQuery1.Snoop
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.580Z: Fusing consumer SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_176/ParDo(Calc)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.626Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_176/ParDo(Calc) into SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.666Z: Fusing consumer SqlQuery1.DevNull into SqlQuery1.Format
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.713Z: Fusing consumer SqlQuery1.Format into SqlQuery1/SqlQuery1.Stamp
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.762Z: Fusing consumer SqlQuery1/SqlQuery1.Stamp into SqlQuery1/SqlQuery1.Debug
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.812Z: Fusing consumer SqlQuery1/SqlQuery1.Debug into SqlQuery1/SqlQuery1.Forget
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.859Z: Fusing consumer SqlQuery1/SqlQuery1.Forget into SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.905Z: Fusing consumer SqlQuery1/SqlQuery1.Snoop into SqlQuery1/SqlQuery1.Monitor
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:13.953Z: Fusing consumer SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous) into SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:14.012Z: Fusing consumer SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:14.583Z: Executing operation SqlQuery1.ReadBounded+SqlQuery1/SqlQuery1.Monitor+SqlQuery1/SqlQuery1.Snoop+SqlQuery1/SqlQuery1/Filter/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlQuery1.SelectEvent/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamIOSourceRel_22/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1/SqlTransform/BeamCalcRel_176/ParDo(Calc)+SqlQuery1/SqlQuery1/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery1/SqlQuery1.Forget+SqlQuery1/SqlQuery1.Debug+SqlQuery1/SqlQuery1.Stamp+SqlQuery1.Format+SqlQuery1.DevNull
Oct 29, 2018 12:23:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:14.706Z: Starting 4 workers in us-central1-b...
Oct 29, 2018 12:23:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:23.952Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:24.172Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:28.652Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:34.777Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:23:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:56.749Z: Workers have started successfully.
Oct 29, 2018 12:23:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:58.461Z: Workers have started successfully.
Oct 29, 2018 12:24:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:23:59.950Z: Workers have started successfully.
Oct 29, 2018 12:24:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:02.437Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:02.469Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:02.821Z: Workers have started successfully.
Oct 29, 2018 12:24:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:03.824Z: Workers have started successfully.
Oct 29, 2018 12:24:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:03.676Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:03.723Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.612Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.659Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.886Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:08.957Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:07.887Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:07.934Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 29, 2018 12:24:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:09.207Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:14.035Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:14.386Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:26.938Z: Workers have started successfully.
Oct 29, 2018 12:24:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:28.923Z: Workers have started successfully.
Oct 29, 2018 12:24:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:29.897Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 29, 2018 12:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:34.001Z: Workers have started successfully.
Oct 29, 2018 12:24:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:53.585Z: Cleaning up.
Oct 29, 2018 12:24:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:24:53.676Z: Stopping worker pool...
Oct 29, 2018 12:25:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.720Z: Cleaning up.
Oct 29, 2018 12:25:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.832Z: Stopping worker pool...
Oct 29, 2018 12:25:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.783Z: Cleaning up.
Oct 29, 2018 12:25:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:28.900Z: Stopping worker pool...
Oct 29, 2018 12:25:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:44.285Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Close
Oct 29, 2018 12:25:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:44.377Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 29, 2018 12:25:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:49.109Z: Cleaning up.
Oct 29, 2018 12:25:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-29T00:25:49.216Z: Stopping worker pool...
Oct 29, 2018 12:27:05 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T00:27:05.988Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T00:27:06.016Z RUNNING SqlQuery1
Oct 29, 2018 12:27:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T00:27:06.025Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 29, 2018 12:27:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T00:27:06.026Z Waiting for main pipeline to 'finish'
Oct 29, 2018 12:27:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-29T00:27:06.041Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-29T00:27:06.057Z RUNNING SqlQuery2
2018-10-29T00:27:06.057Z RUNNING SqlQuery3
2018-10-29T00:27:06.076Z RUNNING SqlQuery0
2018-10-29T00:27:06.923Z new perf {"snapshots":null,"runtimeSec":78.176,"numEvents":10000000,"eventsPerSec":127916.49611133852,"eventBytesPerSec":1.6418912415575111E7,"numResults":9200000,"resultsPerSec":117683.17642243144,"resultBytesPerSec":1.182708946479738E7,"startupDelaySec":-175.844,"processingDelaySec":0.748,"shutdownDelaySec":97.668,"timeDilation":12.791010028653295,"errors":null,"jobId":null}
2018-10-29T00:27:06.936Z new perf {"snapshots":null,"runtimeSec":43.609,"numEvents":10000000,"eventsPerSec":229310.4634364466,"eventBytesPerSec":2.9433486138182484E7,"numResults":83527,"resultsPerSec":1915.3615079456074,"resultBytesPerSec":30645.78412712972,"startupDelaySec":-176.264,"processingDelaySec":1.114,"shutdownDelaySec":132.66,"timeDilation":22.929670480864043,"errors":null,"jobId":null}
2018-10-29T00:27:06.949Z new perf {"snapshots":null,"runtimeSec":76.668,"numEvents":10000000,"eventsPerSec":130432.51421714404,"eventBytesPerSec":1.6741859667657953E7,"numResults":9200000,"resultsPerSec":119997.91307977252,"resultBytesPerSec":1.2059719126623884E7,"startupDelaySec":-174.29,"processingDelaySec":0.685,"shutdownDelaySec":97.622,"timeDilation":13.04259925914332,"errors":null,"jobId":null}
2018-10-29T00:27:07.081Z new perf {"snapshots":null,"runtimeSec":93.182,"numEvents":10000000,"eventsPerSec":107316.86377197312,"eventBytesPerSec":1.3774815919383572E7,"numResults":9054,"resultsPerSec":97.16468845914447,"resultBytesPerSec":3103.228091262261,"startupDelaySec":-170.474,"processingDelaySec":89.515,"shutdownDelaySec":77.292,"timeDilation":10.62436951342534,"errors":null,"jobId":null}
2018-10-29T00:27:21.958Z RUNNING SqlQuery2
2018-10-29T00:27:21.971Z RUNNING SqlQuery0
2018-10-29T00:27:21.976Z RUNNING SqlQuery1
2018-10-29T00:27:22.116Z RUNNING SqlQuery3
2018-10-29T00:27:22.654Z no activity
2018-10-29T00:27:22.674Z no activity
2018-10-29T00:27:22.691Z no activity
2018-10-29T00:27:22.972Z no activity
2018-10-29T00:27:37.719Z RUNNING SqlQuery2
2018-10-29T00:27:37.751Z RUNNING SqlQuery0
2018-10-29T00:27:37.765Z RUNNING SqlQuery1
2018-10-29T00:27:38.005Z RUNNING SqlQuery3
2018-10-29T00:27:38.431Z no activity
2018-10-29T00:27:38.435Z no activity
2018-10-29T00:27:38.570Z no activity
2018-10-29T00:27:38.792Z no activity
2018-10-29T00:27:53.463Z RUNNING SqlQuery2
2018-10-29T00:27:53.465Z RUNNING SqlQuery1
2018-10-29T00:27:53.602Z RUNNING SqlQuery0
2018-10-29T00:27:53.822Z RUNNING SqlQuery3
2018-10-29T00:27:54.122Z no activity
2018-10-29T00:27:54.249Z no activity
2018-10-29T00:27:54.324Z no activity
2018-10-29T00:27:54.784Z no activity
2018-10-29T00:28:09.167Z RUNNING SqlQuery1
2018-10-29T00:28:09.292Z RUNNING SqlQuery2
2018-10-29T00:28:09.354Z RUNNING SqlQuery0
2018-10-29T00:28:09.820Z RUNNING SqlQuery3
2018-10-29T00:28:09.871Z no activity
2018-10-29T00:28:10.003Z no activity
2018-10-29T00:28:10.065Z no activity
2018-10-29T00:28:10.704Z no activity
2018-10-29T00:28:24.901Z RUNNING SqlQuery1
2018-10-29T00:28:25.047Z DONE SqlQuery2
2018-10-29T00:28:25.098Z RUNNING SqlQuery0
2018-10-29T00:28:25.650Z no activity
2018-10-29T00:28:25.743Z RUNNING SqlQuery3
2018-10-29T00:28:25.768Z no activity
2018-10-29T00:28:26.641Z no activity
2018-10-29T00:28:40.701Z RUNNING SqlQuery1
2018-10-29T00:28:40.815Z DONE SqlQuery0
2018-10-29T00:28:41.423Z no activity
2018-10-29T00:28:41.685Z RUNNING SqlQuery3
2018-10-29T00:28:42.592Z no activity
2018-10-29T00:28:56.469Z DONE SqlQuery1
2018-10-29T00:28:57.624Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 6 mins 1.035 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 15s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/qmwd2ffxm367w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #850
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/850/display/redirect?page=changes>
Changes:
[github] [BEAM-5886] Fix incorrectly formulated condition in checkState method
------------------------------------------
[...truncated 1.25 MB...]
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.056Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.133Z: Expanding GroupByKey operations into optimizable parts.
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.176Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.308Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.348Z: Unzipping flatten s17 for input s15.org.apache.beam.sdk.values.PCollection.<init>:402#c47715dbb819979d
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.394Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify, through flatten SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/Flatten, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable0
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.432Z: Fusing consumer SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.465Z: Fusing consumer SqlQuery3.Format into SqlQuery3/SqlQuery3.Stamp
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.492Z: Fusing consumer SqlQuery3.DevNull into SqlQuery3.Format
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.540Z: Fusing consumer SqlQuery3/SqlQuery3.Forget into SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.582Z: Fusing consumer SqlQuery3/SqlQuery3.Debug into SqlQuery3/SqlQuery3.Forget
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.627Z: Fusing consumer SqlQuery3/SqlQuery3.Stamp into SqlQuery3/SqlQuery3.Debug
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.673Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.713Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.757Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.805Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.849Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Read
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.888Z: Unzipping flatten s17-u13 for input s18-reify-value0-c11
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.936Z: Fusing unzipped copy of SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Write, through flatten s17-u13, into producer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:17.983Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.021Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/Window.Into()/Window.Assign
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.057Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable1
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.102Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Write into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.142Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable0 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/left_ExtractJoinFields/Map
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.189Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.229Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_357/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_40/Convert.ConvertTransform/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.277Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_356/ParDo(Calc) into SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_34/Convert.ConvertTransform/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.318Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/right_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_357/ParDo(Calc)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.366Z: Fusing consumer SqlQuery3/SqlQuery3.Snoop into SqlQuery3/SqlQuery3.Monitor
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.403Z: Fusing consumer SqlQuery3/SqlQuery3/Window.Into()/Window.Assign into SqlQuery3/SqlQuery3.Snoop
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.454Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_40/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.500Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable1 into SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/right_ExtractJoinFields/Map
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.548Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_34/Convert.ConvertTransform/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.598Z: Fusing consumer SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/left_ExtractJoinFields/Map into SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_356/ParDo(Calc)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.640Z: Fusing consumer SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous) into SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:18.688Z: Fusing consumer SqlQuery3/SqlQuery3.Monitor into SqlQuery3.ReadBounded
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:19.171Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Create
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:19.277Z: Starting 4 workers in us-central1-b...
Oct 28, 2018 9:59:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:19.462Z: Executing operation SqlQuery3.ReadBounded+SqlQuery3/SqlQuery3.Monitor+SqlQuery3/SqlQuery3.Snoop+SqlQuery3/SqlQuery3/Window.Into()/Window.Assign+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.Filter.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Person/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_40/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_357/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/right_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable1+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlQuery3.ToRecords.Auction/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamIOSourceRel_34/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_356/ParDo(Calc)+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/left_ExtractJoinFields/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/MakeUnionTable0+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Reify+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Session/Flatten+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Write
Oct 28, 2018 9:59:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:29.089Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 9:59:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:29.556Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 9:59:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:30.086Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 9:59:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T21:59:32.452Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.774Z: Workers have started successfully.
Oct 28, 2018 10:00:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.685Z: Workers have started successfully.
Oct 28, 2018 10:00:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.616Z: Workers have started successfully.
Oct 28, 2018 10:00:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:03.570Z: Workers have started successfully.
Oct 28, 2018 10:00:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:23.194Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:23.242Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.196Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.243Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.304Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:25.348Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:26.894Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:26.937Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:30.888Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:28.722Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:28.768Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Oct 28, 2018 10:00:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:30.688Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:32.552Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.715Z: Workers have started successfully.
Oct 28, 2018 10:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.830Z: Workers have started successfully.
Oct 28, 2018 10:00:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.917Z: Workers have started successfully.
Oct 28, 2018 10:00:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:34.975Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Oct 28, 2018 10:00:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:00:35.076Z: Workers have started successfully.
Oct 28, 2018 10:01:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:00.467Z: Cleaning up.
Oct 28, 2018 10:01:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:00.586Z: Stopping worker pool...
Oct 28, 2018 10:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:28.563Z: Cleaning up.
Oct 28, 2018 10:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:28.694Z: Stopping worker pool...
Oct 28, 2018 10:01:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:33.503Z: Cleaning up.
Oct 28, 2018 10:01:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:01:33.615Z: Stopping worker pool...
Oct 28, 2018 10:02:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:01.522Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Close
Oct 28, 2018 10:02:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:01.616Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_358/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_359/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Forget+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Oct 28, 2018 10:02:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:06.344Z: Cleaning up.
Oct 28, 2018 10:02:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-10-28T22:02:06.461Z: Stopping worker pool...
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T22:03:10.713Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T22:03:10.715Z Waiting for main pipeline to 'finish'
2018-10-28T22:03:10.744Z RUNNING SqlQuery2
2018-10-28T22:03:10.766Z RUNNING SqlQuery1
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2018-10-28T22:03:10.810Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T22:03:10.845Z RUNNING SqlQuery3
Oct 28, 2018 10:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2018-10-28T22:03:10.899Z Waiting for main pipeline to 'finish'
2018-10-28T22:03:10.942Z RUNNING SqlQuery0
2018-10-28T22:03:11.674Z new perf {"snapshots":null,"runtimeSec":43.917,"numEvents":10000000,"eventsPerSec":227702.2565293622,"eventBytesPerSec":2.9227062344877835E7,"numResults":83527,"resultsPerSec":1901.9286381128036,"resultBytesPerSec":30430.858209804857,"startupDelaySec":-174.373,"processingDelaySec":1.155,"shutdownDelaySec":130.456,"timeDilation":22.768859439397044,"errors":null,"jobId":null}
2018-10-28T22:03:11.813Z new perf {"snapshots":null,"runtimeSec":73.098,"numEvents":10000000,"eventsPerSec":136802.64849927495,"eventBytesPerSec":1.7559507743029904E7,"numResults":9200000,"resultsPerSec":125858.43661933295,"resultBytesPerSec":1.264869826807847E7,"startupDelaySec":-175.512,"processingDelaySec":0.715,"shutdownDelaySec":102.414,"timeDilation":13.679580836684998,"errors":null,"jobId":null}
2018-10-28T22:03:11.945Z new perf {"snapshots":null,"runtimeSec":76.89,"numEvents":10000000,"eventsPerSec":130055.92404734036,"eventBytesPerSec":1.6693521875406425E7,"numResults":9200000,"resultsPerSec":119651.45012355312,"resultBytesPerSec":1.2024899804916114E7,"startupDelaySec":-175.525,"processingDelaySec":0.726,"shutdownDelaySec":98.635,"timeDilation":13.0049421251138,"errors":null,"jobId":null}
2018-10-28T22:03:11.988Z new perf {"snapshots":null,"runtimeSec":48.892,"numEvents":10000000,"eventsPerSec":204532.43884480078,"eventBytesPerSec":2.625306587989855E7,"numResults":9054,"resultsPerSec":185.18367013008262,"resultBytesPerSec":5914.362267855681,"startupDelaySec":-113.62,"processingDelaySec":45.134,"shutdownDelaySec":64.728,"timeDilation":20.248711445635276,"errors":null,"jobId":null}
2018-10-28T22:03:26.715Z RUNNING SqlQuery2
2018-10-28T22:03:26.844Z RUNNING SqlQuery1
2018-10-28T22:03:26.984Z RUNNING SqlQuery0
2018-10-28T22:03:27.021Z RUNNING SqlQuery3
2018-10-28T22:03:27.480Z no activity
2018-10-28T22:03:27.621Z no activity
2018-10-28T22:03:27.736Z no activity
2018-10-28T22:03:27.834Z no activity
2018-10-28T22:03:42.513Z RUNNING SqlQuery2
2018-10-28T22:03:42.664Z RUNNING SqlQuery1
2018-10-28T22:03:42.792Z RUNNING SqlQuery0
2018-10-28T22:03:42.863Z RUNNING SqlQuery3
2018-10-28T22:03:43.206Z no activity
2018-10-28T22:03:43.486Z no activity
2018-10-28T22:03:43.493Z no activity
2018-10-28T22:03:43.684Z no activity
2018-10-28T22:03:58.235Z RUNNING SqlQuery2
2018-10-28T22:03:58.513Z RUNNING SqlQuery1
2018-10-28T22:03:58.526Z RUNNING SqlQuery0
2018-10-28T22:03:58.709Z RUNNING SqlQuery3
2018-10-28T22:03:58.966Z no activity
2018-10-28T22:03:59.227Z no activity
2018-10-28T22:03:59.227Z no activity
2018-10-28T22:03:59.517Z no activity
2018-10-28T22:04:14.004Z RUNNING SqlQuery2
2018-10-28T22:04:14.255Z RUNNING SqlQuery0
2018-10-28T22:04:14.255Z RUNNING SqlQuery1
2018-10-28T22:04:14.548Z RUNNING SqlQuery3
2018-10-28T22:04:14.791Z no activity
2018-10-28T22:04:14.991Z no activity
2018-10-28T22:04:15.037Z no activity
2018-10-28T22:04:15.308Z no activity
2018-10-28T22:04:29.821Z DONE SqlQuery2
2018-10-28T22:04:30.022Z RUNNING SqlQuery0
2018-10-28T22:04:30.072Z DONE SqlQuery1
2018-10-28T22:04:30.337Z RUNNING SqlQuery3
2018-10-28T22:04:30.758Z no activity
2018-10-28T22:04:31.115Z no activity
2018-10-28T22:04:45.797Z RUNNING SqlQuery0
2018-10-28T22:04:46.145Z RUNNING SqlQuery3
2018-10-28T22:04:46.534Z no activity
2018-10-28T22:04:47.137Z no activity
2018-10-28T22:05:01.562Z RUNNING SqlQuery0
2018-10-28T22:05:02.168Z RUNNING SqlQuery3
2018-10-28T22:05:02.270Z no activity
2018-10-28T22:05:02.999Z no activity
2018-10-28T22:05:17.307Z DONE SqlQuery0
2018-10-28T22:05:18.030Z RUNNING SqlQuery3
2018-10-28T22:05:18.862Z no activity
2018-10-28T22:05:33.888Z RUNNING SqlQuery3
2018-10-28T22:05:34.811Z no activity
2018-10-28T22:05:49.850Z DONE SqlQuery3
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 6 mins 48.099 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_172/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 1s
68 actionable tasks: 2 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/sgrsqxo5wmsja
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org