You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/04/29 19:07:44 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#2552
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/2552/display/redirect?page=changes>
Changes:
[valentyn] Adds a possibility to pass a project that hosts Cloud Spanner instance
------------------------------------------
[...truncated 763.58 KB...]
Apr 29, 2019 7:04:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:04:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:04:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:04:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:04:21.434Z no activity
2019-04-29T19:04:36.487Z RUNNING Query0
Apr 29, 2019 7:04:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:04:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:04:37 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:04:37 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:04:38.245Z no activity
2019-04-29T19:04:53.411Z RUNNING Query0
Apr 29, 2019 7:04:53 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:04:53 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:04:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:04:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:04:54.723Z no activity
2019-04-29T19:05:09.784Z RUNNING Query0
Apr 29, 2019 7:05:09 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:05:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:05:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:05:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:05:11.306Z no activity
2019-04-29T19:05:26.387Z RUNNING Query0
Apr 29, 2019 7:05:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:05:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:05:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:05:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:05:28.022Z no activity
2019-04-29T19:05:43.066Z RUNNING Query0
Apr 29, 2019 7:05:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:05:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:05:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:05:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:05:44.098Z no activity
2019-04-29T19:05:59.197Z RUNNING Query0
Apr 29, 2019 7:05:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:05:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:05:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:06:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:06:00.619Z no activity
2019-04-29T19:06:15.760Z RUNNING Query0
Apr 29, 2019 7:06:15 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:06:15 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:06:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:06:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:06:17.040Z no activity
2019-04-29T19:06:32.245Z RUNNING Query0
Apr 29, 2019 7:06:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:06:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:06:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:06:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:06:33.834Z no activity
2019-04-29T19:06:49.009Z RUNNING Query0
Apr 29, 2019 7:06:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:06:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:06:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:06:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:06:50.449Z no activity
2019-04-29T19:07:05.528Z RUNNING Query0
Apr 29, 2019 7:07:05 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:07:05 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:07:06 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:07:06 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:07:06.743Z no activity
2019-04-29T19:07:21.794Z RUNNING Query0
Apr 29, 2019 7:07:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:07:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:07:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:07:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T19:07:23.436Z no activity
2019-04-29T19:07:38.532Z FAILED Query0
Apr 29, 2019 7:07:38 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 7:07:38 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 7:07:38 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 7:07:38 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
==========================================================================================
Run started 2019-04-29T18:42:23.578Z and ran for PT1515.022S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardHours":0,"standardMinutes":10,"standardDays":0,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 56.0 178561.9 9200000
0002 37.9 263629.7 83527
0003 54.2 184471.2 59507
0004 56.1 17835.2 140
0005 83.1 120393.4 4567
0006 57.3 17442.9 8902
0007 105.9 94450.1 100
0008 53.1 188377.1 92833
0009 46.9 21321.1 32548
0010 77.2 129506.8 -1
*** Job was unexpectedly updated ***
0011 75.2 133001.7 1839657
0012 48.0 208281.3 199929
0013 59.6 167776.8 9200000
0014 135.6 73731.6 9200000
==========================================================================================
==========================================================================================
Run started 2019-04-29T18:42:23.578Z and ran for PT1518.526S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardHours":0,"standardMinutes":10,"standardDays":0,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 56.0 178561.9 9200000
0002 37.9 263629.7 83527
0003 54.2 184471.2 59507
0004 56.1 17835.2 140
0005 83.1 120393.4 4567
0006 57.3 17442.9 8902
0007 105.9 94450.1 100
0008 53.1 188377.1 92833
0009 46.9 21321.1 32548
0010 77.2 129506.8 -1
*** Job was unexpectedly updated ***
0011 75.2 133001.7 1839657
0012 48.0 208281.3 199929
0013 59.6 167776.8 9200000
0014 135.6 73731.6 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 26m 47s
76 actionable tasks: 52 executed, 24 from cache
Publishing build scan...
https://gradle.com/s/hg3ova26dj2xs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #2556
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/2556/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#2555
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/2555/display/redirect?page=changes>
Changes:
[relax] Ensure that all nested schemas are given ids, and fix bug where nullable
[chamikara] Updates Dataflow runner to support external ParDos.
------------------------------------------
[...truncated 1.01 MB...]
INFO: 2019-04-29T21:22:55.053Z: Workers have started successfully.
Apr 29, 2019 9:22:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:22:56.708Z: Workers have started successfully.
Apr 29, 2019 9:22:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:22:57.960Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:22:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:22:57.995Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:22:57.797Z: Workers have started successfully.
Apr 29, 2019 9:23:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:22:59.741Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:22:59.784Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:00.828Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:00.883Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:03.330Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:03.480Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:03.523Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:05.079Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:17.669Z: Workers have started successfully.
Apr 29, 2019 9:23:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:17.991Z: Workers have started successfully.
Apr 29, 2019 9:23:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:18.594Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:18.638Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:18.789Z: Workers have started successfully.
Apr 29, 2019 9:23:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:18.607Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:18.649Z: Resized worker pool to 1, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:22.250Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:23.992Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:24.035Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:24.722Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:24.080Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:24.122Z: Resized worker pool to 3, though goal was 4. This could be a quota issue.
Apr 29, 2019 9:23:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:26.047Z: Workers have started successfully.
Apr 29, 2019 9:23:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:26.423Z: Workers have started successfully.
Apr 29, 2019 9:23:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:29.347Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:29.446Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 29, 2019 9:23:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:45.313Z: Cleaning up.
Apr 29, 2019 9:23:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:45.423Z: Stopping worker pool...
Apr 29, 2019 9:23:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:48.961Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_493/InnerJoin/CoGBK/GBK/Close
Apr 29, 2019 9:23:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:49.053Z: Executing operation SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_493/InnerJoin/CoGBK/GBK/Read+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_493/InnerJoin/CoGBK/GBK/GroupByWindow+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_493/InnerJoin/CoGBK/ConstructCoGbkResultFn+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_493/InnerJoin/Join+SqlQuery3/SqlQuery3/SqlTransform/BeamJoinRel_493/JoinParts2WholeRow/Map+SqlQuery3/SqlQuery3/SqlTransform/BeamCalcRel_494/ParDo(Calc)+SqlQuery3/SqlQuery3/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery3/SqlQuery3.Debug+SqlQuery3/SqlQuery3.Stamp+SqlQuery3.Format+SqlQuery3.DevNull
Apr 29, 2019 9:23:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:54.580Z: Cleaning up.
Apr 29, 2019 9:23:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:23:54.680Z: Stopping worker pool...
Apr 29, 2019 9:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:08.532Z: Cleaning up.
Apr 29, 2019 9:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:08.649Z: Stopping worker pool...
Apr 29, 2019 9:24:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:08.286Z: Cleaning up.
Apr 29, 2019 9:24:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:08.418Z: Stopping worker pool...
Apr 29, 2019 9:24:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:34.552Z: Executing operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamJoinRel_445/InnerJoin/CoGBK/GBK/Close
Apr 29, 2019 9:24:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:34.641Z: Executing operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamJoinRel_445/InnerJoin/CoGBK/GBK/Read+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamJoinRel_445/InnerJoin/CoGBK/GBK/GroupByWindow+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamJoinRel_445/InnerJoin/CoGBK/ConstructCoGbkResultFn+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamJoinRel_445/InnerJoin/Join+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamJoinRel_445/JoinParts2WholeRow/Map+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_446/ParDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/ResultToBid/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Debug+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Stamp+SqlBoundedSideInputJoin.Format+SqlBoundedSideInputJoin.DevNull
Apr 29, 2019 9:24:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:59.409Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_578/Group.CombineFieldsByFields/Group.ByFields/GroupByKey/Close
Apr 29, 2019 9:24:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:59.464Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_575/Group.CombineByFields/Group.ByFields/GroupByKey/Close
Apr 29, 2019 9:24:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:59.508Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_578/Group.CombineFieldsByFields/Group.ByFields/GroupByKey/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_578/Group.CombineFieldsByFields/Combine.GroupedValues+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_578/Group.CombineFieldsByFields/Combine.GroupedValues/Extract+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_578/mergeRecord+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_579/ParDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/BeamJoinRel.ExtractJoinKeys/right_ExtractJoinFields/Map+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/MakeUnionTable1+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/Write
Apr 29, 2019 9:24:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:24:59.593Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_575/Group.CombineByFields/Group.ByFields/GroupByKey/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_575/Group.CombineByFields/Combine.GroupedValues+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_575/Group.CombineByFields/Combine.GroupedValues/Extract+SqlQuery7/SqlQuery7/SqlTransform/BeamAggregationRel_575/mergeRecord+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_576/ParDo(Calc)+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/BeamJoinRel.ExtractJoinKeys/left_ExtractJoinFields/Map+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/MakeUnionTable0+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/Reify+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/Write
Apr 29, 2019 9:25:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:25:43.022Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/Close
Apr 29, 2019 9:25:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:25:43.158Z: Executing operation SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/Read+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/GBK/GroupByWindow+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/CoGBK/ConstructCoGbkResultFn+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/InnerJoin/Join+SqlQuery7/SqlQuery7/SqlTransform/BeamJoinRel_580/JoinParts2WholeRow/Map+SqlQuery7/SqlQuery7/SqlTransform/BeamCalcRel_581/ParDo(Calc)+SqlQuery7/SqlQuery7/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery7/SqlQuery7.Debug+SqlQuery7/SqlQuery7.Stamp+SqlQuery7.Format+SqlQuery7.DevNull
Apr 29, 2019 9:25:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:25:47.150Z: Cleaning up.
Apr 29, 2019 9:25:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:25:47.250Z: Stopping worker pool...
Apr 29, 2019 9:26:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:26:04.306Z: Cleaning up.
Apr 29, 2019 9:26:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-29T21:26:04.406Z: Stopping worker pool...
Apr 29, 2019 9:26:05 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2019-04-29T21:26:05.929Z Waiting for main pipeline to 'finish'
2019-04-29T21:26:05.962Z RUNNING SqlQuery1
Apr 29, 2019 9:26:05 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2019-04-29T21:26:05.983Z Waiting for main pipeline to 'finish'
2019-04-29T21:26:06.025Z RUNNING SqlQuery0
Apr 29, 2019 9:26:06 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2019-04-29T21:26:06.030Z Waiting for main pipeline to 'finish'
2019-04-29T21:26:06.158Z RUNNING SqlQuery2
Apr 29, 2019 9:26:06 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2019-04-29T21:26:06.676Z Waiting for main pipeline to 'finish'
Apr 29, 2019 9:26:06 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2019-04-29T21:26:06.707Z Waiting for main pipeline to 'finish'
2019-04-29T21:26:06.708Z RUNNING SqlQuery7
2019-04-29T21:26:06.765Z RUNNING SqlQuery3
2019-04-29T21:26:06.990Z new perf {"snapshots":null,"runtimeSec":61.136,"numEvents":10000000,"eventsPerSec":163569.746139754,"eventBytesPerSec":2.099523843561895E7,"numResults":9200000,"resultsPerSec":150484.16644857367,"resultBytesPerSec":1.512356951714211E7,"startupDelaySec":-178.815,"processingDelaySec":0.468,"shutdownDelaySec":117.68,"timeDilation":16.3561567652447,"errors":null,"jobId":null}
2019-04-29T21:26:07.042Z new perf {"snapshots":null,"runtimeSec":44.097,"numEvents":10000000,"eventsPerSec":226772.7963353516,"eventBytesPerSec":2.9107760097058754E7,"numResults":83527,"resultsPerSec":1894.1651359502914,"resultBytesPerSec":30306.642175204663,"startupDelaySec":-186.064,"processingDelaySec":0.61,"shutdownDelaySec":141.972,"timeDilation":22.67591899675715,"errors":null,"jobId":null}
2019-04-29T21:26:07.043Z new perf {"snapshots":null,"runtimeSec":67.193,"numEvents":10000000,"eventsPerSec":148825.02641644218,"eventBytesPerSec":1.910265797032429E7,"numResults":9200000,"resultsPerSec":136919.02430312682,"resultBytesPerSec":1.3760280773294838E7,"startupDelaySec":-185.869,"processingDelaySec":0.494,"shutdownDelaySec":118.676,"timeDilation":14.881758516512138,"errors":null,"jobId":null}
Apr 29, 2019 9:26:07 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned. State value RUNNING
2019-04-29T21:26:07.757Z Waiting for main pipeline to 'finish'
2019-04-29T21:26:07.790Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:26:07.818Z new perf {"snapshots":null,"runtimeSec":53.009,"numEvents":10000000,"eventsPerSec":188647.21085098755,"eventBytesPerSec":2.4214093776528515E7,"numResults":9054,"resultsPerSec":170.80118470448414,"resultBytesPerSec":5455.017072572582,"startupDelaySec":-186.38,"processingDelaySec":49.35,"shutdownDelaySec":133.371,"timeDilation":18.723235676960517,"errors":null,"jobId":null}
2019-04-29T21:26:07.837Z new perf {"snapshots":null,"runtimeSec":156.977,"numEvents":10000000,"eventsPerSec":63703.5998904298,"eventBytesPerSec":8176770.463188875,"numResults":100,"resultsPerSec":0.6370359989042981,"resultBytesPerSec":64.35974696930123,"startupDelaySec":-159.923,"processingDelaySec":137.254,"shutdownDelaySec":2.946,"timeDilation":6.3066563891525504,"errors":null,"jobId":null}
2019-04-29T21:26:08.809Z new perf {"snapshots":null,"runtimeSec":143.749,"numEvents":10000000,"eventsPerSec":69565.70132661793,"eventBytesPerSec":8929209.22580331,"numResults":9200000,"resultsPerSec":64000.445220488495,"resultBytesPerSec":2281280.53064717,"startupDelaySec":-164.621,"processingDelaySec":72.448,"shutdownDelaySec":20.872,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-04-29T21:26:22.027Z RUNNING SqlQuery1
2019-04-29T21:26:22.074Z RUNNING SqlQuery2
2019-04-29T21:26:22.122Z RUNNING SqlQuery0
2019-04-29T21:26:23.059Z no activity
2019-04-29T21:26:23.089Z RUNNING SqlQuery7
2019-04-29T21:26:23.089Z no activity
2019-04-29T21:26:23.097Z RUNNING SqlQuery3
2019-04-29T21:26:23.255Z no activity
2019-04-29T21:26:23.868Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:26:24.066Z no activity
2019-04-29T21:26:24.098Z no activity
2019-04-29T21:26:24.698Z no activity
2019-04-29T21:26:38.094Z RUNNING SqlQuery1
2019-04-29T21:26:38.134Z RUNNING SqlQuery2
2019-04-29T21:26:38.286Z RUNNING SqlQuery0
2019-04-29T21:26:39.078Z no activity
2019-04-29T21:26:39.118Z no activity
2019-04-29T21:26:39.120Z RUNNING SqlQuery7
2019-04-29T21:26:39.132Z RUNNING SqlQuery3
2019-04-29T21:26:39.234Z no activity
2019-04-29T21:26:39.807Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:26:40.043Z no activity
2019-04-29T21:26:40.154Z no activity
2019-04-29T21:26:40.731Z no activity
2019-04-29T21:26:54.113Z RUNNING SqlQuery2
2019-04-29T21:26:54.155Z RUNNING SqlQuery1
2019-04-29T21:26:54.264Z RUNNING SqlQuery0
2019-04-29T21:26:54.964Z no activity
2019-04-29T21:26:54.982Z no activity
2019-04-29T21:26:55.083Z RUNNING SqlQuery3
2019-04-29T21:26:55.221Z RUNNING SqlQuery7
2019-04-29T21:26:55.393Z no activity
2019-04-29T21:26:55.797Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:26:56.296Z no activity
2019-04-29T21:26:56.467Z no activity
2019-04-29T21:26:56.844Z no activity
2019-04-29T21:27:10.002Z RUNNING SqlQuery2
2019-04-29T21:27:10.026Z DONE SqlQuery1
2019-04-29T21:27:10.438Z RUNNING SqlQuery0
2019-04-29T21:27:10.810Z no activity
2019-04-29T21:27:11.291Z no activity
2019-04-29T21:27:11.342Z DONE SqlQuery3
2019-04-29T21:27:11.526Z RUNNING SqlQuery7
2019-04-29T21:27:11.900Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:27:12.699Z no activity
2019-04-29T21:27:12.916Z no activity
2019-04-29T21:27:25.915Z RUNNING SqlQuery2
2019-04-29T21:27:26.345Z DONE SqlQuery0
2019-04-29T21:27:26.752Z no activity
2019-04-29T21:27:27.731Z RUNNING SqlQuery7
2019-04-29T21:27:27.941Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:27:28.707Z no activity
2019-04-29T21:27:28.863Z no activity
2019-04-29T21:27:41.785Z RUNNING SqlQuery2
2019-04-29T21:27:42.635Z no activity
2019-04-29T21:27:43.741Z RUNNING SqlQuery7
2019-04-29T21:27:43.923Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:27:44.970Z no activity
2019-04-29T21:27:45.039Z no activity
2019-04-29T21:27:57.680Z RUNNING SqlQuery2
2019-04-29T21:27:58.547Z no activity
2019-04-29T21:28:00.018Z RUNNING SqlQuery7
2019-04-29T21:28:00.089Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:28:01.062Z no activity
2019-04-29T21:28:01.159Z no activity
2019-04-29T21:28:13.603Z DONE SqlQuery2
2019-04-29T21:28:16.204Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:28:16.253Z RUNNING SqlQuery7
2019-04-29T21:28:17.301Z no activity
2019-04-29T21:28:17.445Z no activity
2019-04-29T21:28:32.382Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:28:32.486Z RUNNING SqlQuery7
2019-04-29T21:28:33.452Z no activity
2019-04-29T21:28:33.635Z no activity
2019-04-29T21:28:48.515Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:28:48.710Z RUNNING SqlQuery7
2019-04-29T21:28:50.004Z no activity
2019-04-29T21:28:50.289Z no activity
2019-04-29T21:29:05.138Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:29:05.408Z RUNNING SqlQuery7
2019-04-29T21:29:06.313Z no activity
2019-04-29T21:29:06.821Z no activity
2019-04-29T21:29:21.455Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:29:21.862Z RUNNING SqlQuery7
2019-04-29T21:29:22.583Z no activity
2019-04-29T21:29:23.044Z no activity
2019-04-29T21:29:37.620Z RUNNING SqlBoundedSideInputJoin
2019-04-29T21:29:38.044Z DONE SqlQuery7
2019-04-29T21:29:38.965Z no activity
2019-04-29T21:29:54.004Z DONE SqlBoundedSideInputJoin
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 4s
76 actionable tasks: 2 executed, 74 up-to-date
Publishing build scan...
https://gradle.com/s/ma5bsi6zzdyii
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#2554
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/2554/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-6526] Add ReadFiles and ParseFiles transforms for AvroIO
------------------------------------------
[...truncated 886.85 KB...]
Apr 29, 2019 8:57:25 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:57:25 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:57:25 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:57:25 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:57:26.002Z no activity
2019-04-29T20:57:41.051Z RUNNING Query0
Apr 29, 2019 8:57:41 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:57:41 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:57:41 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:57:41 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:57:41.836Z no activity
2019-04-29T20:57:56.908Z RUNNING Query0
Apr 29, 2019 8:57:56 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:57:57 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:57:57 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:57:57 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:57:57.644Z no activity
2019-04-29T20:58:12.689Z RUNNING Query0
Apr 29, 2019 8:58:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:58:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:58:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:58:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:58:13.456Z no activity
2019-04-29T20:58:28.493Z RUNNING Query0
Apr 29, 2019 8:58:28 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:58:28 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:58:28 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:58:28 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:58:29.283Z no activity
2019-04-29T20:58:44.353Z RUNNING Query0
Apr 29, 2019 8:58:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:58:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:58:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:58:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:58:45.256Z no activity
2019-04-29T20:59:00.292Z RUNNING Query0
Apr 29, 2019 8:59:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:59:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:59:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:59:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:59:01.055Z no activity
2019-04-29T20:59:16.178Z RUNNING Query0
Apr 29, 2019 8:59:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:59:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:59:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:59:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:59:17.033Z no activity
2019-04-29T20:59:32.075Z RUNNING Query0
Apr 29, 2019 8:59:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:59:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:59:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:59:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:59:33.074Z no activity
2019-04-29T20:59:48.109Z RUNNING Query0
Apr 29, 2019 8:59:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 8:59:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 8:59:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 8:59:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T20:59:48.798Z no activity
2019-04-29T21:00:03.837Z RUNNING Query0
Apr 29, 2019 9:00:03 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 9:00:03 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 9:00:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 9:00:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T21:00:04.583Z no activity
2019-04-29T21:00:19.635Z RUNNING Query0
Apr 29, 2019 9:00:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 9:00:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 9:00:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 9:00:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
2019-04-29T21:00:20.584Z no activity
2019-04-29T21:00:35.637Z FAILED Query0
Apr 29, 2019 9:00:35 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query0.Events
Apr 29, 2019 9:00:35 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query0.Events
Apr 29, 2019 9:00:35 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query0.Results
Apr 29, 2019 9:00:35 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query0.Results
==========================================================================================
Run started 2019-04-29T20:02:53.752Z and ran for PT3462.167S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardSeconds":600,"standardDays":0,"standardHours":0,"standardMinutes":10,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 62.3 160459.6 9200000
0002 44.4 225357.2 83527
0003 62.3 160552.3 59507
0004 65.0 15378.0 140
0005 78.8 126850.4 4567
0006 75.3 13282.5 8902
0007 111.5 89714.3 100
0008 62.0 161163.0 92833
0009 68.1 14693.1 32548
0010 80.6 124067.9 -1
*** Job was unexpectedly updated ***
0011 84.1 118935.8 1839657
0012 64.1 155989.2 199929
0013 63.7 156882.4 9200000
0014 134.3 74459.1 9200000
==========================================================================================
==========================================================================================
Run started 2019-04-29T20:02:53.752Z and ran for PT3465.606S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardSeconds":600,"standardDays":0,"standardHours":0,"standardMinutes":10,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 62.3 160459.6 9200000
0002 44.4 225357.2 83527
0003 62.3 160552.3 59507
0004 65.0 15378.0 140
0005 78.8 126850.4 4567
0006 75.3 13282.5 8902
0007 111.5 89714.3 100
0008 62.0 161163.0 92833
0009 68.1 14693.1 32548
0010 80.6 124067.9 -1
*** Job was unexpectedly updated ***
0011 84.1 118935.8 1839657
0012 64.1 155989.2 199929
0013 63.7 156882.4 9200000
0014 134.3 74459.1 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 0m 53s
76 actionable tasks: 71 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/hpybl4ynpmylu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#2553
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/2553/display/redirect?page=changes>
Changes:
[ajamato] Update dataflow container version to beam-master-20190426
[daniel.o.programmer] [BEAM-7087] Updating Go SDK errors in base beam directory
[daniel.o.programmer] [BEAM-7087] Moving "errors" package to its own subdirectory.
------------------------------------------
[...truncated 733.10 KB...]
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 *** not run ***
0002 44.5 224482.0 83527
0003 92.4 108190.0 59507
0004 129.5 7719.3 140
0005 117.6 85049.2 4567
0006 81.8 12222.5 8902
0007 *** not run ***
0008 93.4 107113.4 92833
0009 65.4 15291.9 32548
0010 78.1 128001.6 -1
*** Job was unexpectedly updated ***
0011 *** not run ***
0012 87.6 114164.4 199929
0013 59.6 167698.0 9200000
0014 163.2 61268.9 9200000
==========================================================================================
2019-04-29T19:16:36.174Z DONE Query11
==========================================================================================
Run started 2019-04-29T19:09:20.856Z and ran for PT435.319S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 *** not run ***
0002 44.5 224482.0 83527
0003 92.4 108190.0 59507
0004 129.5 7719.3 140
0005 117.6 85049.2 4567
0006 81.8 12222.5 8902
0007 *** not run ***
0008 93.4 107113.4 92833
0009 65.4 15291.9 32548
0010 78.1 128001.6 -1
*** Job was unexpectedly updated ***
0011 122.1 81896.7 1839657
0012 87.6 114164.4 199929
0013 59.6 167698.0 9200000
0014 163.2 61268.9 9200000
==========================================================================================
2019-04-29T19:16:39.564Z RUNNING Query7
2019-04-29T19:16:41.204Z no activity
2019-04-29T19:16:43.404Z RUNNING Query1
2019-04-29T19:16:43.911Z no activity
2019-04-29T19:16:56.291Z RUNNING Query7
2019-04-29T19:16:57.789Z no activity
2019-04-29T19:16:58.912Z DONE Query1
==========================================================================================
Run started 2019-04-29T19:09:20.856Z and ran for PT458.056S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 127.8 78255.8 9200000
0002 44.5 224482.0 83527
0003 92.4 108190.0 59507
0004 129.5 7719.3 140
0005 117.6 85049.2 4567
0006 81.8 12222.5 8902
0007 *** not run ***
0008 93.4 107113.4 92833
0009 65.4 15291.9 32548
0010 78.1 128001.6 -1
*** Job was unexpectedly updated ***
0011 122.1 81896.7 1839657
0012 87.6 114164.4 199929
0013 59.6 167698.0 9200000
0014 163.2 61268.9 9200000
==========================================================================================
2019-04-29T19:17:12.915Z RUNNING Query7
2019-04-29T19:17:15.134Z no activity
2019-04-29T19:17:30.168Z RUNNING Query7
2019-04-29T19:17:31.743Z no activity
2019-04-29T19:17:46.812Z DONE Query7
==========================================================================================
Run started 2019-04-29T19:09:20.856Z and ran for PT506.050S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 127.8 78255.8 9200000
0002 44.5 224482.0 83527
0003 92.4 108190.0 59507
0004 129.5 7719.3 140
0005 117.6 85049.2 4567
0006 81.8 12222.5 8902
0007 184.4 54240.2 100
0008 93.4 107113.4 92833
0009 65.4 15291.9 32548
0010 78.1 128001.6 -1
*** Job was unexpectedly updated ***
0011 122.1 81896.7 1839657
0012 87.6 114164.4 199929
0013 59.6 167698.0 9200000
0014 163.2 61268.9 9200000
==========================================================================================
==========================================================================================
Run started 2019-04-29T19:09:20.856Z and ran for PT509.665S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 127.8 78255.8 9200000
0002 44.5 224482.0 83527
0003 92.4 108190.0 59507
0004 129.5 7719.3 140
0005 117.6 85049.2 4567
0006 81.8 12222.5 8902
0007 184.4 54240.2 100
0008 93.4 107113.4 92833
0009 65.4 15291.9 32548
0010 78.1 128001.6 -1
*** Job was unexpectedly updated ***
0011 122.1 81896.7 1839657
0012 87.6 114164.4 199929
0013 59.6 167698.0 9200000
0014 163.2 61268.9 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :beam-sdks-java-nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 58s
76 actionable tasks: 52 executed, 24 from cache
Publishing build scan...
https://gradle.com/s/tevkbkr57pce6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org