You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/08/25 12:14:19 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6220
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6220/display/redirect>
Changes:
------------------------------------------
[...truncated 997.86 KB...]
2020-08-25T12:12:55.587Z 4 samples not enough to calculate steady-state event rate
Aug 25, 2020 12:12:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
2020-08-25T12:12:55.657Z no activity
2020-08-25T12:13:10.315Z RUNNING Query11
2020-08-25T12:13:10.663Z DONE Query5 (waiting for shutdown)
2020-08-25T12:13:10.706Z DONE BoundedSideInputJoin
2020-08-25T12:13:10.712Z 3 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2020-08-25T12:07:05.254Z and ran for PT365.459S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.8 402803.5 10000000
0001 19.3 518537.7 9200000
0002 10.5 952018.3 83527
0003 49.8 200795.1 59227
0004 60.0 16656.4 140
0005 159.0 62877.7 4567
0006 44.0 22726.8 13998
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 48.5 206334.5 92833
0009 38.6 25937.0 32548
0010 96.6 103485.4 100
0011 *** not run ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 36.0 278001.7 9200000
0014 *** not run ***
==========================================================================================
2020-08-25T12:13:10.747Z 4 samples not enough to calculate steady-state event rate
Aug 25, 2020 12:13:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
2020-08-25T12:13:10.747Z streaming query appears to have finished waiting for completion.
==========================================================================================
Run started 2020-08-25T12:07:05.254Z and ran for PT365.493S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.8 402803.5 10000000
0001 19.3 518537.7 9200000
0002 10.5 952018.3 83527
0003 49.8 200795.1 59227
0004 60.0 16656.4 140
0005 159.0 62877.7 4567
0006 44.0 22726.8 13998
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 48.5 206334.5 92833
0009 38.6 25937.0 32548
0010 96.6 103485.4 100
0011 *** not run ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 36.0 278001.7 9200000
0014 165.8 60323.8 9200000
==========================================================================================
2020-08-25T12:13:11.046Z 8 samples not enough to calculate steady-state event rate
Aug 25, 2020 12:13:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-25T12:13:11.110Z new perf {"snapshots":null,"runtimeSec":216.939,"numEvents":10000000,"eventsPerSec":46095.90714440465,"eventBytesPerSec":5916708.830592932,"numResults":1839657,"resultsPerSec":8480.065824955402,"resultBytesPerSec":135681.05319928643,"startupDelaySec":-136.441,"processingDelaySec":51.595,"shutdownDelaySec":30.708,"timeDilation":4.609360234904743,"errors":null,"jobId":null}
2020-08-25T12:13:26.200Z RUNNING Query11
2020-08-25T12:13:26.937Z 8 samples not enough to calculate steady-state event rate
Aug 25, 2020 12:13:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T12:13:27.022Z no activity
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-25T12:13:42.072Z RUNNING Query11
2020-08-25T12:13:42.828Z 8 samples not enough to calculate steady-state event rate
Aug 25, 2020 12:13:42 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T12:13:42.892Z no activity
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-25T12:13:57.976Z RUNNING Query11
2020-08-25T12:13:58.838Z 8 samples not enough to calculate steady-state event rate
Aug 25, 2020 12:13:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T12:13:58.903Z no activity
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-25T12:14:13.989Z DONE Query11
2020-08-25T12:14:14.032Z 8 samples not enough to calculate steady-state event rate
2020-08-25T12:14:14.033Z streaming query appears to have finished waiting for completion.
Aug 25, 2020 12:14:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
==========================================================================================
Run started 2020-08-25T12:07:05.254Z and ran for PT428.779S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.8 402803.5 10000000
0001 19.3 518537.7 9200000
0002 10.5 952018.3 83527
0003 49.8 200795.1 59227
0004 60.0 16656.4 140
0005 159.0 62877.7 4567
0006 44.0 22726.8 13998
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 48.5 206334.5 92833
0009 38.6 25937.0 32548
0010 96.6 103485.4 100
0011 216.9 46095.9 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 36.0 278001.7 9200000
0014 165.8 60323.8 9200000
==========================================================================================
==========================================================================================
Run started 2020-08-25T12:07:05.254Z and ran for PT432.208S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.8 402803.5 10000000
0001 19.3 518537.7 9200000
0002 10.5 952018.3 83527
0003 49.8 200795.1 59227
0004 60.0 16656.4 140
0005 159.0 62877.7 4567
0006 44.0 22726.8 13998
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 48.5 206334.5 92833
0009 38.6 25937.0 32548
0010 96.6 103485.4 100
0011 216.9 46095.9 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 36.0 278001.7 9200000
0014 165.8 60323.8 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 18s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/tpioarpzeftgy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #6223
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6223/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6222
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6222/display/redirect?page=changes>
Changes:
[rehmanmuradali0] Adding key in Spark
[kmjung] Update BigQuery storage API source to v1
[kmjung] Make stream progress reporting work with v1 API
[kmjung] Clean up some leftovers
[kmjung] Address code review feedback
[noreply] Dataframe set_index is not index preserving (#12676)
------------------------------------------
[...truncated 963.56 KB...]
2020-08-26T00:13:15.455Z DONE Query5
2020-08-26T00:13:15.496Z 2 samples not enough to calculate steady-state event rate
Aug 26, 2020 12:13:15 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query5
==========================================================================================
Run started 2020-08-26T00:07:56.584Z and ran for PT318.913S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.5 408096.6 10000000
0001 18.2 550448.6 9200000
0002 11.7 853315.1 83527
0003 43.4 230377.6 59437
0004 59.0 16947.4 140
0005 138.6 72153.2 4567
0006 38.1 26243.3 14018
0007 108.8 91884.7 100
0008 48.1 207960.7 92833
0009 36.5 27360.5 32548
0010 98.6 101450.7 120
0011 *** not run ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 27.2 368310.6 9200000
0014 *** not run ***
==========================================================================================
2020-08-26T00:13:15.637Z 2 samples not enough to calculate steady-state event rate
2020-08-26T00:13:15.657Z 5 samples not enough to calculate steady-state event rate
Aug 26, 2020 12:13:15 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
2020-08-26T00:13:15.704Z no activity
Aug 26, 2020 12:13:15 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-26T00:13:15.721Z new perf {"snapshots":null,"runtimeSec":187.229,"numEvents":10000000,"eventsPerSec":53410.5293517564,"eventBytesPerSec":6855588.060610268,"numResults":1839657,"resultsPerSec":9825.705419566413,"resultBytesPerSec":157211.2867130626,"startupDelaySec":-154.743,"processingDelaySec":22.152,"shutdownDelaySec":30.858,"timeDilation":5.340785882528881,"errors":null,"jobId":null}
2020-08-26T00:13:30.789Z RUNNING Query11
2020-08-26T00:13:30.792Z RUNNING BoundedSideInputJoin
2020-08-26T00:13:31.568Z 2 samples not enough to calculate steady-state event rate
2020-08-26T00:13:31.578Z 5 samples not enough to calculate steady-state event rate
Aug 26, 2020 12:13:31 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-26T00:13:31.638Z streaming query appears to have finished waiting for completion.
2020-08-26T00:13:31.639Z no activity
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
Aug 26, 2020 12:13:31 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-26T00:13:31.651Z no activity
2020-08-26T00:13:46.707Z RUNNING Query11
2020-08-26T00:13:46.769Z DONE BoundedSideInputJoin (waiting for shutdown)
2020-08-26T00:13:46.813Z 2 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2020-08-26T00:07:56.584Z and ran for PT350.230S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.5 408096.6 10000000
0001 18.2 550448.6 9200000
0002 11.7 853315.1 83527
0003 43.4 230377.6 59437
0004 59.0 16947.4 140
0005 138.6 72153.2 4567
0006 38.1 26243.3 14018
0007 108.8 91884.7 100
0008 48.1 207960.7 92833
0009 36.5 27360.5 32548
0010 98.6 101450.7 120
0011 *** not run ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 27.2 368310.6 9200000
0014 149.7 66798.0 9200000
==========================================================================================
2020-08-26T00:13:47.475Z 5 samples not enough to calculate steady-state event rate
Aug 26, 2020 12:13:47 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-26T00:13:47.534Z no activity
2020-08-26T00:14:04.554Z RUNNING Query11
2020-08-26T00:14:04.648Z 5 samples not enough to calculate steady-state event rate
Aug 26, 2020 12:14:04 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-26T00:14:04.648Z no activity
2020-08-26T00:14:19.648Z DONE Query11
2020-08-26T00:14:19.649Z 5 samples not enough to calculate steady-state event rate
Aug 26, 2020 12:14:19 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-26T00:14:19.650Z streaming query appears to have finished waiting for completion.
==========================================================================================
Run started 2020-08-26T00:07:56.584Z and ran for PT383.066S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.5 408096.6 10000000
0001 18.2 550448.6 9200000
0002 11.7 853315.1 83527
0003 43.4 230377.6 59437
0004 59.0 16947.4 140
0005 138.6 72153.2 4567
0006 38.1 26243.3 14018
0007 108.8 91884.7 100
0008 48.1 207960.7 92833
0009 36.5 27360.5 32548
0010 98.6 101450.7 120
0011 187.2 53410.5 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 27.2 368310.6 9200000
0014 149.7 66798.0 9200000
==========================================================================================
==========================================================================================
Run started 2020-08-26T00:07:56.584Z and ran for PT386.510S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 24.5 408096.6 10000000
0001 18.2 550448.6 9200000
0002 11.7 853315.1 83527
0003 43.4 230377.6 59437
0004 59.0 16947.4 140
0005 138.6 72153.2 4567
0006 38.1 26243.3 14018
0007 108.8 91884.7 100
0008 48.1 207960.7 92833
0009 36.5 27360.5 32548
0010 98.6 101450.7 120
0011 187.2 53410.5 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 27.2 368310.6 9200000
0014 149.7 66798.0 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 33s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/7mp54oq3b5evi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6221
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6221/display/redirect>
Changes:
------------------------------------------
[...truncated 1.47 MB...]
2020-08-25T18:33:51.266Z no activity
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:34:06.326Z RUNNING SqlQuery7
2020-08-25T18:34:07.365Z revising events/sec from 12240.1 to 15551.6
Aug 25, 2020 6:34:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:34:07.508Z new perf {"snapshots":null,"runtimeSec":775.391,"numEvents":9490869,"eventsPerSec":15551.562264577587,"eventBytesPerSec":1571118.234542315,"numResults":57,"resultsPerSec":0.07351129946053024,"resultBytesPerSec":7.438827636637516,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":10.772,"timeDilation":0.7222162754017006,"errors":null,"jobId":null}
2020-08-25T18:34:22.606Z RUNNING SqlQuery7
2020-08-25T18:34:23.837Z revising events/sec from 12118.0 to 15506.8
Aug 25, 2020 6:34:23 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:34:23.922Z new perf {"snapshots":null,"runtimeSec":791.454,"numEvents":9590869,"eventsPerSec":15506.806103460602,"eventBytesPerSec":1555445.410598721,"numResults":59,"resultsPerSec":0.0745463412908394,"resultBytesPerSec":7.540551946164907,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":10.951,"timeDilation":0.7580983860085362,"errors":null,"jobId":null}
2020-08-25T18:34:38.990Z RUNNING SqlQuery7
2020-08-25T18:34:39.950Z revising events/sec from 11885.8 to 15495.8
Aug 25, 2020 6:34:40 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:34:40.059Z new perf {"snapshots":null,"runtimeSec":806.917,"numEvents":9590869,"eventsPerSec":15495.760874624035,"eventBytesPerSec":1525638.3147213405,"numResults":64,"resultsPerSec":0.07931422934452985,"resultBytesPerSec":7.9983443154624325,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":11.902,"timeDilation":0.7807494451102158,"errors":null,"jobId":null}
2020-08-25T18:34:55.125Z RUNNING SqlQuery7
2020-08-25T18:34:56.131Z revising events/sec from 11846.9 to 15462.3
Aug 25, 2020 6:34:56 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:34:56.211Z new perf {"snapshots":null,"runtimeSec":811.256,"numEvents":9610869,"eventsPerSec":15462.293588110495,"eventBytesPerSec":1520641.1071227826,"numResults":65,"resultsPerSec":0.08012267397714162,"resultBytesPerSec":8.09362272821403,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":23.701,"timeDilation":0.7889001745441636,"errors":null,"jobId":null}
2020-08-25T18:35:11.288Z RUNNING SqlQuery7
2020-08-25T18:35:12.447Z revising events/sec from 11846.9 to 15462.3
Aug 25, 2020 6:35:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:35:12.536Z no activity
2020-08-25T18:35:27.601Z RUNNING SqlQuery7
2020-08-25T18:35:28.613Z revising events/sec from 11846.9 to 15462.3
Aug 25, 2020 6:35:28 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T18:35:28.704Z no activity
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:35:43.808Z RUNNING SqlQuery7
2020-08-25T18:35:44.858Z revising events/sec from 11185.2 to 15321.0
Aug 25, 2020 6:35:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:35:44.947Z new perf {"snapshots":null,"runtimeSec":859.246,"numEvents":9610869,"eventsPerSec":15320.990248586864,"eventBytesPerSec":1435711.3352869842,"numResults":68,"resultsPerSec":0.07913915223346982,"resultBytesPerSec":7.977924831771111,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":24.356,"timeDilation":0.8379439648249745,"errors":null,"jobId":null}
2020-08-25T18:36:00.025Z RUNNING SqlQuery7
2020-08-25T18:36:00.970Z revising events/sec from 11120.4 to 15321.0
Aug 25, 2020 6:36:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:36:01.084Z new perf {"snapshots":null,"runtimeSec":885.836,"numEvents":9850869,"eventsPerSec":15320.990248586864,"eventBytesPerSec":1427393.7907242423,"numResults":74,"resultsPerSec":0.0835369075088391,"resultBytesPerSec":8.409005730180304,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":14.008,"timeDilation":0.8240803038034128,"errors":null,"jobId":null}
2020-08-25T18:36:16.150Z RUNNING SqlQuery7
2020-08-25T18:36:17.167Z revising events/sec from 10858.1 to 15275.3
Aug 25, 2020 6:36:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:36:17.261Z new perf {"snapshots":null,"runtimeSec":907.238,"numEvents":9850869,"eventsPerSec":15275.272507371463,"eventBytesPerSec":1393721.1690868328,"numResults":77,"resultsPerSec":0.08487298812439514,"resultBytesPerSec":8.551229115182565,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":8.743,"timeDilation":0.8377074152537702,"errors":null,"jobId":null}
2020-08-25T18:36:32.336Z RUNNING SqlQuery7
2020-08-25T18:36:33.387Z revising events/sec from 10893.0 to 15275.3
Aug 25, 2020 6:36:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:36:33.478Z new perf {"snapshots":null,"runtimeSec":917.8,"numEvents":9997567,"eventsPerSec":15275.272507371463,"eventBytesPerSec":1398186.4828938767,"numResults":78,"resultsPerSec":0.08498583569405099,"resultBytesPerSec":8.553061669208978,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":14.359,"timeDilation":0.8389627369797342,"errors":null,"jobId":null}
2020-08-25T18:36:48.543Z RUNNING SqlQuery7
2020-08-25T18:36:49.572Z revising events/sec from 10893.0 to 15275.3
Aug 25, 2020 6:36:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:36:49.665Z no activity
2020-08-25T18:37:04.734Z RUNNING SqlQuery7
2020-08-25T18:37:05.735Z revising events/sec from 10893.0 to 15275.3
Aug 25, 2020 6:37:05 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T18:37:05.834Z no activity
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:37:20.890Z RUNNING SqlQuery7
2020-08-25T18:37:21.895Z revising events/sec from 10402.0 to 15229.2
Aug 25, 2020 6:37:21 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:37:21.992Z new perf {"snapshots":null,"runtimeSec":961.121,"numEvents":9997567,"eventsPerSec":15229.172893883317,"eventBytesPerSec":1335165.4515924633,"numResults":80,"resultsPerSec":0.08323613780158794,"resultBytesPerSec":8.402688111070303,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":19.61,"timeDilation":0.8219568607906809,"errors":null,"jobId":null}
2020-08-25T18:37:37.055Z RUNNING SqlQuery7
2020-08-25T18:37:38.060Z revising events/sec from 10183.2 to 15229.2
Aug 25, 2020 6:37:38 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:37:38.151Z new perf {"snapshots":null,"runtimeSec":981.769,"numEvents":9997567,"eventsPerSec":15229.172893883317,"eventBytesPerSec":1307085.0210181824,"numResults":83,"resultsPerSec":0.08454127192852902,"resultBytesPerSec":8.537649895240122,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":15.12,"timeDilation":0.8352270238722144,"errors":null,"jobId":null}
2020-08-25T18:37:53.233Z RUNNING SqlQuery7
2020-08-25T18:37:54.594Z revising events/sec from 9995.2 to 15274.8
Aug 25, 2020 6:37:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:37:54.686Z new perf {"snapshots":null,"runtimeSec":1000.482,"numEvents":10000000,"eventsPerSec":15274.75933016892,"eventBytesPerSec":1282946.5167789126,"numResults":88,"resultsPerSec":0.0879576044346625,"resultBytesPerSec":8.919700704260547,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":12.566,"timeDilation":0.8695808620245042,"errors":null,"jobId":null}
2020-08-25T18:38:09.808Z RUNNING SqlQuery7
2020-08-25T18:38:10.891Z revising events/sec from 9945.9 to 15274.8
Aug 25, 2020 6:38:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:38:10.979Z new perf {"snapshots":null,"runtimeSec":1005.443,"numEvents":10000000,"eventsPerSec":15274.75933016892,"eventBytesPerSec":1276616.2746172582,"numResults":89,"resultsPerSec":0.0885181954620998,"resultBytesPerSec":8.974153681511533,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":24.14,"timeDilation":0.875236089962335,"errors":null,"jobId":null}
2020-08-25T18:38:26.071Z RUNNING SqlQuery7
2020-08-25T18:38:27.055Z revising events/sec from 9945.9 to 15274.8
Aug 25, 2020 6:38:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:38:27.136Z no activity
2020-08-25T18:38:42.217Z RUNNING SqlQuery7
2020-08-25T18:38:43.330Z revising events/sec from 9614.0 to 14932.4
Aug 25, 2020 6:38:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:38:43.419Z new perf {"snapshots":null,"runtimeSec":1040.15,"numEvents":10000000,"eventsPerSec":14932.389386669041,"eventBytesPerSec":1234019.032831803,"numResults":90,"resultsPerSec":0.08652598182954381,"resultBytesPerSec":8.77661875691006,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":21.883,"timeDilation":0.8556458203143776,"errors":null,"jobId":null}
2020-08-25T18:38:58.502Z RUNNING SqlQuery7
2020-08-25T18:38:59.516Z revising events/sec from 9402.2 to 14932.4
Aug 25, 2020 6:38:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:38:59.629Z new perf {"snapshots":null,"runtimeSec":1063.582,"numEvents":10000000,"eventsPerSec":14932.389386669041,"eventBytesPerSec":1206832.0985123853,"numResults":91,"resultsPerSec":0.08555992861857382,"resultBytesPerSec":8.672580017337637,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":14.735,"timeDilation":0.8461970962276533,"errors":null,"jobId":null}
2020-08-25T18:39:14.697Z RUNNING SqlQuery7
2020-08-25T18:39:15.843Z revising events/sec from 9196.3 to 14932.4
Aug 25, 2020 6:39:15 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:39:15.940Z new perf {"snapshots":null,"runtimeSec":1087.399,"numEvents":10000000,"eventsPerSec":14932.389386669041,"eventBytesPerSec":1180399.1883384113,"numResults":99,"resultsPerSec":0.09104293824070099,"resultBytesPerSec":9.18614050592285,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":7.128,"timeDilation":0.9012331260190602,"errors":null,"jobId":null}
2020-08-25T18:39:30.997Z RUNNING SqlQuery7
2020-08-25T18:39:32.018Z revising events/sec from 9106.6 to 14898.8
Aug 25, 2020 6:39:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:39:32.136Z new perf {"snapshots":null,"runtimeSec":1098.108,"numEvents":10000000,"eventsPerSec":14898.833783657168,"eventBytesPerSec":1168887.6658762163,"numResults":100,"resultsPerSec":0.0910657239542923,"resultBytesPerSec":9.200370091102151,"startupDelaySec":-151.912,"processingDelaySec":107.999,"shutdownDelaySec":12.73,"timeDilation":0.9015506671474938,"errors":null,"jobId":null}
2020-08-25T18:39:47.203Z RUNNING SqlQuery7
2020-08-25T18:39:48.317Z revising events/sec from 9106.6 to 14898.8
Aug 25, 2020 6:39:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:39:48.417Z no activity
2020-08-25T18:40:03.615Z RUNNING SqlQuery7
2020-08-25T18:40:04.892Z revising events/sec from 9106.6 to 14898.8
Aug 25, 2020 6:40:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:40:04.999Z no activity
2020-08-25T18:40:20.075Z RUNNING SqlQuery7
2020-08-25T18:40:21.157Z revising events/sec from 9106.6 to 14898.8
Aug 25, 2020 6:40:21 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T18:40:21.259Z no activity
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:40:36.366Z RUNNING SqlQuery7
2020-08-25T18:40:37.574Z revising events/sec from 9106.6 to 14898.8
Aug 25, 2020 6:40:37 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-25T18:40:37.681Z streaming query appears to have finished waiting for completion.
SEVERE: Failed to get metric fatal, from namespace SqlQuery7
2020-08-25T18:40:37.682Z no activity
2020-08-25T18:40:52.753Z DONE SqlQuery7 (waiting for shutdown)
2020-08-25T18:40:52.827Z revising events/sec from 9106.6 to 14898.8
==========================================================================================
Run started 2020-08-25T18:19:19.128Z and ran for PT1293.700S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.2 449862.8 9200000
0001 21.1 474924.0 9200000
0002 13.1 763883.6 83527
0003 30.3 329858.8 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 1098.1 14898.8 100
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
==========================================================================================
Run started 2020-08-25T18:19:19.128Z and ran for PT1295.487S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.2 449862.8 9200000
0001 21.1 474924.0 9200000
0002 13.1 763883.6 83527
0003 30.3 329858.8 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 1098.1 14898.8 100
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 21m 41s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/hgl6bffkek6oe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org