You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/12/10 02:33:16 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4487
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4487/display/redirect?page=changes>
Changes:
[kcweaver] Version Flink job server container images
[kcweaver] [BEAM-8337] publish Flink job server container images
[kcweaver] [BEAM-8870] Skip test_sdf_with_watermark_tracking for Spark
[kcweaver] [BEAM-8870] Cache environment in spark_runner_test.
[ningk] [BEAM-7926] Data-centric Interactive Part1
[kcweaver] Don't override default for environment_cache_millis
[ehudm] [BEAM-3713] pytest migration: py27-gcp-pytest
[kcweaver] Get Flink version numbers from subdirectories
[kcweaver] Warn if Flink versions can't be listed.
------------------------------------------
[...truncated 250.87 KB...]
2019-12-10T02:32:39.729Z 0 samples not enough to calculate steady-state event rate
2019-12-10T02:32:39.787Z no activity
2019-12-10T02:32:40.051Z 0 samples not enough to calculate steady-state event rate
2019-12-10T02:32:40.098Z no activity
2019-12-10T02:32:40.203Z 0 samples not enough to calculate steady-state event rate
2019-12-10T02:32:40.249Z no activity
2019-12-10T02:32:54.834Z RUNNING BoundedSideInputJoin
2019-12-10T02:32:55.132Z FAILED Query2
2019-12-10T02:32:55.155Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-10T02:20:54.740Z and ran for PT720.415S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.5 444780.5 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 34.2 29221.8 14530
0007 110.3 90692.3 100
0008 49.6 201645.4 92833
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 99.3 100707.0 130
0011 194.1 51532.8 1839657
0012 82.4 121341.6 585166
0013 *** not run ***
0014 *** not run ***
==========================================================================================
2019-12-10T02:32:55.282Z FAILED BoundedSideInputJoin
2019-12-10T02:32:55.305Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-10T02:20:54.740Z and ran for PT720.565S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.5 444780.5 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 34.2 29221.8 14530
0007 110.3 90692.3 100
0008 49.6 201645.4 92833
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 99.3 100707.0 130
0011 194.1 51532.8 1839657
0012 82.4 121341.6 585166
0013 *** not run ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
2019-12-10T02:32:55.393Z 0 samples not enough to calculate steady-state event rate
2019-12-10T02:32:55.446Z no activity
2019-12-10T02:33:10.508Z FAILED BoundedSideInputJoin
2019-12-10T02:33:10.532Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-10T02:20:54.740Z and ran for PT735.793S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.5 444780.5 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 34.2 29221.8 14530
0007 110.3 90692.3 100
0008 49.6 201645.4 92833
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 99.3 100707.0 130
0011 194.1 51532.8 1839657
0012 82.4 121341.6 585166
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2019-12-10T02:20:54.740Z and ran for PT739.296S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.5 444780.5 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 34.2 29221.8 14530
0007 110.3 90692.3 100
0008 49.6 201645.4 92833
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 99.3 100707.0 130
0011 194.1 51532.8 1839657
0012 82.4 121341.6 585166
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 24s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/tpzokgkx6rmpm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #4490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4490/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4489/display/redirect?page=changes>
Changes:
[github] Changing _BatchSizeEstimator defaults to match BatchElements defaults
------------------------------------------
[...truncated 306.02 KB...]
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 21.6 462278.1 9200000
0002 14.0 715307.6 83527
0003 44.2 226249.5 59435
0004 *** not run ***
0005 130.8 76456.7 4567
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 111.9 89367.1 100
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 98.7 101293.5 130
0011 248.6 40223.5 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 38.4 260287.9 9200000
0014 *** not run ***
==========================================================================================
2019-12-10T07:19:31.211Z RUNNING BoundedSideInputJoin
2019-12-10T07:19:31.738Z 0 samples not enough to calculate steady-state event rate
2019-12-10T07:19:31.782Z WARNING: streaming query appears to have been stuck for 12 min.
2019-12-10T07:19:31.782Z no activity
2019-12-10T07:19:32.077Z RUNNING Query4
2019-12-10T07:19:32.844Z 2 samples not enough to calculate steady-state event rate
2019-12-10T07:19:32.916Z no activity
2019-12-10T07:19:46.810Z RUNNING BoundedSideInputJoin
2019-12-10T07:19:47.347Z 0 samples not enough to calculate steady-state event rate
2019-12-10T07:19:47.392Z WARNING: streaming query appears to have been stuck for 12 min.
2019-12-10T07:19:47.392Z no activity
2019-12-10T07:19:47.945Z RUNNING Query4
2019-12-10T07:19:48.656Z 2 samples not enough to calculate steady-state event rate
2019-12-10T07:19:48.728Z streaming query appears to have finished waiting for completion.
2019-12-10T07:19:48.728Z no activity
2019-12-10T07:20:02.422Z RUNNING BoundedSideInputJoin
2019-12-10T07:20:03.020Z 0 samples not enough to calculate steady-state event rate
2019-12-10T07:20:03.084Z WARNING: streaming query appears to have been stuck for 13 min.
2019-12-10T07:20:03.084Z no activity
2019-12-10T07:20:03.762Z RUNNING Query4 (waiting for shutdown)
2019-12-10T07:20:04.594Z 2 samples not enough to calculate steady-state event rate
2019-12-10T07:20:04.594Z no activity
2019-12-10T07:20:18.121Z FAILED BoundedSideInputJoin
2019-12-10T07:20:18.150Z 0 samples not enough to calculate steady-state event rate
2019-12-10T07:20:18.150Z WARNING: streaming query appears to have been stuck for 13 min.
==========================================================================================
Run started 2019-12-10T07:02:47.805Z and ran for PT1050.345S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 21.6 462278.1 9200000
0002 14.0 715307.6 83527
0003 44.2 226249.5 59435
0004 *** not run ***
0005 130.8 76456.7 4567
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 111.9 89367.1 100
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 98.7 101293.5 130
0011 248.6 40223.5 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 38.4 260287.9 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
2019-12-10T07:20:19.628Z RUNNING Query4 (waiting for shutdown)
2019-12-10T07:20:20.393Z 2 samples not enough to calculate steady-state event rate
2019-12-10T07:20:20.393Z no activity
2019-12-10T07:20:35.431Z RUNNING Query4 (waiting for shutdown)
2019-12-10T07:20:36.263Z 2 samples not enough to calculate steady-state event rate
2019-12-10T07:20:36.263Z no activity
2019-12-10T07:20:51.296Z RUNNING Query4 (waiting for shutdown)
2019-12-10T07:20:52.100Z 2 samples not enough to calculate steady-state event rate
2019-12-10T07:20:52.100Z no activity
2019-12-10T07:21:07.148Z DONE Query4 (waiting for shutdown)
2019-12-10T07:21:07.207Z 2 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-10T07:02:47.805Z and ran for PT1099.402S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 21.6 462278.1 9200000
0002 14.0 715307.6 83527
0003 44.2 226249.5 59435
0004 54.0 18534.3 140
0005 130.8 76456.7 4567
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 111.9 89367.1 100
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 98.7 101293.5 130
0011 248.6 40223.5 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 38.4 260287.9 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2019-12-10T07:02:47.805Z and ran for PT1102.732S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 21.6 462278.1 9200000
0002 14.0 715307.6 83527
0003 44.2 226249.5 59435
0004 54.0 18534.3 140
0005 130.8 76456.7 4567
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 111.9 89367.1 100
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 98.7 101293.5 130
0011 248.6 40223.5 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 38.4 260287.9 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 18m 28s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/jcoqn3ui6alhc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4488/display/redirect>
Changes:
------------------------------------------
[...truncated 125.65 KB...]
> Task :model:pipeline:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE
> Task :model:pipeline:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE
> Task :model:pipeline:shadowJar UP-TO-DATE
> Task :model:fn-execution:extractIncludeProto UP-TO-DATE
> Task :model:job-management:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:generateProto UP-TO-DATE
> Task :model:job-management:generateProto UP-TO-DATE
> Task :model:fn-execution:compileJava UP-TO-DATE
> Task :model:job-management:compileJava UP-TO-DATE
> Task :model:fn-execution:classes UP-TO-DATE
> Task :model:job-management:classes UP-TO-DATE
> Task :model:job-management:shadowJar UP-TO-DATE
> Task :model:fn-execution:shadowJar UP-TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :sdks:java:core:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava UP-TO-DATE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :sdks:java:io:kafka:jar UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:jar UP-TO-DATE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava UP-TO-DATE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE
> Task :sdks:java:extensions:sql:compileJava UP-TO-DATE
> Task :sdks:java:extensions:sql:processResources UP-TO-DATE
> Task :sdks:java:extensions:sql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE
> Task :sdks:java:testing:nexmark:classes UP-TO-DATE
> Task :sdks:java:testing:nexmark:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-10T06:07:42.816Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.817Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.817Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.817Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-10T06:07:42.817Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.817Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-10T06:07:42.816Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-10T06:07:42.816Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:42.816Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-10T06:07:43.857Z Generating 1000000 events in streaming mode
2019-12-10T06:07:43.858Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.858Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.858Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 1000000 events in streaming mode
2019-12-10T06:07:43.858Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.857Z Generating 10000000 events in streaming mode
2019-12-10T06:07:43.905Z Generating 1000000 events in streaming mode
2019-12-10T06:07:44.062Z Generating 10000000 events in streaming mode
2019-12-10T06:07:44.140Z Expected auction duration is 16667 ms
2019-12-10T06:07:44.140Z Expected auction duration is 16667 ms
2019-12-10T06:07:44.140Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-10T06:07:42.596Z and ran for PT9.929S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (ef6b1ad5847e4567): The workflow could not be created. Causes: (c6dbffb551f96944): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (ef6b1ad5847e4567): The workflow could not be created. Causes: (c6dbffb551f96944): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(ef6b1ad5847e4567): The workflow could not be created. Causes: (c6dbffb551f96944): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(ef6b1ad5847e4567): The workflow could not be created. Causes: (c6dbffb551f96944): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
2019-12-10T06:08:09.379Z Waiting for main pipeline to 'finish'
2019-12-10T06:08:09.379Z FAILED Query5
2019-12-10T06:08:09.433Z 0 samples not enough to calculate steady-state event rate
2019-12-10T06:08:10.473Z Waiting for main pipeline to 'finish'
2019-12-10T06:08:10.473Z FAILED Query2
2019-12-10T06:08:10.513Z 0 samples not enough to calculate steady-state event rate
2019-12-10T06:11:42.953Z Waiting for main pipeline to 'finish'
2019-12-10T06:11:42.954Z FAILED Query12
2019-12-10T06:11:42.979Z 0 samples not enough to calculate steady-state event rate
2019-12-10T06:12:27.912Z Waiting for main pipeline to 'finish'
2019-12-10T06:12:27.943Z RUNNING Query1
2019-12-10T06:12:28.759Z 1 samples not enough to calculate steady-state event rate
2019-12-10T06:12:28.826Z new perf {"snapshots":null,"runtimeSec":21.657,"numEvents":10000000,"eventsPerSec":461744.47060996445,"eventBytesPerSec":5.926789938587985E7,"numResults":9200000,"resultsPerSec":424804.9129611673,"resultBytesPerSec":4.2692641917163044E7,"startupDelaySec":-147.228,"processingDelaySec":0.421,"shutdownDelaySec":125.571,"timeDilation":46.1721383386434,"errors":null,"jobId":null}
2019-12-10T06:12:43.870Z DONE Query1
2019-12-10T06:12:43.936Z 1 samples not enough to calculate steady-state event rate
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 6s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/ep2b2czr64vzm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org