You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/12/07 12:25:52 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4472
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4472/display/redirect>
Changes:
------------------------------------------
[...truncated 277.87 KB...]
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 *** not run ***
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-07T12:23:11.048Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:23:11.048Z no activity
2019-12-07T12:23:24.487Z RUNNING Query6
2019-12-07T12:23:25.241Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:23:25.310Z streaming query appears to have finished waiting for completion.
2019-12-07T12:23:25.311Z no activity
2019-12-07T12:23:26.226Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:23:26.955Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:23:26.955Z no activity
2019-12-07T12:23:40.354Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:23:41.038Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:23:41.038Z no activity
2019-12-07T12:23:41.989Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:23:42.667Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:23:42.667Z no activity
2019-12-07T12:23:56.076Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:23:56.840Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:23:56.841Z no activity
2019-12-07T12:23:57.758Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:23:58.833Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:23:58.834Z no activity
2019-12-07T12:24:11.874Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:12.644Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:24:12.644Z no activity
2019-12-07T12:24:13.867Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:24:14.620Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:24:14.621Z no activity
2019-12-07T12:24:27.682Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:28.401Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:24:28.401Z no activity
2019-12-07T12:24:29.693Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:24:30.413Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:24:30.413Z no activity
2019-12-07T12:24:43.435Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:44.163Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:24:44.163Z no activity
2019-12-07T12:24:45.445Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:24:46.267Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:24:46.267Z no activity
2019-12-07T12:24:59.200Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:24:59.945Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:24:59.945Z no activity
2019-12-07T12:25:01.302Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:25:02.020Z 4 samples not enough to calculate steady-state event rate
2019-12-07T12:25:02.020Z no activity
2019-12-07T12:25:14.973Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:25:15.705Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:25:15.705Z no activity
2019-12-07T12:25:17.061Z DONE BoundedSideInputJoin (waiting for shutdown)
2019-12-07T12:25:17.108Z 4 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-07T12:08:46.156Z and ran for PT990.952S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 *** not run ***
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 159.6 62649.6 9200000
==========================================================================================
2019-12-07T12:25:30.750Z RUNNING Query6 (waiting for shutdown)
2019-12-07T12:25:31.509Z 3 samples not enough to calculate steady-state event rate
2019-12-07T12:25:31.509Z no activity
2019-12-07T12:25:46.550Z DONE Query6 (waiting for shutdown)
2019-12-07T12:25:46.590Z 3 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-07T12:08:46.156Z and ran for PT1020.435S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 53.9 18556.7 15844
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 159.6 62649.6 9200000
==========================================================================================
==========================================================================================
Run started 2019-12-07T12:08:46.156Z and ran for PT1023.556S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 22.3 448209.4 10000000
0001 23.3 429442.6 9200000
0002 12.5 797130.3 83527
0003 50.3 198767.6 59434
0004 51.5 19409.6 140
0005 148.9 67154.2 4567
0006 53.9 18556.7 15844
0007 111.8 89483.1 100
0008 53.3 187557.4 92833
0009 35.5 28182.5 32548
0010 99.0 101029.5 150
0011 198.4 50415.2 1839657
0012 90.0 111142.0 509556
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 159.6 62649.6 9200000
==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 9s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/uhwnqnkbg5p7o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #4486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4486/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4485/display/redirect?page=changes>
Changes:
[pabloem] [BEAM-8335] Adds support for multi-output TestStream (#9953)
------------------------------------------
[...truncated 16.38 KB...]
> Task :runners:google-cloud-dataflow-java:worker:windmill:processResources
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore
> Task :model:pipeline:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:job-management:generateProto
> Task :model:fn-execution:generateProto
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar
> Task :model:pipeline:shadowJar
> Task :model:job-management:shadowJar
> Task :sdks:java:extensions:sql:compileJavacc
Java Compiler Compiler Version 4.0 (Parser Generator)
(type "javacc" with no arguments for help)
Reading from file <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/ws/src/sdks/java/extensions/sql/build/generated/fmpp/javacc/Parser.jj> . . .
Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
File "TokenMgrError.java" does not exist. Will create one.
File "ParseException.java" does not exist. Will create one.
File "Token.java" does not exist. Will create one.
File "SimpleCharStream.java" does not exist. Will create one.
Parser generated with 0 errors and 1 warnings.
> Task :sdks:java:extensions:sql:processResources
> Task :model:fn-execution:shadowJar
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :vendor:sdks-java-extensions-protobuf:compileJava FROM-CACHE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava FROM-CACHE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava FROM-CACHE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:jar
> Task :sdks:java:extensions:join-library:jar
> Task :vendor:sdks-java-extensions-protobuf:shadowJar
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:core:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:testing:test-utils:compileJava FROM-CACHE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar
> Task :runners:core-java:jar
> Task :sdks:java:extensions:protobuf:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :sdks:java:io:parquet:compileJava FROM-CACHE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar
> Task :sdks:java:harness:shadowJar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar
> Task :sdks:java:extensions:sql:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:classes
> Task :sdks:java:extensions:sql:jar
> Task :sdks:java:testing:nexmark:compileJava FROM-CACHE
> Task :sdks:java:testing:nexmark:classes
> Task :sdks:java:testing:nexmark:jar
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-09T22:13:17.215Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.216Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T22:13:17.216Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.216Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.216Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T22:13:17.216Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.216Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.215Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.216Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.215Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.215Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T22:13:17.215Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.215Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.215Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:17.215Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 1000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 1000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.385Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.389Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.389Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.472Z Generating 1000000 events in batch mode
2019-12-09T22:13:18.481Z Generating 10000000 events in batch mode
2019-12-09T22:13:18.699Z Expected auction duration is 16667 ms
2019-12-09T22:13:18.702Z Expected auction duration is 16667 ms
2019-12-09T22:13:18.702Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-09T22:13:16.963Z and ran for PT13.964S
Default configuration:
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (854887132b43cfef): The workflow could not be created. Causes: (57b80f6eb74e3cdb): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (854887132b43cfef): The workflow could not be created. Causes: (57b80f6eb74e3cdb): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
at java.lang.Thread.run(Thread.java:748)
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
Performance:
"code" : 400,
"errors" : [ {
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
"domain" : "global",
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
"message" : "(854887132b43cfef): The workflow could not be created. Causes: (57b80f6eb74e3cdb): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
0003 *** not run ***
"reason" : "failedPrecondition"
0004 *** not run ***
} ],
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
"message" : "(854887132b43cfef): The workflow could not be created. Causes: (57b80f6eb74e3cdb): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
0008 *** not run ***
"status" : "FAILED_PRECONDITION"
0009 *** not run ***
}
0010 *** not run ***
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
0011 *** not run ***
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
0012 *** not run ***
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
0013 *** not run ***
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
0014 *** not run ***
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
==========================================================================================
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 4s
81 actionable tasks: 55 executed, 26 from cache
Publishing build scan...
https://scans.gradle.com/s/divtpmmnley5s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4484/display/redirect>
Changes:
------------------------------------------
[...truncated 90.25 KB...]
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 *** not run ***
0003 *** not run ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
2019-12-09T18:09:24.185Z Waiting for main pipeline to 'finish'
2019-12-09T18:09:24.185Z FAILED Query2
==========================================================================================
Run started 2019-12-09T18:08:38.440Z and ran for PT45.776S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 *** not run ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
2019-12-09T18:09:27.298Z Waiting for main pipeline to 'finish'
2019-12-09T18:09:27.299Z FAILED Query3
==========================================================================================
Run started 2019-12-09T18:08:38.440Z and ran for PT48.888S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2019-12-09T18:08:38.440Z and ran for PT52.766S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
Exception in thread "main" ==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 56s
81 actionable tasks: 58 executed, 23 from cache
Publishing build scan...
https://scans.gradle.com/s/tgqou45c6abes
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4483
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4483/display/redirect?page=changes>
Changes:
[dcavazos] [BEAM-7390] Add code snippet for Mean
[nielm] Add limit on number of mutated rows to batching/sorting stages.
[heejong] [BEAM-8903] handling --jar_packages experimental flag in PortableRunner
------------------------------------------
[...truncated 198.91 KB...]
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-09T17:57:02.662Z Waiting for main pipeline to 'finish'
2019-12-09T17:57:02.662Z FAILED BoundedSideInputJoin
2019-12-09T17:57:02.692Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-09T17:56:35.823Z and ran for PT26.869S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
2019-12-09T17:57:04.836Z Waiting for main pipeline to 'finish'
2019-12-09T17:57:04.836Z FAILED Query8
2019-12-09T17:57:04.866Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2019-12-09T17:56:35.823Z and ran for PT29.043S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2019-12-09T17:56:35.823Z and ran for PT32.672S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
Exception in thread "main" *** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/qd5tv6jes7nvc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4482/display/redirect?page=changes>
Changes:
[github] Changing RowAsDictJsonCoder implementation for efficiency (#10300)
[github] Merge pull request #10151: [BEAM-7116] Remove use of KV in Schema
------------------------------------------
[...truncated 317.38 KB...]
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 37.6 26576.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-09T17:23:31.177Z FAILED BoundedSideInputJoin
2019-12-09T17:23:31.209Z 0 samples not enough to calculate steady-state event rate
2019-12-09T17:23:31.209Z WARNING: streaming query appears to have been stuck for 12 min.
==========================================================================================
Run started 2019-12-09T17:06:34.993Z and ran for PT1016.216S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 37.6 26576.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
2019-12-09T17:23:31.445Z RUNNING Query12
2019-12-09T17:23:31.963Z 0 samples not enough to calculate steady-state event rate
2019-12-09T17:23:32.022Z WARNING: streaming query appears to have been stuck for 12 min.
2019-12-09T17:23:32.023Z no activity
2019-12-09T17:23:47.067Z RUNNING Query12
2019-12-09T17:23:47.690Z 0 samples not enough to calculate steady-state event rate
2019-12-09T17:23:47.743Z WARNING: streaming query appears to have been stuck for 13 min.
2019-12-09T17:23:47.743Z no activity
2019-12-09T17:24:02.776Z RUNNING Query12
2019-12-09T17:24:03.416Z 0 samples not enough to calculate steady-state event rate
2019-12-09T17:24:03.416Z WARNING: streaming query appears to have been stuck for 13 min.
2019-12-09T17:24:03.416Z no activity
2019-12-09T17:24:18.416Z FAILED Query12
2019-12-09T17:24:18.417Z 0 samples not enough to calculate steady-state event rate
2019-12-09T17:24:18.417Z WARNING: streaming query appears to have been stuck for 13 min.
==========================================================================================
Run started 2019-12-09T17:06:34.993Z and ran for PT1063.424S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 37.6 26576.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2019-12-09T17:06:34.993Z and ran for PT1066.576S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
Exception in thread "main" *** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 37.6 26576.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 55s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/2f2s5ynviduo4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4481
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4481/display/redirect?page=changes>
Changes:
[michal.walenia] [BEAM-8895] Add BigQuery table name sanitization to BigQueryIOIT
[michal.walenia] [BEAM-8918] Split batch BQIOIT into avro and json using tests
------------------------------------------
[...truncated 314.83 KB...]
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-09T13:04:57.605Z Waiting for main pipeline to 'finish'
2019-12-09T13:04:57.605Z FAILED SqlQuery1
==========================================================================================
Run started 2019-12-09T13:04:25.553Z and ran for PT32.076S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-09T13:04:57.634Z Waiting for main pipeline to 'finish'
2019-12-09T13:04:57.634Z FAILED SqlQuery3
==========================================================================================
Run started 2019-12-09T13:04:25.553Z and ran for PT32.118S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 *** not run ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2019-12-09T13:04:58.484Z Waiting for main pipeline to 'finish'
2019-12-09T13:04:58.484Z FAILED SqlQuery2
==========================================================================================
Run started 2019-12-09T13:04:25.553Z and ran for PT32.955S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
==========================================================================================
Run started 2019-12-09T13:04:25.553Z and ran for PT34.275S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
Exception in thread "main" ==========================================================================================
java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/pg7nv4l6cpo3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4480
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4480/display/redirect>
Changes:
------------------------------------------
[...truncated 149.81 KB...]
2019-12-09T12:07:42.971Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T12:07:42.971Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 1000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 1000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 1000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.019Z Generating 10000000 events in streaming mode
2019-12-09T12:07:44.258Z Expected auction duration is 16667 ms
2019-12-09T12:07:44.261Z Expected auction duration is 16667 ms
2019-12-09T12:07:44.261Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-09T12:07:42.750Z and ran for PT9.372S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (d8390577cb3690b5): The workflow could not be created. Causes: (9fbe2312150d06a8): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
==========================================================================================
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (d8390577cb3690b5): The workflow could not be created. Causes: (9fbe2312150d06a8): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(d8390577cb3690b5): The workflow could not be created. Causes: (9fbe2312150d06a8): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(d8390577cb3690b5): The workflow could not be created. Causes: (9fbe2312150d06a8): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
2019-12-09T12:13:08.216Z Waiting for main pipeline to 'finish'
2019-12-09T12:13:08.247Z RUNNING Query12
2019-12-09T12:13:09.040Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:13:09.117Z new perf {"snapshots":null,"runtimeSec":81.177,"numEvents":10000000,"eventsPerSec":123187.60239969449,"eventBytesPerSec":1.5811928218584081E7,"numResults":594481,"resultsPerSec":7323.268906217278,"resultBytesPerSec":117172.30249947644,"startupDelaySec":-125.294,"processingDelaySec":15.276,"shutdownDelaySec":44.117,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-09T12:13:24.154Z RUNNING Query12
2019-12-09T12:13:24.882Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:13:25.032Z no activity
2019-12-09T12:13:40.075Z RUNNING Query12
2019-12-09T12:13:40.918Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:13:40.982Z no activity
2019-12-09T12:13:46.795Z Waiting for main pipeline to 'finish'
2019-12-09T12:13:46.830Z RUNNING Query11
2019-12-09T12:13:47.573Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:13:47.647Z new perf {"snapshots":null,"runtimeSec":134.045,"numEvents":8485337,"eventsPerSec":63302.15226229998,"eventBytesPerSec":8125327.039427059,"numResults":1089696,"resultsPerSec":8129.329702711777,"resultBytesPerSec":130069.27524338843,"startupDelaySec":-141.801,"processingDelaySec":20.36,"shutdownDelaySec":7.756,"timeDilation":5.139244283636093,"errors":null,"jobId":null}
2019-12-09T12:13:56.011Z RUNNING Query12
2019-12-09T12:13:56.800Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:13:56.869Z no activity
2019-12-09T12:14:02.677Z RUNNING Query11
2019-12-09T12:14:03.419Z 2 samples not enough to calculate steady-state event rate
2019-12-09T12:14:03.496Z new perf {"snapshots":null,"runtimeSec":152.126,"numEvents":9231022,"eventsPerSec":60680.107279492,"eventBytesPerSec":7788757.8520437,"numResults":1265091,"resultsPerSec":8316.073518004812,"resultBytesPerSec":133057.176288077,"startupDelaySec":-141.801,"processingDelaySec":20.36,"shutdownDelaySec":5.528,"timeDilation":4.881742765865138,"errors":null,"jobId":null}
2019-12-09T12:14:11.905Z RUNNING Query12
2019-12-09T12:14:12.686Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:14:12.761Z streaming query appears to have finished waiting for completion.
2019-12-09T12:14:12.762Z no activity
2019-12-09T12:14:18.561Z RUNNING Query11
2019-12-09T12:14:19.246Z 3 samples not enough to calculate steady-state event rate
2019-12-09T12:14:19.306Z new perf {"snapshots":null,"runtimeSec":162.411,"numEvents":9760000,"eventsPerSec":60094.45173048624,"eventBytesPerSec":7713566.365578686,"numResults":1432939,"resultsPerSec":8822.918398384345,"resultBytesPerSec":141164.33000227818,"startupDelaySec":-141.801,"processingDelaySec":20.36,"shutdownDelaySec":11.091,"timeDilation":4.857737468521221,"errors":null,"jobId":null}
2019-12-09T12:14:27.799Z RUNNING Query12 (waiting for shutdown)
2019-12-09T12:14:28.519Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:14:28.519Z no activity
2019-12-09T12:14:34.337Z RUNNING Query11
2019-12-09T12:14:35.068Z 4 samples not enough to calculate steady-state event rate
2019-12-09T12:14:35.135Z new perf {"snapshots":null,"runtimeSec":176.667,"numEvents":10000000,"eventsPerSec":56603.66678553437,"eventBytesPerSec":7265447.972739674,"numResults":1579952,"resultsPerSec":8943.107654513859,"resultBytesPerSec":143089.72247222174,"startupDelaySec":-141.801,"processingDelaySec":20.36,"shutdownDelaySec":12.646,"timeDilation":5.031782958900077,"errors":null,"jobId":null}
2019-12-09T12:14:43.555Z RUNNING Query12 (waiting for shutdown)
2019-12-09T12:14:44.474Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:14:44.475Z no activity
2019-12-09T12:14:50.170Z RUNNING Query11
2019-12-09T12:14:50.875Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:14:50.950Z new perf {"snapshots":null,"runtimeSec":195.083,"numEvents":10000000,"eventsPerSec":51260.23282397749,"eventBytesPerSec":6579583.546490468,"numResults":1779632,"resultsPerSec":9122.43506610007,"resultBytesPerSec":145958.96105760112,"startupDelaySec":-141.801,"processingDelaySec":20.36,"shutdownDelaySec":10.058,"timeDilation":5.125766981233629,"errors":null,"jobId":null}
2019-12-09T12:14:51.701Z Waiting for main pipeline to 'finish'
2019-12-09T12:14:51.736Z RUNNING BoundedSideInputJoin
2019-12-09T12:14:52.427Z 0 samples not enough to calculate steady-state event rate
2019-12-09T12:14:52.511Z new perf {"snapshots":null,"runtimeSec":95.48,"numEvents":9523790,"eventsPerSec":99746.43904482614,"eventBytesPerSec":1.2803009331797235E7,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-110.531,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-09T12:14:59.509Z RUNNING Query12 (waiting for shutdown)
2019-12-09T12:15:00.303Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:15:00.303Z no activity
2019-12-09T12:15:05.986Z RUNNING Query11
2019-12-09T12:15:06.750Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:15:06.811Z new perf {"snapshots":null,"runtimeSec":199.926,"numEvents":10000000,"eventsPerSec":50018.506847533594,"eventBytesPerSec":6420199.958984825,"numResults":1839657,"resultsPerSec":9201.68962516131,"resultBytesPerSec":147227.03400258097,"startupDelaySec":-141.801,"processingDelaySec":20.36,"shutdownDelaySec":21.031,"timeDilation":5.001600592219122,"errors":null,"jobId":null}
2019-12-09T12:15:07.542Z RUNNING BoundedSideInputJoin
2019-12-09T12:15:08.332Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:15:08.402Z new perf {"snapshots":null,"runtimeSec":112.408,"numEvents":9750000,"eventsPerSec":86737.59874742011,"eventBytesPerSec":1.113321192441819E7,"numResults":10149,"resultsPerSec":90.28716817308377,"resultBytesPerSec":7755.60458330368,"startupDelaySec":-110.531,"processingDelaySec":101.431,"shutdownDelaySec":13.932,"timeDilation":1.1466265746210234,"errors":null,"jobId":null}
2019-12-09T12:15:15.338Z RUNNING Query12 (waiting for shutdown)
2019-12-09T12:15:16.024Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:15:16.024Z no activity
2019-12-09T12:15:21.846Z RUNNING Query11
2019-12-09T12:15:22.625Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:15:22.690Z no activity
2019-12-09T12:15:23.570Z RUNNING BoundedSideInputJoin
2019-12-09T12:15:24.392Z 2 samples not enough to calculate steady-state event rate
2019-12-09T12:15:24.474Z new perf {"snapshots":null,"runtimeSec":129.497,"numEvents":10000000,"eventsPerSec":77221.86614361721,"eventBytesPerSec":9911927.666277982,"numResults":436751,"resultsPerSec":3372.6727260090966,"resultBytesPerSec":288518.791941126,"startupDelaySec":-110.531,"processingDelaySec":101.431,"shutdownDelaySec":12.735,"timeDilation":7.721646061298716,"errors":null,"jobId":null}
2019-12-09T12:15:31.062Z DONE Query12 (waiting for shutdown)
2019-12-09T12:15:31.144Z 1 samples not enough to calculate steady-state event rate
2019-12-09T12:15:37.725Z RUNNING Query11
2019-12-09T12:15:38.497Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:15:38.561Z no activity
2019-12-09T12:15:39.508Z RUNNING BoundedSideInputJoin
2019-12-09T12:15:40.292Z 3 samples not enough to calculate steady-state event rate
2019-12-09T12:15:40.352Z new perf {"snapshots":null,"runtimeSec":143.354,"numEvents":10000000,"eventsPerSec":69757.38381907724,"eventBytesPerSec":8953812.917672334,"numResults":4362091,"resultsPerSec":30428.80561407425,"resultBytesPerSec":2605618.106226544,"startupDelaySec":-110.531,"processingDelaySec":101.431,"shutdownDelaySec":14.95,"timeDilation":6.975250080220991,"errors":null,"jobId":null}
2019-12-09T12:15:53.594Z RUNNING Query11
2019-12-09T12:15:54.352Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:15:54.416Z no activity
2019-12-09T12:15:55.384Z RUNNING BoundedSideInputJoin
2019-12-09T12:15:56.100Z 4 samples not enough to calculate steady-state event rate
2019-12-09T12:15:56.170Z new perf {"snapshots":null,"runtimeSec":155.632,"numEvents":10000000,"eventsPerSec":64254.13796648504,"eventBytesPerSec":8247435.598077516,"numResults":8648940,"resultsPerSec":55573.01840238511,"resultBytesPerSec":4759185.032641102,"startupDelaySec":-110.531,"processingDelaySec":101.431,"shutdownDelaySec":18.55,"timeDilation":6.424964017682738,"errors":null,"jobId":null}
2019-12-09T12:16:09.445Z RUNNING Query11
2019-12-09T12:16:10.142Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:16:10.208Z streaming query appears to have finished waiting for completion.
2019-12-09T12:16:10.208Z no activity
2019-12-09T12:16:11.212Z RUNNING BoundedSideInputJoin
2019-12-09T12:16:11.898Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:16:11.972Z new perf {"snapshots":null,"runtimeSec":162.819,"numEvents":10000000,"eventsPerSec":61417.89348908912,"eventBytesPerSec":7883385.213027964,"numResults":9200000,"resultsPerSec":56504.462009961986,"resultBytesPerSec":4839311.10619768,"startupDelaySec":-110.531,"processingDelaySec":101.431,"shutdownDelaySec":27.181,"timeDilation":6.141359423654488,"errors":null,"jobId":null}
2019-12-09T12:16:25.249Z RUNNING Query11 (waiting for shutdown)
2019-12-09T12:16:25.927Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:16:25.927Z no activity
2019-12-09T12:16:27.002Z RUNNING BoundedSideInputJoin
2019-12-09T12:16:27.691Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:16:27.778Z no activity
2019-12-09T12:16:40.961Z RUNNING Query11 (waiting for shutdown)
2019-12-09T12:16:41.686Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:16:41.686Z no activity
2019-12-09T12:16:42.817Z RUNNING BoundedSideInputJoin
2019-12-09T12:16:43.516Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:16:43.585Z no activity
2019-12-09T12:16:56.724Z RUNNING Query11 (waiting for shutdown)
2019-12-09T12:16:57.620Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:16:57.620Z no activity
2019-12-09T12:16:58.617Z RUNNING BoundedSideInputJoin
2019-12-09T12:16:59.430Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:16:59.501Z no activity
2019-12-09T12:17:12.656Z DONE Query11 (waiting for shutdown)
2019-12-09T12:17:12.688Z 6 samples not enough to calculate steady-state event rate
2019-12-09T12:17:14.536Z RUNNING BoundedSideInputJoin
2019-12-09T12:17:15.240Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:17:15.319Z streaming query appears to have finished waiting for completion.
2019-12-09T12:17:15.319Z no activity
2019-12-09T12:17:30.352Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-09T12:17:31.084Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:17:31.085Z no activity
2019-12-09T12:17:46.112Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-09T12:17:46.821Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:17:46.821Z no activity
2019-12-09T12:18:01.854Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-09T12:18:02.624Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:18:02.624Z no activity
2019-12-09T12:18:17.658Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-09T12:18:18.452Z 5 samples not enough to calculate steady-state event rate
2019-12-09T12:18:18.452Z no activity
2019-12-09T12:18:33.494Z DONE BoundedSideInputJoin (waiting for shutdown)
2019-12-09T12:18:33.542Z 5 samples not enough to calculate steady-state event rate
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 57s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/mdiigoipghumm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4479/display/redirect>
Changes:
------------------------------------------
[...truncated 119.14 KB...]
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:testing:nexmark:processResources UP-TO-DATE
> Task :sdks:java:io:mongodb:processResources NO-SOURCE
> Task :sdks:java:core:generateGrammarSource UP-TO-DATE
> Task :sdks:java:core:processResources UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractIncludeProto UP-TO-DATE
> Task :model:pipeline:extractIncludeProto UP-TO-DATE
> Task :model:pipeline:extractProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:generateProto UP-TO-DATE
> Task :model:pipeline:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava UP-TO-DATE
> Task :model:pipeline:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:processResources UP-TO-DATE
> Task :model:pipeline:processResources UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE
> Task :model:pipeline:classes UP-TO-DATE
> Task :model:pipeline:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE
> Task :model:pipeline:shadowJar UP-TO-DATE
> Task :model:fn-execution:extractIncludeProto UP-TO-DATE
> Task :model:job-management:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:generateProto UP-TO-DATE
> Task :model:job-management:generateProto UP-TO-DATE
> Task :model:fn-execution:compileJava UP-TO-DATE
> Task :model:job-management:compileJava UP-TO-DATE
> Task :model:job-management:classes UP-TO-DATE
> Task :model:fn-execution:classes UP-TO-DATE
> Task :model:job-management:shadowJar UP-TO-DATE
> Task :model:fn-execution:shadowJar UP-TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :sdks:java:core:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:jar UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava UP-TO-DATE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :sdks:java:io:kafka:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava UP-TO-DATE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE
> Task :sdks:java:extensions:sql:compileJava UP-TO-DATE
> Task :sdks:java:extensions:sql:processResources UP-TO-DATE
> Task :sdks:java:extensions:sql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE
> Task :sdks:java:testing:nexmark:classes UP-TO-DATE
> Task :sdks:java:testing:nexmark:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-09T06:07:23.321Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.322Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T06:07:23.322Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.322Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T06:07:23.322Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.322Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.322Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.322Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.321Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.321Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T06:07:23.321Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.321Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.321Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.321Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:23.321Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T06:07:24.355Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 1000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.355Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.355Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.355Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.355Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 10000000 events in streaming mode
2019-12-09T06:07:24.356Z Generating 1000000 events in streaming mode
2019-12-09T06:07:24.375Z Generating 1000000 events in streaming mode
2019-12-09T06:07:24.629Z Expected auction duration is 16667 ms
2019-12-09T06:07:24.630Z Expected auction duration is 16667 ms
2019-12-09T06:07:24.629Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-09T06:07:23.101Z and ran for PT9.493S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main" 0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (ddf088d383b3c00d): The workflow could not be created. Causes: (d5f783b60a7598b1): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (ddf088d383b3c00d): The workflow could not be created. Causes: (d5f783b60a7598b1): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(ddf088d383b3c00d): The workflow could not be created. Causes: (d5f783b60a7598b1): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(ddf088d383b3c00d): The workflow could not be created. Causes: (d5f783b60a7598b1): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 15s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/jupbxbz5rgr3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4478
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4478/display/redirect>
Changes:
------------------------------------------
[...truncated 116.86 KB...]
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:testing:nexmark:processResources UP-TO-DATE
> Task :sdks:java:core:generateGrammarSource UP-TO-DATE
> Task :sdks:java:core:processResources UP-TO-DATE
> Task :sdks:java:io:mongodb:processResources NO-SOURCE
> Task :model:pipeline:extractIncludeProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractIncludeProto UP-TO-DATE
> Task :model:pipeline:extractProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractProto UP-TO-DATE
> Task :model:pipeline:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava UP-TO-DATE
> Task :model:pipeline:compileJava UP-TO-DATE
> Task :model:pipeline:processResources UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:processResources UP-TO-DATE
> Task :model:pipeline:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE
> Task :model:pipeline:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE
> Task :model:pipeline:shadowJar UP-TO-DATE
> Task :model:job-management:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:generateProto UP-TO-DATE
> Task :model:job-management:generateProto UP-TO-DATE
> Task :model:fn-execution:compileJava UP-TO-DATE
> Task :model:job-management:compileJava UP-TO-DATE
> Task :model:job-management:classes UP-TO-DATE
> Task :model:fn-execution:classes UP-TO-DATE
> Task :model:job-management:shadowJar UP-TO-DATE
> Task :model:fn-execution:shadowJar UP-TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :sdks:java:core:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:jar UP-TO-DATE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava UP-TO-DATE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:sql:compileJava UP-TO-DATE
> Task :sdks:java:extensions:sql:processResources UP-TO-DATE
> Task :sdks:java:extensions:sql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE
> Task :sdks:java:testing:nexmark:classes UP-TO-DATE
> Task :sdks:java:testing:nexmark:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-09T00:07:01.391Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.392Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.392Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.392Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.392Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T00:07:01.392Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.392Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T00:07:01.392Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.392Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.391Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-09T00:07:01.391Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.391Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.391Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.391Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:01.391Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 1000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 1000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 1000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.640Z Generating 10000000 events in streaming mode
2019-12-09T00:07:02.965Z Expected auction duration is 16667 ms
2019-12-09T00:07:02.980Z Expected auction duration is 16667 ms
2019-12-09T00:07:02.980Z Expected auction duration is 16667 ms
2019-12-09T00:07:03.128Z Generating 10000000 events in streaming mode
==========================================================================================
Run started 2019-12-09T00:07:01.134Z and ran for PT10.980S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
Exception in thread "main" 0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (54466f44db8f837e): The workflow could not be created. Causes: (5f5311e1b1ef7fdf): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 301 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
0013 *** not run ***
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
0014 *** not run ***
==========================================================================================
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (54466f44db8f837e): The workflow could not be created. Causes: (5f5311e1b1ef7fdf): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 301 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(54466f44db8f837e): The workflow could not be created. Causes: (5f5311e1b1ef7fdf): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 301 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(54466f44db8f837e): The workflow could not be created. Causes: (5f5311e1b1ef7fdf): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 301 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 18s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/6qh26qz3bj6mm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4477
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4477/display/redirect>
Changes:
------------------------------------------
[...truncated 295.76 KB...]
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
2019-12-08T18:21:43.462Z Waiting for main pipeline to 'finish'
2019-12-08T18:21:43.463Z DONE SqlQuery2
==========================================================================================
Run started 2019-12-08T18:17:50.255Z and ran for PT233.275S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 53.3 187504.7 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
2019-12-08T18:22:00.435Z Waiting for main pipeline to 'finish'
2019-12-08T18:22:00.465Z RUNNING SqlQuery3
2019-12-08T18:22:00.748Z Waiting for main pipeline to 'finish'
2019-12-08T18:22:00.787Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:22:01.305Z new perf {"snapshots":null,"runtimeSec":99.55,"numEvents":10000000,"eventsPerSec":100452.03415369161,"eventBytesPerSec":1.2893670487192366E7,"numResults":9054,"resultsPerSec":90.94927172275239,"resultBytesPerSec":2904.7212456052234,"startupDelaySec":-162.898,"processingDelaySec":96.528,"shutdownDelaySec":63.348,"timeDilation":9.969864389753893,"errors":null,"jobId":null}
2019-12-08T18:22:01.656Z new perf {"snapshots":null,"runtimeSec":133.268,"numEvents":10000000,"eventsPerSec":75036.768016328,"eventBytesPerSec":9631456.141009094,"numResults":1112884,"resultsPerSec":8350.721853708317,"resultBytesPerSec":298785.7925383438,"startupDelaySec":-158.543,"processingDelaySec":118.368,"shutdownDelaySec":25.275,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T18:22:16.348Z RUNNING SqlQuery3
2019-12-08T18:22:16.727Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:22:17.190Z no activity
2019-12-08T18:22:17.579Z new perf {"snapshots":null,"runtimeSec":170.02,"numEvents":10000000,"eventsPerSec":58816.60981061051,"eventBytesPerSec":7549493.571344547,"numResults":7727830,"resultsPerSec":45452.47617927302,"resultBytesPerSec":1633434.5665215857,"startupDelaySec":-158.543,"processingDelaySec":118.368,"shutdownDelaySec":4.432,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T18:22:32.239Z DONE SqlQuery3
==========================================================================================
Run started 2019-12-08T18:17:50.255Z and ran for PT282.035S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 53.3 187504.7 83527
0003 99.6 100452.0 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
2019-12-08T18:22:32.663Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:22:33.504Z new perf {"snapshots":null,"runtimeSec":181.956,"numEvents":10000000,"eventsPerSec":54958.341577084575,"eventBytesPerSec":7054259.804568138,"numResults":9200000,"resultsPerSec":50561.67425091781,"resultBytesPerSec":1802258.7603596475,"startupDelaySec":-158.543,"processingDelaySec":118.368,"shutdownDelaySec":8.419,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T18:22:48.585Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:22:49.460Z no activity
2019-12-08T18:23:04.552Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:23:05.490Z no activity
2019-12-08T18:23:20.576Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:23:21.568Z no activity
2019-12-08T18:23:36.630Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:23:37.563Z no activity
2019-12-08T18:23:52.614Z RUNNING SqlBoundedSideInputJoin
2019-12-08T18:23:53.722Z no activity
2019-12-08T18:24:08.810Z DONE SqlBoundedSideInputJoin
==========================================================================================
Run started 2019-12-08T18:17:50.255Z and ran for PT378.606S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 53.3 187504.7 83527
0003 99.6 100452.0 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 182.0 54958.3 9200000
0014 *** not run ***
==========================================================================================
==========================================================================================
Run started 2019-12-08T18:17:50.255Z and ran for PT380.185S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 53.3 187504.7 83527
0003 99.6 100452.0 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 182.0 54958.3 9200000
0014 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:170)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 28s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/ysentwribzdcm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4476/display/redirect>
Changes:
------------------------------------------
[...truncated 114.76 KB...]
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:testing:nexmark:processResources UP-TO-DATE
> Task :sdks:java:core:generateGrammarSource UP-TO-DATE
> Task :sdks:java:core:processResources UP-TO-DATE
> Task :sdks:java:io:mongodb:processResources NO-SOURCE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractIncludeProto UP-TO-DATE
> Task :model:pipeline:extractIncludeProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractProto UP-TO-DATE
> Task :model:pipeline:extractProto UP-TO-DATE
> Task :model:pipeline:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava UP-TO-DATE
> Task :model:pipeline:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:processResources UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE
> Task :model:pipeline:processResources UP-TO-DATE
> Task :model:pipeline:classes UP-TO-DATE
> Task :model:pipeline:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE
> Task :model:pipeline:shadowJar UP-TO-DATE
> Task :model:job-management:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:generateProto UP-TO-DATE
> Task :model:job-management:generateProto UP-TO-DATE
> Task :model:job-management:compileJava UP-TO-DATE
> Task :model:fn-execution:compileJava UP-TO-DATE
> Task :model:job-management:classes UP-TO-DATE
> Task :model:fn-execution:classes UP-TO-DATE
> Task :model:fn-execution:shadowJar UP-TO-DATE
> Task :model:job-management:shadowJar UP-TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :sdks:java:core:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :sdks:java:io:kafka:jar UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava UP-TO-DATE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE
> Task :sdks:java:extensions:sql:compileJava UP-TO-DATE
> Task :sdks:java:extensions:sql:processResources UP-TO-DATE
> Task :sdks:java:extensions:sql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE
> Task :sdks:java:testing:nexmark:classes UP-TO-DATE
> Task :sdks:java:testing:nexmark:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-08T12:07:07.607Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-08T12:07:07.608Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-08T12:07:07.608Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.608Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-08T12:07:07.607Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.607Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.607Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.607Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:07.607Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T12:07:08.732Z Generating 1000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 1000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 1000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.732Z Generating 10000000 events in streaming mode
2019-12-08T12:07:08.734Z Generating 10000000 events in streaming mode
2019-12-08T12:07:09.020Z Expected auction duration is 16667 ms
2019-12-08T12:07:09.020Z Expected auction duration is 16667 ms
2019-12-08T12:07:09.043Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-08T12:07:07.411Z and ran for PT10.202S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
Exception in thread "main" 0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (823d07106673bd60): The workflow could not be created. Causes: (c3522bc1c7d3dc79): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
0014 *** not run ***
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
==========================================================================================
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (823d07106673bd60): The workflow could not be created. Causes: (c3522bc1c7d3dc79): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(823d07106673bd60): The workflow could not be created. Causes: (c3522bc1c7d3dc79): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(823d07106673bd60): The workflow could not be created. Causes: (c3522bc1c7d3dc79): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 23s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/f6wpgdhanapmg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4475
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4475/display/redirect>
Changes:
------------------------------------------
[...truncated 118.16 KB...]
> Task :sdks:java:io:parquet:processResources NO-SOURCE
> Task :sdks:java:testing:nexmark:processResources UP-TO-DATE
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:core:processResources UP-TO-DATE
> Task :sdks:java:io:mongodb:processResources NO-SOURCE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractIncludeProto UP-TO-DATE
> Task :model:pipeline:extractIncludeProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractProto UP-TO-DATE
> Task :model:pipeline:extractProto UP-TO-DATE
> Task :model:pipeline:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:generateProto UP-TO-DATE
> Task :model:pipeline:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava UP-TO-DATE
> Task :model:pipeline:processResources UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:processResources UP-TO-DATE
> Task :model:pipeline:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE
> Task :model:pipeline:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE
> Task :model:pipeline:shadowJar UP-TO-DATE
> Task :model:job-management:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:generateProto UP-TO-DATE
> Task :model:job-management:generateProto UP-TO-DATE
> Task :model:fn-execution:compileJava UP-TO-DATE
> Task :model:fn-execution:classes UP-TO-DATE
> Task :model:job-management:compileJava UP-TO-DATE
> Task :model:job-management:classes UP-TO-DATE
> Task :model:fn-execution:shadowJar UP-TO-DATE
> Task :model:job-management:shadowJar UP-TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :sdks:java:core:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava UP-TO-DATE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE
> Task :sdks:java:io:kafka:jar UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava UP-TO-DATE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE
> Task :sdks:java:extensions:sql:compileJava UP-TO-DATE
> Task :sdks:java:extensions:sql:processResources UP-TO-DATE
> Task :sdks:java:extensions:sql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE
> Task :sdks:java:testing:nexmark:classes UP-TO-DATE
> Task :sdks:java:testing:nexmark:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-08T06:07:06.582Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.583Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-08T06:07:06.583Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.583Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.583Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.583Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.583Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-08T06:07:06.582Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.582Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.582Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-08T06:07:06.582Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.582Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.582Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.582Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:06.582Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 1000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 1000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 1000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.609Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.776Z Generating 10000000 events in streaming mode
2019-12-08T06:07:07.869Z Expected auction duration is 16667 ms
2019-12-08T06:07:07.870Z Expected auction duration is 16667 ms
2019-12-08T06:07:07.870Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-08T06:07:06.354Z and ran for PT9.357S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Exception in thread "main"
java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (e0fc9f327228d358): The workflow could not be created. Causes: (7eada7a3bc897265): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (e0fc9f327228d358): The workflow could not be created. Causes: (7eada7a3bc897265): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(e0fc9f327228d358): The workflow could not be created. Causes: (7eada7a3bc897265): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(e0fc9f327228d358): The workflow could not be created. Causes: (7eada7a3bc897265): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 302 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 19s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/h6cnqiopueoo2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4474
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4474/display/redirect>
Changes:
------------------------------------------
[...truncated 158.20 KB...]
2019-12-08T00:11:44.567Z RUNNING Query8
2019-12-08T00:11:44.835Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:11:44.890Z no activity
2019-12-08T00:11:44.934Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:11:44.991Z no activity
2019-12-08T00:11:45.161Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:11:45.225Z no activity
2019-12-08T00:11:50.811Z RUNNING Query3
2019-12-08T00:11:50.812Z RUNNING Query2
2019-12-08T00:11:51.393Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:11:51.431Z RUNNING Query12
2019-12-08T00:11:51.448Z no activity
2019-12-08T00:11:51.560Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:11:51.584Z RUNNING Query9
2019-12-08T00:11:51.630Z no activity
2019-12-08T00:11:52.067Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:11:52.126Z no activity
2019-12-08T00:11:52.250Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:11:52.313Z no activity
2019-12-08T00:11:59.464Z RUNNING Query0
2019-12-08T00:11:59.920Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:00.028Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:00.058Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:00.114Z no activity
2019-12-08T00:12:00.254Z RUNNING Query8
2019-12-08T00:12:00.499Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:12:00.559Z new perf {"snapshots":null,"runtimeSec":17.994,"numEvents":1260511,"eventsPerSec":70051.73946871179,"eventBytesPerSec":8991685.39513171,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-2.024,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T00:12:00.676Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:00.734Z no activity
2019-12-08T00:12:00.887Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:00.944Z no activity
2019-12-08T00:12:06.477Z RUNNING Query2
2019-12-08T00:12:06.659Z RUNNING Query3
2019-12-08T00:12:07.057Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:07.121Z no activity
2019-12-08T00:12:07.153Z RUNNING Query12
2019-12-08T00:12:07.338Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:07.347Z RUNNING Query9
2019-12-08T00:12:07.397Z no activity
2019-12-08T00:12:07.773Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:07.833Z no activity
2019-12-08T00:12:08.051Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:08.109Z no activity
2019-12-08T00:12:15.147Z RUNNING Query0
2019-12-08T00:12:15.587Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:15.704Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:15.757Z no activity
2019-12-08T00:12:15.762Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:15.973Z RUNNING Query8
2019-12-08T00:12:16.187Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:12:16.248Z new perf {"snapshots":null,"runtimeSec":29.224,"numEvents":2606237,"eventsPerSec":89181.39200656993,"eventBytesPerSec":1.1447505543388994E7,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-2.024,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T00:12:16.366Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:16.428Z no activity
2019-12-08T00:12:16.624Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:16.694Z no activity
2019-12-08T00:12:22.151Z RUNNING Query2
2019-12-08T00:12:22.427Z RUNNING Query3
2019-12-08T00:12:22.767Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:22.829Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:22.829Z no activity
2019-12-08T00:12:22.859Z RUNNING Query12
2019-12-08T00:12:23.140Z RUNNING Query9
2019-12-08T00:12:23.185Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:23.251Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:23.252Z no activity
2019-12-08T00:12:23.472Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:23.529Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:23.529Z no activity
2019-12-08T00:12:23.760Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:23.824Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:23.824Z no activity
2019-12-08T00:12:30.789Z RUNNING Query0
2019-12-08T00:12:31.276Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:31.366Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:31.426Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:31.426Z no activity
2019-12-08T00:12:31.459Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:31.725Z RUNNING Query8
2019-12-08T00:12:31.861Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:12:31.925Z new perf {"snapshots":null,"runtimeSec":49.53,"numEvents":5005171,"eventsPerSec":101053.32121946295,"eventBytesPerSec":1.2972079870785382E7,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-2.024,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T00:12:32.061Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:32.114Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:32.114Z no activity
2019-12-08T00:12:32.350Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:32.414Z streaming query appears to have finished waiting for completion.
2019-12-08T00:12:32.414Z no activity
2019-12-08T00:12:37.859Z RUNNING Query2 (waiting for shutdown)
2019-12-08T00:12:38.284Z RUNNING Query3 (waiting for shutdown)
2019-12-08T00:12:38.513Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:38.513Z no activity
2019-12-08T00:12:38.556Z RUNNING Query12 (waiting for shutdown)
2019-12-08T00:12:38.854Z RUNNING Query9 (waiting for shutdown)
2019-12-08T00:12:39.084Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:39.084Z no activity
2019-12-08T00:12:39.161Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:39.161Z no activity
2019-12-08T00:12:39.522Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:39.522Z no activity
2019-12-08T00:12:46.460Z RUNNING Query0 (waiting for shutdown)
2019-12-08T00:12:46.651Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:46.651Z no activity
2019-12-08T00:12:46.954Z RUNNING BoundedSideInputJoin
2019-12-08T00:12:47.145Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:12:47.442Z RUNNING Query8 (waiting for shutdown)
2019-12-08T00:12:47.552Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:12:47.609Z new perf {"snapshots":null,"runtimeSec":65.982,"numEvents":6592240,"eventsPerSec":99909.67233487921,"eventBytesPerSec":1.282434171440696E7,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-2.024,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T00:12:47.790Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:47.790Z no activity
2019-12-08T00:12:48.053Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:48.053Z no activity
2019-12-08T00:12:53.546Z DONE Query2 (waiting for shutdown)
2019-12-08T00:12:53.576Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:54.135Z DONE Query3 (waiting for shutdown)
2019-12-08T00:12:54.177Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:54.191Z RUNNING Query12 (waiting for shutdown)
2019-12-08T00:12:54.561Z RUNNING Query9 (waiting for shutdown)
2019-12-08T00:12:54.797Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:54.797Z no activity
2019-12-08T00:12:55.204Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:12:55.204Z no activity
2019-12-08T00:13:01.652Z DONE Query0 (waiting for shutdown)
2019-12-08T00:13:01.652Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:02.640Z RUNNING BoundedSideInputJoin
2019-12-08T00:13:02.815Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:13:03.084Z RUNNING Query8 (waiting for shutdown)
2019-12-08T00:13:03.228Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:13:03.289Z new perf {"snapshots":null,"runtimeSec":77.312,"numEvents":8598498,"eventsPerSec":111218.15500827815,"eventBytesPerSec":1.427555488151904E7,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-2.024,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2019-12-08T00:13:03.428Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:03.429Z no activity
2019-12-08T00:13:03.740Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:03.740Z no activity
2019-12-08T00:13:09.831Z RUNNING Query12 (waiting for shutdown)
2019-12-08T00:13:10.235Z RUNNING Query9 (waiting for shutdown)
2019-12-08T00:13:10.419Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:10.419Z no activity
2019-12-08T00:13:10.895Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:10.895Z no activity
2019-12-08T00:13:18.324Z RUNNING BoundedSideInputJoin
2019-12-08T00:13:18.469Z DONE BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:13:18.496Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:18.770Z RUNNING Query8 (waiting for shutdown)
2019-12-08T00:13:18.961Z 0 samples not enough to calculate steady-state event rate
2019-12-08T00:13:19.025Z new perf {"snapshots":null,"runtimeSec":109.48,"numEvents":9280000,"eventsPerSec":84764.34051881621,"eventBytesPerSec":1.0880095661308002E7,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-2.024,"processingDelaySec":103.482,"shutdownDelaySec":2.138,"timeDilation":0.8122944830105956,"errors":null,"jobId":null}
2019-12-08T00:13:19.405Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:19.405Z no activity
2019-12-08T00:13:25.448Z RUNNING Query12 (waiting for shutdown)
2019-12-08T00:13:25.927Z RUNNING Query9 (waiting for shutdown)
2019-12-08T00:13:26.108Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:26.109Z no activity
2019-12-08T00:13:26.583Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:26.583Z no activity
2019-12-08T00:13:34.059Z RUNNING BoundedSideInputJoin
2019-12-08T00:13:34.437Z RUNNING Query8 (waiting for shutdown)
2019-12-08T00:13:34.698Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:34.757Z new perf {"snapshots":null,"runtimeSec":119.173,"numEvents":10000000,"eventsPerSec":83911.62427731113,"eventBytesPerSec":1.0770601537260957E7,"numResults":13359,"resultsPerSec":112.09753887205994,"resultBytesPerSec":9630.587465281566,"startupDelaySec":-2.024,"processingDelaySec":103.482,"shutdownDelaySec":8.182,"timeDilation":0.8383610381546155,"errors":null,"jobId":null}
2019-12-08T00:13:35.118Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:35.118Z no activity
2019-12-08T00:13:41.139Z RUNNING Query12 (waiting for shutdown)
2019-12-08T00:13:41.614Z RUNNING Query9 (waiting for shutdown)
2019-12-08T00:13:41.829Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:41.829Z no activity
2019-12-08T00:13:42.275Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:42.275Z no activity
2019-12-08T00:13:49.818Z RUNNING BoundedSideInputJoin
2019-12-08T00:13:50.174Z RUNNING Query8 (waiting for shutdown)
2019-12-08T00:13:50.463Z 2 samples not enough to calculate steady-state event rate
2019-12-08T00:13:50.520Z new perf {"snapshots":null,"runtimeSec":139.48,"numEvents":10000000,"eventsPerSec":71694.86664754804,"eventBytesPerSec":9202501.412388874,"numResults":4195787,"resultsPerSec":30081.638944651564,"resultBytesPerSec":2575056.811012332,"startupDelaySec":-2.024,"processingDelaySec":103.482,"shutdownDelaySec":3.606,"timeDilation":7.168984800688271,"errors":null,"jobId":null}
2019-12-08T00:13:50.834Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:50.835Z no activity
2019-12-08T00:13:56.860Z RUNNING Query12 (waiting for shutdown)
2019-12-08T00:13:57.312Z DONE Query9 (waiting for shutdown)
2019-12-08T00:13:57.346Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:57.506Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:13:57.507Z no activity
2019-12-08T00:14:05.557Z RUNNING BoundedSideInputJoin
2019-12-08T00:14:05.873Z DONE Query8 (waiting for shutdown)
2019-12-08T00:14:05.911Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:14:06.285Z 3 samples not enough to calculate steady-state event rate
2019-12-08T00:14:06.351Z new perf {"snapshots":null,"runtimeSec":150.04,"numEvents":10000000,"eventsPerSec":66648.89362836577,"eventBytesPerSec":8554818.028525727,"numResults":7893452,"resultsPerSec":52608.9842708611,"resultBytesPerSec":4504844.721407625,"startupDelaySec":-2.024,"processingDelaySec":103.482,"shutdownDelaySec":8.809,"timeDilation":6.664422820581178,"errors":null,"jobId":null}
2019-12-08T00:14:12.541Z DONE Query12 (waiting for shutdown)
2019-12-08T00:14:12.580Z 1 samples not enough to calculate steady-state event rate
2019-12-08T00:14:21.388Z RUNNING BoundedSideInputJoin
2019-12-08T00:14:22.067Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:14:22.131Z new perf {"snapshots":null,"runtimeSec":157.098,"numEvents":10000000,"eventsPerSec":63654.534112464826,"eventBytesPerSec":8170472.55216489,"numResults":9200000,"resultsPerSec":58562.17138346764,"resultBytesPerSec":5015543.132312315,"startupDelaySec":-2.024,"processingDelaySec":103.482,"shutdownDelaySec":17.583,"timeDilation":6.365007829507695,"errors":null,"jobId":null}
2019-12-08T00:14:37.168Z RUNNING BoundedSideInputJoin
2019-12-08T00:14:37.885Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:14:37.954Z no activity
2019-12-08T00:14:52.993Z RUNNING BoundedSideInputJoin
2019-12-08T00:14:53.689Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:14:53.764Z no activity
2019-12-08T00:15:08.826Z RUNNING BoundedSideInputJoin
2019-12-08T00:15:09.512Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:15:09.572Z no activity
2019-12-08T00:15:24.609Z RUNNING BoundedSideInputJoin
2019-12-08T00:15:25.317Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:15:25.380Z streaming query appears to have finished waiting for completion.
2019-12-08T00:15:25.380Z no activity
2019-12-08T00:15:40.437Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:15:41.403Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:15:41.403Z no activity
2019-12-08T00:15:56.439Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:15:57.147Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:15:57.147Z no activity
2019-12-08T00:16:12.191Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:16:12.915Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:16:12.915Z no activity
2019-12-08T00:16:27.959Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:16:28.700Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:16:28.700Z no activity
2019-12-08T00:16:43.732Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:16:44.450Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:16:44.450Z no activity
2019-12-08T00:16:59.483Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:17:00.220Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:17:00.220Z no activity
2019-12-08T00:17:15.253Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:17:15.998Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:17:15.998Z no activity
2019-12-08T00:17:31.034Z RUNNING BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:17:31.765Z 4 samples not enough to calculate steady-state event rate
2019-12-08T00:17:31.766Z no activity
2019-12-08T00:17:46.803Z DONE BoundedSideInputJoin (waiting for shutdown)
2019-12-08T00:17:46.843Z 4 samples not enough to calculate steady-state event rate
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 50s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/gbn6bo55qkffo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#4473
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/4473/display/redirect>
Changes:
------------------------------------------
[...truncated 126.38 KB...]
> Task :sdks:java:testing:test-utils:processResources NO-SOURCE
> Task :sdks:java:testing:nexmark:processResources UP-TO-DATE
> Task :sdks:java:core:generateGrammarSource UP-TO-DATE
> Task :sdks:java:core:processResources UP-TO-DATE
> Task :sdks:java:io:mongodb:processResources NO-SOURCE
> Task :model:pipeline:extractIncludeProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractIncludeProto UP-TO-DATE
> Task :model:pipeline:extractProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:extractProto UP-TO-DATE
> Task :model:pipeline:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:generateProto UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava UP-TO-DATE
> Task :model:pipeline:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:processResources UP-TO-DATE
> Task :model:pipeline:processResources UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE
> Task :model:pipeline:classes UP-TO-DATE
> Task :model:pipeline:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE
> Task :model:pipeline:shadowJar UP-TO-DATE
> Task :model:fn-execution:extractIncludeProto UP-TO-DATE
> Task :model:job-management:extractIncludeProto UP-TO-DATE
> Task :model:fn-execution:generateProto UP-TO-DATE
> Task :model:job-management:generateProto UP-TO-DATE
> Task :model:fn-execution:compileJava UP-TO-DATE
> Task :model:job-management:compileJava UP-TO-DATE
> Task :model:job-management:classes UP-TO-DATE
> Task :model:fn-execution:classes UP-TO-DATE
> Task :model:job-management:shadowJar UP-TO-DATE
> Task :model:fn-execution:shadowJar UP-TO-DATE
> Task :sdks:java:core:compileJava UP-TO-DATE
> Task :sdks:java:core:classes UP-TO-DATE
> Task :sdks:java:core:shadowJar UP-TO-DATE
> Task :sdks:java:core:jar UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE
> Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE
> Task :runners:local-java:compileJava UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :runners:local-java:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar UP-TO-DATE
> Task :runners:local-java:jar UP-TO-DATE
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava UP-TO-DATE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar UP-TO-DATE
> Task :sdks:java:fn-execution:jar UP-TO-DATE
> Task :sdks:java:io:mongodb:compileJava UP-TO-DATE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:jar UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE
> Task :sdks:java:io:kafka:compileJava UP-TO-DATE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE
> Task :runners:core-construction-java:compileJava UP-TO-DATE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar UP-TO-DATE
> Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE
> Task :sdks:java:testing:test-utils:classes UP-TO-DATE
> Task :sdks:java:testing:test-utils:jar UP-TO-DATE
> Task :runners:core-java:compileJava UP-TO-DATE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar UP-TO-DATE
> Task :sdks:java:harness:compileJava UP-TO-DATE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar UP-TO-DATE
> Task :sdks:java:harness:shadowJar UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE
> Task :runners:java-fn-execution:compileJava UP-TO-DATE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar UP-TO-DATE
> Task :runners:direct-java:compileJava UP-TO-DATE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE
> Task :runners:direct-java:shadowJar UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava UP-TO-DATE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar UP-TO-DATE
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE
> Task :sdks:java:extensions:sql:compileJava UP-TO-DATE
> Task :sdks:java:extensions:sql:processResources UP-TO-DATE
> Task :sdks:java:extensions:sql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE
> Task :sdks:java:testing:nexmark:classes UP-TO-DATE
> Task :sdks:java:testing:nexmark:jar UP-TO-DATE
> Task :sdks:java:testing:nexmark:run
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
2019-12-07T18:08:58.002Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.002Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-07T18:08:58.003Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-07T18:08:58.003Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.003Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
2019-12-07T18:08:58.002Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.002Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:58.002Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
2019-12-07T18:08:59.025Z Generating 1000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 1000000 events in streaming mode
2019-12-07T18:08:59.025Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.026Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.045Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.052Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.057Z Generating 1000000 events in streaming mode
2019-12-07T18:08:59.087Z Generating 10000000 events in streaming mode
2019-12-07T18:08:59.298Z Expected auction duration is 16667 ms
2019-12-07T18:08:59.298Z Expected auction duration is 16667 ms
2019-12-07T18:08:59.298Z Expected auction duration is 16667 ms
==========================================================================================
Run started 2019-12-07T18:08:57.785Z and ran for PT9.472S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 *** not run ***
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
Exception in thread "main"
java.lang.RuntimeException: java.lang.RuntimeException: Failed to create a workflow job: (b03e8aaf28135393): The workflow could not be created. Causes: (4817b2d1c591d7e9): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:415)
Caused by: java.lang.RuntimeException: Failed to create a workflow job: (b03e8aaf28135393): The workflow could not be created. Causes: (4817b2d1c591d7e9): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:974)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:188)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:315)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:301)
at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1178)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90)
at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(b03e8aaf28135393): The workflow could not be created. Causes: (4817b2d1c591d7e9): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"reason" : "failedPrecondition"
} ],
"message" : "(b03e8aaf28135393): The workflow could not be created. Causes: (4817b2d1c591d7e9): Dataflow quota error for jobs-per-project quota. Project apache-beam-testing is running 300 jobs. Please check the quota usage via GCP Console. If it exceeds the limit, please wait for a workflow to finish or contact Google Cloud Support to request an increase in quota. If it does not, contact Google Cloud Support.",
"status" : "FAILED_PRECONDITION"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:150)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:417)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1132)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:61)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:960)
... 12 more
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17s
81 actionable tasks: 2 executed, 79 up-to-date
Publishing build scan...
https://scans.gradle.com/s/xncdw2453nxh4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org