You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/08/18 06:14:39 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6191
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6191/display/redirect?page=changes>
Changes:
[heejong] [BEAM-10679] improving XLang KafkaIO streaming test
[heejong] fix formatting
[heejong] fix incorrect coder issue
[heejong] use Create
[noreply] [BEAM-9919] Added an External Transform API to Go SDK (#12445)
------------------------------------------
[...truncated 841.50 KB...]
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 17.9 559190.3 9200000
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 *** not run ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
Aug 18, 2020 6:11:55 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2020-08-18T06:11:55.028Z Waiting for main pipeline to 'finish'
2020-08-18T06:11:55.081Z RUNNING Query11
2020-08-18T06:11:55.848Z 1 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:11:55 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:11:55.918Z new perf {"snapshots":null,"runtimeSec":140.413,"numEvents":9159824,"eventsPerSec":65234.87141503991,"eventBytesPerSec":8373453.939450051,"numResults":796717,"resultsPerSec":5674.097127758825,"resultBytesPerSec":90785.5540441412,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":15.231,"timeDilation":3.2400846075505827,"errors":null,"jobId":null}
2020-08-18T06:12:10.982Z RUNNING Query11
2020-08-18T06:12:11.792Z 2 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:12:11 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:12:11.858Z new perf {"snapshots":null,"runtimeSec":159.461,"numEvents":9421207,"eventsPerSec":59081.57480512476,"eventBytesPerSec":7583542.352048462,"numResults":915061,"resultsPerSec":5738.46269620785,"resultBytesPerSec":91815.4031393256,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":12.076,"timeDilation":3.404907783094299,"errors":null,"jobId":null}
2020-08-18T06:12:26.918Z RUNNING Query11
2020-08-18T06:12:27.666Z 3 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:12:27 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:12:27.729Z new perf {"snapshots":null,"runtimeSec":173.841,"numEvents":9715444,"eventsPerSec":55886.95417076524,"eventBytesPerSec":7173549.473369343,"numResults":996644,"resultsPerSec":5733.07792753148,"resultBytesPerSec":91729.24684050368,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":13.635,"timeDilation":3.260623213166054,"errors":null,"jobId":null}
2020-08-18T06:12:42.812Z RUNNING Query11
2020-08-18T06:12:43.537Z 4 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:12:43 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:12:43.604Z new perf {"snapshots":null,"runtimeSec":183.84,"numEvents":9804269,"eventsPerSec":53330.44495213229,"eventBytesPerSec":6845371.904917319,"numResults":1210323,"resultsPerSec":6583.567232375979,"resultBytesPerSec":105337.07571801567,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":19.506,"timeDilation":3.627882941688425,"errors":null,"jobId":null}
2020-08-18T06:12:58.664Z RUNNING Query11
2020-08-18T06:12:59.374Z 5 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:12:59 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:12:59.513Z new perf {"snapshots":null,"runtimeSec":213.84,"numEvents":10000000,"eventsPerSec":46763.93565282454,"eventBytesPerSec":6002454.624953236,"numResults":1366927,"resultsPerSec":6392.288627010849,"resultBytesPerSec":111862.47661803217,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":5.381,"timeDilation":4.67615974560419,"errors":null,"jobId":null}
2020-08-18T06:13:14.593Z RUNNING Query11
2020-08-18T06:13:15.352Z 6 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:13:15 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:13:15.422Z new perf {"snapshots":null,"runtimeSec":226.505,"numEvents":10000000,"eventsPerSec":44149.13578066709,"eventBytesPerSec":5666828.0920950975,"numResults":1836853,"resultsPerSec":8109.54725061257,"resultBytesPerSec":129752.75600980112,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":8.624,"timeDilation":4.414692832387806,"errors":null,"jobId":null}
2020-08-18T06:13:30.495Z RUNNING Query11
2020-08-18T06:13:31.321Z 7 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:13:31 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:13:31.392Z new perf {"snapshots":null,"runtimeSec":226.505,"numEvents":10000000,"eventsPerSec":44149.13578066709,"eventBytesPerSec":5666828.0920950975,"numResults":1839657,"resultsPerSec":8121.926668285469,"resultBytesPerSec":129950.8266925675,"startupDelaySec":-155.644,"processingDelaySec":31.462,"shutdownDelaySec":24.534,"timeDilation":4.414692832387806,"errors":null,"jobId":null}
2020-08-18T06:13:46.515Z RUNNING Query11
2020-08-18T06:13:47.284Z 7 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:13:47 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-18T06:13:47.366Z no activity
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:14:02.418Z RUNNING Query11
2020-08-18T06:14:03.230Z 7 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:14:03 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-18T06:14:03.295Z no activity
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:14:18.352Z RUNNING Query11
2020-08-18T06:14:19.112Z 7 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:14:19 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:14:19.177Z no activity
2020-08-18T06:14:34.281Z DONE Query11
2020-08-18T06:14:34.316Z 7 samples not enough to calculate steady-state event rate
Aug 18, 2020 6:14:34 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2020-08-18T06:14:34.316Z streaming query appears to have finished waiting for completion.
==========================================================================================
Run started 2020-08-18T06:07:02.925Z and ran for PT451.392S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 17.9 559190.3 9200000
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 226.5 44149.1 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2020-08-18T06:07:02.925Z and ran for PT454.836S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 17.9 559190.3 9200000
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 226.5 44149.1 1839657
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 47s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/xa7s62la2iidy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #6192
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6192/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org