You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/04/09 01:05:11 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#7126
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/7126/display/redirect?page=changes>
Changes:
[fabien.caylus] [BEAM-12012] Add API key & token authentication in ElasticsearchIO
[fabien.caylus] Simplify arguments checks
[Boyuan Zhang] Change PubSubSource and PubSubSink translation to avoid special
[Andrew Pilloud] Complex Type Passthrough Test
[Andrew Pilloud] Don't use base types in BeamCalcRel
[Andrew Pilloud] Use correct schema geters, enforce types
[noreply] Turn on mpyp checks for filesystem (#14425)
[Andrew Pilloud] Rename functions, add comments
[noreply] [BEAM-12112] Disable streaming mode for PORTABILITY_BATCH (#14452)
[noreply] [BEAM-9547] Implementations for a few more DataFrame operations (#14362)
------------------------------------------
[...truncated 1.49 MB...]
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 102.6 97451.6 83527
0003 98.8 101253.5 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-04-09T00:57:20.050Z RUNNING SqlQuery0
2021-04-09T00:57:20.482Z RUNNING SqlBoundedSideInputJoin
Apr 09, 2021 12:57:20 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace SqlBoundedSideInputJoin.Results
Apr 09, 2021 12:57:20 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace SqlBoundedSideInputJoin.Results
2021-04-09T00:57:20.974Z new perf {"snapshots":null,"runtimeSec":179.782,"numEvents":10000000,"eventsPerSec":55622.921093324134,"eventBytesPerSec":7139562.898399172,"numResults":9200000,"resultsPerSec":51173.087405858205,"resultBytesPerSec":5142864.947547585,"startupDelaySec":-141.229,"processingDelaySec":0.622,"shutdownDelaySec":8.503,"timeDilation":5.562013994726947,"errors":null,"jobId":null}
2021-04-09T00:57:21.242Z new perf {"snapshots":null,"runtimeSec":167.398,"numEvents":9700000,"eventsPerSec":57945.7341186872,"eventBytesPerSec":7437803.193586542,"numResults":-1,"resultsPerSec":-1.0,"resultBytesPerSec":-1.0,"startupDelaySec":-132.005,"processingDelaySec":-1.0,"shutdownDelaySec":-1.0,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:57:36.017Z RUNNING SqlQuery0
2021-04-09T00:57:36.270Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:57:36.651Z no activity
2021-04-09T00:57:37.001Z new perf {"snapshots":null,"runtimeSec":183.304,"numEvents":10000000,"eventsPerSec":54554.183214768906,"eventBytesPerSec":7002383.4558983985,"numResults":410235,"resultsPerSec":2238.0035351110723,"resultBytesPerSec":80076.29948064417,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":11.729,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:57:51.748Z RUNNING SqlQuery0
2021-04-09T00:57:52.036Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:57:52.365Z no activity
2021-04-09T00:57:52.957Z new perf {"snapshots":null,"runtimeSec":193.667,"numEvents":10000000,"eventsPerSec":51635.02300340275,"eventBytesPerSec":6627690.298295528,"numResults":454448,"resultsPerSec":2346.543293385037,"resultBytesPerSec":83904.3616103931,"startupDelaySec":-132.005,"processingDelaySec":173.728,"shutdownDelaySec":17.126,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:58:07.393Z RUNNING SqlQuery0
2021-04-09T00:58:07.984Z no activity
2021-04-09T00:58:08.068Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:58:08.801Z new perf {"snapshots":null,"runtimeSec":211.71,"numEvents":10000000,"eventsPerSec":47234.42444853809,"eventBytesPerSec":6062844.915214208,"numResults":1245826,"resultsPerSec":5884.5874073024415,"resultBytesPerSec":210559.3642246469,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":15.038,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:58:23.019Z DONE SqlQuery0
==========================================================================================
Run started 2021-04-09T00:52:18.773Z and ran for PT364.278S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 179.8 55622.9 9200000
0001 *** not run ***
0002 102.6 97451.6 83527
0003 98.8 101253.5 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-04-09T00:58:23.867Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:58:24.554Z no activity
2021-04-09T00:58:39.592Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:58:40.370Z no activity
2021-04-09T00:58:55.401Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:58:56.175Z new perf {"snapshots":null,"runtimeSec":271.122,"numEvents":10000000,"eventsPerSec":36883.76450454039,"eventBytesPerSec":4734270.538724264,"numResults":2680976,"resultsPerSec":9888.448742632467,"resultBytesPerSec":354963.1973797773,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":3.039,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:59:11.245Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:59:11.876Z new perf {"snapshots":null,"runtimeSec":276.95,"numEvents":10000000,"eventsPerSec":36107.600649936816,"eventBytesPerSec":4634644.870915328,"numResults":4244899,"resultsPerSec":15327.311789131612,"resultBytesPerSec":550666.5138111573,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":13.016,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:59:26.932Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:59:27.583Z new perf {"snapshots":null,"runtimeSec":296.327,"numEvents":10000000,"eventsPerSec":33746.503018624695,"eventBytesPerSec":4331582.66712112,"numResults":7133728,"resultsPerSec":24073.83734860475,"resultBytesPerSec":865536.6267670513,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":9.34,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:59:42.613Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:59:43.264Z new perf {"snapshots":null,"runtimeSec":318.197,"numEvents":10000000,"eventsPerSec":31427.071908283233,"eventBytesPerSec":4033868.631696716,"numResults":7769605,"resultsPerSec":24417.593503395696,"resultBytesPerSec":877507.9651913751,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":3.177,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T00:59:58.294Z RUNNING SqlBoundedSideInputJoin
2021-04-09T00:59:58.996Z no activity
2021-04-09T01:00:14.025Z RUNNING SqlBoundedSideInputJoin
2021-04-09T01:00:14.701Z no activity
2021-04-09T01:00:29.734Z RUNNING SqlBoundedSideInputJoin
2021-04-09T01:00:30.478Z new perf {"snapshots":null,"runtimeSec":354.411,"numEvents":10000000,"eventsPerSec":28215.828515480614,"eventBytesPerSec":3621684.7022242537,"numResults":9200000,"resultsPerSec":25958.562234242167,"resultBytesPerSec":925286.7292493744,"startupDelaySec":-132.005,"processingDelaySec":173.641,"shutdownDelaySec":14.081,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-04-09T01:00:45.530Z RUNNING SqlBoundedSideInputJoin
2021-04-09T01:00:46.164Z no activity
2021-04-09T01:01:01.203Z RUNNING SqlBoundedSideInputJoin
2021-04-09T01:01:01.828Z no activity
2021-04-09T01:01:16.892Z RUNNING SqlBoundedSideInputJoin
2021-04-09T01:01:17.594Z no activity
2021-04-09T01:01:32.628Z DONE SqlBoundedSideInputJoin
==========================================================================================
Run started 2021-04-09T00:52:18.773Z and ran for PT553.896S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 179.8 55622.9 9200000
0001 *** not run ***
0002 102.6 97451.6 83527
0003 98.8 101253.5 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 354.4 28215.8 9200000
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-04-09T00:52:18.773Z and ran for PT555.205S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 179.8 55622.9 9200000
0001 *** not run ***
0002 102.6 97451.6 83527
0003 98.8 101253.5 9054
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 354.4 28215.8 9200000
0015 *** not run ***
==========================================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 9m 21s
114 actionable tasks: 2 executed, 112 up-to-date
Publishing build scan...
https://gradle.com/s/pugodwer6huhy
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-11' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
at com.sun.proxy.$Proxy140.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203)
at hudson.Launcher$ProcStarter.join(Launcher.java:523)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804)
at hudson.model.Build$BuildExecution.build(Build.java:197)
at hudson.model.Build$BuildExecution.doRun(Build.java:163)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:514)
at hudson.model.Run.execute(Run.java:1907)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1322)
at hudson.remoting.Channel$1.handle(Channel.java:607)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:85)
Caused by: Command Close created at
at hudson.remoting.Command.<init>(Command.java:70)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1315)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1313)
at hudson.remoting.Channel.close(Channel.java:1488)
at hudson.remoting.Channel.close(Channel.java:1455)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1321)
... 2 more
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-11 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #7127
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/7127/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org