You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/08/19 18:19:06 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6197
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6197/display/redirect?page=changes>
Changes:
[zyichi] Allow Nexmark launcher to publish human-readable events to pubsub.
[irvi.fa] [BEAM-10753] Add Slack link invitation on README
[Luke Cwik] [BEAM-10756] Fix empty pull response to not ack and to not throw
[noreply] Merge pull request #12597: [BEAM-10685] Added integration test for
[ettarapp] clarifying unclear comments
[noreply] Update README.md
[noreply] [BEAM-3301] Adding SDF Go Dataflow translation. (#12629)
[noreply] [BEAM-10752] Use TestPubsubSignal in PubsubToBigqueryIT (#12625)
------------------------------------------
[...truncated 1.20 MB...]
*** Job was unexpectedly updated ***
0002 *** not run ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
Aug 19, 2020 6:14:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2020-08-19T18:14:55.591Z: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 19, 2020 6:15:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:04.969Z: Autoscaling: Raised the number of ****s to 3 based on the rate of progress in the currently running stage(s).
Aug 19, 2020 6:15:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:05.010Z: Resized **** pool to 3, though goal was 4. This could be a quota issue.
Aug 19, 2020 6:15:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:07.421Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s).
Aug 19, 2020 6:15:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:10.387Z: Autoscaling: Raised the number of ****s to 4 based on the rate of progress in the currently running stage(s).
Aug 19, 2020 6:15:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:28.619Z: Workers have started successfully.
Aug 19, 2020 6:15:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:28.653Z: Workers have started successfully.
Aug 19, 2020 6:15:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:36.455Z: Workers have started successfully.
Aug 19, 2020 6:15:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:15:36.496Z: Workers have started successfully.
Aug 19, 2020 6:16:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:20.370Z: Finished operation SqlQuery2.ReadBounded+SqlQuery2/SqlQuery2.Monitor+SqlQuery2/SqlQuery2.Snoop+SqlQuery2/SqlQuery2/Filter/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlQuery2.SelectEvent/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamIOSourceRel_31/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2/SqlTransform/BeamCalcRel_430/ParDo(Calc)+SqlQuery2/SqlQuery2/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery2/SqlQuery2.Debug+SqlQuery2/SqlQuery2.Stamp+SqlQuery2.Format+SqlQuery2.DevNull
Aug 19, 2020 6:16:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:20.643Z: Cleaning up.
Aug 19, 2020 6:16:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:20.728Z: Stopping **** pool...
Aug 19, 2020 6:16:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:52.431Z: Finished operation NexmarkUtils.GenerateSideInputData/GenerateSequence/Read(BoundedCountingSource)+NexmarkUtils.GenerateSideInputData/MapElements/Map+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SideToRows/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamIOSourceRel_48/Convert.ConvertTransform/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/extractKeyrhs+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable1+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write
Aug 19, 2020 6:16:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:56.606Z: Finished operation SqlBoundedSideInputJoin.ReadBounded+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Monitor+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Snoop+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/Filter/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.SelectEvent/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamIOSourceRel_35/Convert.ConvertTransform/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1266/ParDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/extractKeylhs+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/MakeUnionTable0+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Reify+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Write
Aug 19, 2020 6:16:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:56.692Z: Executing operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close
Aug 19, 2020 6:16:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:56.734Z: Finished operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Close
Aug 19, 2020 6:16:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:16:56.808Z: Executing operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Select.Fields/ParDo(Select)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1268/ParDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/ResultToBid/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Debug+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Stamp+SqlBoundedSideInputJoin.Format+SqlBoundedSideInputJoin.DevNull
Aug 19, 2020 6:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:17:11.147Z: Autoscaling: Resized **** pool from 4 to 0.
Aug 19, 2020 6:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:17:11.198Z: Worker pool stopped.
Aug 19, 2020 6:17:19 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2020-08-19_11_14_25-13954839864098030500 finished with status DONE.
2020-08-19T18:17:19.219Z Waiting for main pipeline to 'finish'
2020-08-19T18:17:19.219Z DONE SqlQuery2
==========================================================================================
Run started 2020-08-19T18:14:14.413Z and ran for PT184.873S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 35.1 284851.6 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
==========================================================================================
Aug 19, 2020 6:17:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2020-08-19T18:17:43.486Z: The Compute Engine API has not fully initialized. Please try again in a few minutes. Causes: Unable to get information for region us-central1.
Aug 19, 2020 6:18:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:18:00.571Z: Finished operation SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/Read+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/GBK/GroupByWindow+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/CoGroupByKey/ConstructCoGbkResultFn+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Join.Impl/CoGroup.ExpandCrossProduct/ParDo(ConvertCoGbkResult)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCoGBKJoinRel_1267/Select.Fields/ParDo(Select)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/SqlTransform/BeamCalcRel_1268/ParDo(Calc)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin/ResultToBid/ParDo(Anonymous)+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Debug+SqlBoundedSideInputJoin/SqlBoundedSideInputJoin.Stamp+SqlBoundedSideInputJoin.Format+SqlBoundedSideInputJoin.DevNull
Aug 19, 2020 6:18:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:18:00.715Z: Cleaning up.
Aug 19, 2020 6:18:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-19T18:18:00.789Z: Stopping **** pool...
Aug 19, 2020 6:18:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2020-08-19T18:18:31.360Z Waiting for main pipeline to 'finish'
2020-08-19T18:18:31.401Z RUNNING SqlBoundedSideInputJoin
2020-08-19T18:18:32.338Z new perf {"snapshots":null,"runtimeSec":122.376,"numEvents":10000000,"eventsPerSec":81715.36902660652,"eventBytesPerSec":1.0488697922795318E7,"numResults":9200000,"resultsPerSec":75178.139504478,"resultBytesPerSec":2679706.764398248,"startupDelaySec":-153.207,"processingDelaySec":59.533,"shutdownDelaySec":30.831,"timeDilation":-1.0,"errors":null,"jobId":null}
2020-08-19T18:18:47.402Z RUNNING SqlBoundedSideInputJoin
2020-08-19T18:18:48.290Z no activity
2020-08-19T18:19:03.392Z DONE SqlBoundedSideInputJoin
==========================================================================================
Run started 2020-08-19T18:14:14.413Z and ran for PT289.025S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 35.1 284851.6 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 122.4 81715.4 9200000
0014 *** not run ***
==========================================================================================
==========================================================================================
Run started 2020-08-19T18:14:14.413Z and ran for PT290.756S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 35.1 284851.6 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 122.4 81715.4 9200000
0014 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 55s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/husv7u6ezsr74
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow #6201
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6201/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6200
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6200/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
Aug 20, 2020 12:12:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2020-08-20T12:12:04.861Z no activity
2020-08-20T12:12:19.448Z RUNNING Query5
2020-08-20T12:12:19.716Z RUNNING BoundedSideInputJoin
2020-08-20T12:12:19.972Z RUNNING Query7
2020-08-20T12:12:20.239Z 2 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query5
2020-08-20T12:12:20.308Z no activity
2020-08-20T12:12:20.690Z 3 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
2020-08-20T12:12:20.755Z no activity
2020-08-20T12:12:20.916Z 3 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:21 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2020-08-20T12:12:21.014Z no activity
2020-08-20T12:12:35.381Z DONE Query5
2020-08-20T12:12:35.427Z 2 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:35 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query5
2020-08-20T12:12:35.427Z streaming query appears to have finished waiting for completion.
==========================================================================================
Run started 2020-08-20T12:07:00.572Z and ran for PT334.855S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardHours":0,"standardMinutes":10,"standardSeconds":600,"standardDays":0,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 428742.9 10000000
0001 22.9 436738.4 9200000
0002 12.4 803923.1 83527
0003 49.3 202938.6 59435
0004 56.8 17593.2 140
0005 149.9 66722.3 4567
0006 39.8 25143.3 13456
0007 *** not run ***
0008 48.8 204720.9 92833
0009 39.4 25405.2 32548
0010 108.4 92239.9 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 91.4 109424.8 611652
0013 29.4 339824.0 9200000
0014 *** not run ***
==========================================================================================
2020-08-20T12:12:35.904Z RUNNING BoundedSideInputJoin
2020-08-20T12:12:36.122Z DONE Query7
2020-08-20T12:12:36.157Z 3 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
==========================================================================================
Run started 2020-08-20T12:07:00.572Z and ran for PT335.586S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardHours":0,"standardMinutes":10,"standardSeconds":600,"standardDays":0,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 428742.9 10000000
0001 22.9 436738.4 9200000
0002 12.4 803923.1 83527
0003 49.3 202938.6 59435
0004 56.8 17593.2 140
0005 149.9 66722.3 4567
0006 39.8 25143.3 13456
0007 112.7 88751.6 100
0008 48.8 204720.9 92833
0009 39.4 25405.2 32548
0010 108.4 92239.9 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 91.4 109424.8 611652
0013 29.4 339824.0 9200000
0014 *** not run ***
==========================================================================================
2020-08-20T12:12:36.832Z 3 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2020-08-20T12:12:36.915Z no activity
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
2020-08-20T12:12:52.036Z RUNNING BoundedSideInputJoin
2020-08-20T12:12:52.862Z 3 samples not enough to calculate steady-state event rate
Aug 20, 2020 12:12:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace BoundedSideInputJoin
2020-08-20T12:12:52.932Z streaming query appears to have finished waiting for completion.
2020-08-20T12:12:52.932Z no activity
2020-08-20T12:13:07.985Z DONE BoundedSideInputJoin (waiting for shutdown)
2020-08-20T12:13:08.026Z 3 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2020-08-20T12:07:00.572Z and ran for PT367.455S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardHours":0,"standardMinutes":10,"standardSeconds":600,"standardDays":0,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 428742.9 10000000
0001 22.9 436738.4 9200000
0002 12.4 803923.1 83527
0003 49.3 202938.6 59435
0004 56.8 17593.2 140
0005 149.9 66722.3 4567
0006 39.8 25143.3 13456
0007 112.7 88751.6 100
0008 48.8 204720.9 92833
0009 39.4 25405.2 32548
0010 108.4 92239.9 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 91.4 109424.8 611652
0013 29.4 339824.0 9200000
0014 148.1 67536.5 9200000
==========================================================================================
==========================================================================================
Run started 2020-08-20T12:07:00.572Z and ran for PT370.886S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardHours":0,"standardMinutes":10,"standardSeconds":600,"standardDays":0,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 428742.9 10000000
0001 22.9 436738.4 9200000
0002 12.4 803923.1 83527
0003 49.3 202938.6 59435
0004 56.8 17593.2 140
0005 149.9 66722.3 4567
0006 39.8 25143.3 13456
0007 112.7 88751.6 100
0008 48.8 204720.9 92833
0009 39.4 25405.2 32548
0010 108.4 92239.9 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 91.4 109424.8 611652
0013 29.4 339824.0 9200000
0014 148.1 67536.5 9200000
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 16s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/27auwfthtqaoi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6199
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6199/display/redirect?page=changes>
Changes:
[douglas.damon] Add Filter lesson to Go SDK katas
[douglas.damon] Reformat code for readability
[yoshiki.obata] [BEAM-9980] Configure Python versions for direct test suite tasks via
[douglas.damon] Change license info format in task-info.yaml
[douglas.damon] Update stepik course
[kevinsijo] [BEAM-9920] Enabling artifact staging for xlang transforms
[kevinsijo] documentation(beam/sdks/go): added apache license and function docstring
[noreply] [BEAM-9547] Implement dataframes top, join, merge. (#12516)
[kevinsijo] fix(beam/sdks/go): correcting changed function name
[noreply] Merge pull request #12581 from [BEAM-10378] Add Azure Blob Storage
------------------------------------------
[...truncated 889.16 KB...]
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 429830.2 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 11.2 891106.8 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 55.1 18150.1 140
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 39.2 25535.6 13867
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 *** not run ***
0013 31.4 318025.7 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
Aug 20, 2020 6:11:29 AM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2020-08-19_23_07_35-13677971818893354626 finished with status DONE.
2020-08-20T06:11:29.254Z Waiting for main pipeline to 'finish'
2020-08-20T06:11:29.254Z DONE Query9
2020-08-20T06:11:29.309Z 1 samples not enough to calculate steady-state event rate
Aug 20, 2020 6:11:29 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query9
==========================================================================================
Run started 2020-08-20T06:07:08.536Z and ran for PT260.773S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 429830.2 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 11.2 891106.8 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 55.1 18150.1 140
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 39.2 25535.6 13867
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 34.8 28725.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 *** not run ***
0013 31.4 318025.7 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
Aug 20, 2020 6:11:36 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2020-08-20T06:11:36.238Z Waiting for main pipeline to 'finish'
2020-08-20T06:11:36.280Z RUNNING Query12
2020-08-20T06:11:37.552Z 1 samples not enough to calculate steady-state event rate
Aug 20, 2020 6:11:37 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query12
2020-08-20T06:11:37.626Z new perf {"snapshots":null,"runtimeSec":89.48,"numEvents":10000000,"eventsPerSec":111756.81716584711,"eventBytesPerSec":1.4344712751452837E7,"numResults":619290,"resultsPerSec":6920.9879302637455,"resultBytesPerSec":110735.80688421993,"startupDelaySec":-150.366,"processingDelaySec":15.501,"shutdownDelaySec":60.886,"timeDilation":-1.0,"errors":null,"jobId":null}
2020-08-20T06:11:52.710Z RUNNING Query12
2020-08-20T06:11:53.711Z 1 samples not enough to calculate steady-state event rate
Aug 20, 2020 6:11:53 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query12
2020-08-20T06:11:53.784Z no activity
2020-08-20T06:12:08.970Z DONE Query12
2020-08-20T06:12:09.005Z 1 samples not enough to calculate steady-state event rate
Aug 20, 2020 6:12:09 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query12
==========================================================================================
Run started 2020-08-20T06:07:08.536Z and ran for PT300.470S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 429830.2 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 11.2 891106.8 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 55.1 18150.1 140
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 39.2 25535.6 13867
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 34.8 28725.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 89.5 111756.8 619290
0013 31.4 318025.7 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
==========================================================================================
Run started 2020-08-20T06:07:08.536Z and ran for PT303.487S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 23.3 429830.2 10000000
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 11.2 891106.8 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 55.1 18150.1 140
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 39.2 25535.6 13867
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 34.8 28725.7 32548
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 89.5 111756.8 619290
0013 31.4 318025.7 9200000
0014 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 14s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/hn5kue6dy2vau
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow
#6198
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/6198/display/redirect?page=changes>
Changes:
[chamikaramj] Include coders embedded in CombinePayload when converting x-lang
[kevinsijo] [BEAM-9919] Refining xlang types and wrappers
[Luke Cwik] [BEAM-9979] Support a reset call that happens after the bundle is done
[noreply] [BEAM-10200] Add optional experiment to enable heap dump through the …
[kevinsijo] [BEAM-9919] xlang transforms wrapped with namespaces
[kevinsijo] [BEAM-9919] cleaning namespace.go
------------------------------------------
[...truncated 1.64 MB...]
2020-08-20T01:09:05.693Z RUNNING SqlQuery0
2020-08-20T01:09:06.424Z RUNNING SqlQuery2
2020-08-20T01:09:06.541Z new perf {"snapshots":null,"runtimeSec":1275.342,"numEvents":8800000,"eventsPerSec":6900.109931296859,"eventBytesPerSec":885667.5919086802,"numResults":8096000,"resultsPerSec":6348.1011367931105,"resultBytesPerSec":637983.6788877022,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":8.413,"timeDilation":0.7840641961136698,"errors":null,"jobId":null}
2020-08-20T01:09:07.666Z no activity
2020-08-20T01:09:21.592Z RUNNING SqlQuery0
2020-08-20T01:09:22.342Z no activity
2020-08-20T01:09:22.717Z RUNNING SqlQuery2
2020-08-20T01:09:23.593Z no activity
2020-08-20T01:09:37.407Z RUNNING SqlQuery0
2020-08-20T01:09:38.356Z no activity
2020-08-20T01:09:38.770Z RUNNING SqlQuery2
2020-08-20T01:09:39.907Z no activity
2020-08-20T01:09:53.507Z RUNNING SqlQuery0
2020-08-20T01:09:54.327Z new perf {"snapshots":null,"runtimeSec":1321.577,"numEvents":9000000,"eventsPerSec":6810.045877009058,"eventBytesPerSec":874106.2352023378,"numResults":8280000,"resultsPerSec":6265.242206848334,"resultBytesPerSec":629654.6406300957,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":9.943,"timeDilation":0.756633930523912,"errors":null,"jobId":null}
2020-08-20T01:09:54.947Z DONE SqlQuery2
==========================================================================================
Run started 2020-08-20T00:46:08.000Z and ran for PT1426.987S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 *** not run ***
0001 *** not run ***
0002 1262.7 7919.7 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
2020-08-20T01:10:09.376Z RUNNING SqlQuery0
2020-08-20T01:10:10.285Z new perf {"snapshots":null,"runtimeSec":1331.037,"numEvents":9200000,"eventsPerSec":6911.904026710001,"eventBytesPerSec":887181.6515994671,"numResults":8464000,"resultsPerSec":6358.951704573201,"resultBytesPerSec":639071.4405384674,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":16.454,"timeDilation":0.7512563512509419,"errors":null,"jobId":null}
2020-08-20T01:10:25.352Z RUNNING SqlQuery0
2020-08-20T01:10:26.218Z no activity
2020-08-20T01:10:41.302Z RUNNING SqlQuery0
2020-08-20T01:10:42.153Z new perf {"snapshots":null,"runtimeSec":1370.363,"numEvents":9300000,"eventsPerSec":6786.522986974984,"eventBytesPerSec":871089.2303718065,"numResults":8556000,"resultsPerSec":6243.6011480169855,"resultBytesPerSec":627479.4167676739,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":9.02,"timeDilation":0.7296971678307135,"errors":null,"jobId":null}
2020-08-20T01:10:57.201Z RUNNING SqlQuery0
2020-08-20T01:10:58.174Z new perf {"snapshots":null,"runtimeSec":1386.409,"numEvents":9600000,"eventsPerSec":6924.363589676639,"eventBytesPerSec":888784.9977892525,"numResults":8832000,"resultsPerSec":6370.414502502508,"resultBytesPerSec":640222.0001457001,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":8.909,"timeDilation":0.7212518095309537,"errors":null,"jobId":null}
2020-08-20T01:11:13.271Z RUNNING SqlQuery0
2020-08-20T01:11:14.196Z no activity
2020-08-20T01:11:29.273Z RUNNING SqlQuery0
2020-08-20T01:11:30.160Z no activity
2020-08-20T01:11:45.224Z RUNNING SqlQuery0
2020-08-20T01:11:46.185Z new perf {"snapshots":null,"runtimeSec":1426.939,"numEvents":9700000,"eventsPerSec":6797.767809275659,"eventBytesPerSec":872535.9724557251,"numResults":8924000,"resultsPerSec":6253.946384533606,"resultBytesPerSec":628516.6752047564,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":16.385,"timeDilation":0.7007657650397109,"errors":null,"jobId":null}
2020-08-20T01:12:01.287Z RUNNING SqlQuery0
2020-08-20T01:12:02.200Z new perf {"snapshots":null,"runtimeSec":1442.76,"numEvents":10000000,"eventsPerSec":6931.159721644625,"eventBytesPerSec":889659.3314203332,"numResults":9200000,"resultsPerSec":6376.666943913056,"resultBytesPerSec":640851.2476087499,"startupDelaySec":-160.46,"processingDelaySec":0.611,"shutdownDelaySec":16.589,"timeDilation":0.6930813163658543,"errors":null,"jobId":null}
2020-08-20T01:12:17.296Z RUNNING SqlQuery0
2020-08-20T01:12:18.134Z no activity
2020-08-20T01:12:33.192Z RUNNING SqlQuery0
2020-08-20T01:12:34.204Z no activity
2020-08-20T01:12:49.294Z RUNNING SqlQuery0
2020-08-20T01:12:50.111Z no activity
2020-08-20T01:13:05.178Z RUNNING SqlQuery0
2020-08-20T01:13:06.064Z no activity
2020-08-20T01:13:21.142Z RUNNING SqlQuery0
2020-08-20T01:13:21.998Z no activity
2020-08-20T01:13:37.069Z RUNNING SqlQuery0
2020-08-20T01:13:37.951Z no activity
2020-08-20T01:13:53.001Z RUNNING SqlQuery0
2020-08-20T01:13:53.833Z no activity
2020-08-20T01:14:08.890Z RUNNING SqlQuery0
2020-08-20T01:14:09.729Z no activity
2020-08-20T01:14:24.781Z RUNNING SqlQuery0
2020-08-20T01:14:25.653Z no activity
2020-08-20T01:14:40.716Z RUNNING SqlQuery0
2020-08-20T01:14:41.480Z no activity
2020-08-20T01:14:56.554Z RUNNING SqlQuery0
2020-08-20T01:14:57.349Z no activity
2020-08-20T01:15:12.534Z RUNNING SqlQuery0
2020-08-20T01:15:13.390Z no activity
2020-08-20T01:15:28.449Z RUNNING SqlQuery0
2020-08-20T01:15:29.276Z no activity
2020-08-20T01:15:44.347Z RUNNING SqlQuery0
2020-08-20T01:15:45.158Z no activity
2020-08-20T01:16:00.232Z RUNNING SqlQuery0
2020-08-20T01:16:01.096Z no activity
2020-08-20T01:16:16.179Z RUNNING SqlQuery0
2020-08-20T01:16:16.940Z no activity
2020-08-20T01:16:32.006Z RUNNING SqlQuery0
2020-08-20T01:16:32.813Z no activity
2020-08-20T01:16:47.888Z RUNNING SqlQuery0
2020-08-20T01:16:48.682Z no activity
2020-08-20T01:17:03.753Z RUNNING SqlQuery0
2020-08-20T01:17:04.895Z no activity
2020-08-20T01:17:20.002Z RUNNING SqlQuery0
2020-08-20T01:17:20.788Z no activity
2020-08-20T01:17:35.881Z RUNNING SqlQuery0
2020-08-20T01:17:36.655Z no activity
2020-08-20T01:17:51.721Z RUNNING SqlQuery0
2020-08-20T01:17:52.508Z no activity
2020-08-20T01:18:07.564Z RUNNING SqlQuery0
2020-08-20T01:18:08.411Z no activity
2020-08-20T01:18:23.479Z RUNNING SqlQuery0
2020-08-20T01:18:24.283Z no activity
2020-08-20T01:18:39.334Z RUNNING SqlQuery0
2020-08-20T01:18:40.174Z no activity
2020-08-20T01:18:55.274Z DONE SqlQuery0
==========================================================================================
Run started 2020-08-20T00:46:08.000Z and ran for PT1967.321S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 1442.8 6931.2 9200000
0001 *** not run ***
0002 1262.7 7919.7 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
==========================================================================================
Run started 2020-08-20T00:46:08.000Z and ran for PT1968.820S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 1442.8 6931.2 9200000
0001 *** not run ***
0002 1262.7 7919.7 83527
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:490)
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32m 56s
89 actionable tasks: 2 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/2ack5gx3m3wto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org