You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/07/25 14:11:02 UTC

Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow #8971

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/8971/display/redirect>

Changes:


------------------------------------------
[...truncated 1.43 MB...]
Run started 2022-07-25T14:06:11.822Z and ran for PT221.320S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:RESHUFFLE; exportSummaryToBigQuery:true; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000  *** not run ***
  0001  *** not run ***
  0002  *** not run ***
  0003          57.0                    175472.5                        9054              
  0004  *** not run ***
  0005  *** not run ***
  0006  *** not run ***
  0007  *** not run ***
  0008  *** not run ***
  0009  *** not run ***
  0010  *** not run ***
  0011  *** not run ***
  0012  *** not run ***
  0013  *** not run ***
  0014  *** not run ***
  0015          -1.0                        -1.0                          -1              
        *** Job was unexpectedly updated ***
  0016  *** not run ***
==========================================================================================

Jul 25, 2022 2:10:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-25T14:10:03.488Z: Autoscaling: Resized **** pool from 4 to 0.
Jul 25, 2022 2:10:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-25T14:10:03.587Z: Worker pool stopped.
Jul 25, 2022 2:10:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-25T14:10:05.891Z: Finished operation SqlQuery0.ReadBounded+SqlQuery0/SqlQuery0.Monitor+SqlQuery0/SqlQuery0.Snoop+SqlQuery0/SqlQuery0/Filter/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.SelectEvent/ParDo(Anonymous)+SqlQuery0/SqlQuery0/SqlQuery0.Serialize+SqlQuery0/SqlQuery0/SqlTransform/BeamZetaSqlCalcRel_117/ParDo(Calc)+SqlQuery0/SqlQuery0/Convert.ConvertTransform/ParDo(Anonymous)+SqlQuery0/SqlQuery0.Debug+SqlQuery0/SqlQuery0.Stamp+SqlQuery0.Format+SqlQuery0.DevNull
Jul 25, 2022 2:10:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-25T14:10:06.039Z: Cleaning up.
Jul 25, 2022 2:10:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-07-25T14:10:06.105Z: Stopping **** pool...
Jul 25, 2022 2:10:11 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-07-25_07_06_30-13906548914184761957 finished with status DONE.
2022-07-25T14:10:11.234Z Waiting for main pipeline to 'finish'
2022-07-25T14:10:11.234Z DONE ZetaSqlQuery2

==========================================================================================
Run started 2022-07-25T14:06:11.822Z and ran for PT239.472S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:RESHUFFLE; exportSummaryToBigQuery:true; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000  *** not run ***
  0001  *** not run ***
  0002          69.7                    143404.1                       83527              
  0003          57.0                    175472.5                        9054              
  0004  *** not run ***
  0005  *** not run ***
  0006  *** not run ***
  0007  *** not run ***
  0008  *** not run ***
  0009  *** not run ***
  0010  *** not run ***
  0011  *** not run ***
  0012  *** not run ***
  0013  *** not run ***
  0014  *** not run ***
  0015          -1.0                        -1.0                          -1              
        *** Job was unexpectedly updated ***
  0016  *** not run ***
==========================================================================================

Jul 25, 2022 2:10:28 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2022-07-25T14:10:28.396Z Waiting for main pipeline to 'finish'
2022-07-25T14:10:28.421Z RUNNING SqlQuery0
2022-07-25T14:10:29.283Z new perf {"snapshots":null,"runtimeSec":115.827,"numEvents":10000000,"eventsPerSec":86335.65576247334,"eventBytesPerSec":1.1081741709618656E7,"numResults":9200000,"resultsPerSec":79428.80330147548,"resultBytesPerSec":7982547.644331632,"startupDelaySec":-138.376,"processingDelaySec":0.614,"shutdownDelaySec":22.549,"timeDilation":8.633133897968522,"errors":null,"jobId":null}
2022-07-25T14:10:44.317Z RUNNING SqlQuery0
2022-07-25T14:10:45.074Z no activity
2022-07-25T14:11:00.114Z DONE SqlQuery0

==========================================================================================
Run started 2022-07-25T14:06:11.822Z and ran for PT288.331S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:RESHUFFLE; exportSummaryToBigQuery:true; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000         115.8                     86335.7                     9200000              
  0001  *** not run ***
  0002          69.7                    143404.1                       83527              
  0003          57.0                    175472.5                        9054              
  0004  *** not run ***
  0005  *** not run ***
  0006  *** not run ***
  0007  *** not run ***
  0008  *** not run ***
  0009  *** not run ***
  0010  *** not run ***
  0011  *** not run ***
  0012  *** not run ***
  0013  *** not run ***
  0014  *** not run ***
  0015          -1.0                        -1.0                          -1              
        *** Job was unexpectedly updated ***
  0016  *** not run ***
==========================================================================================


==========================================================================================
Run started 2022-07-25T14:06:11.822Z and ran for PT288.590S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000
  0002  query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000
  0013  query:PORTABILITY_BATCH; exportSummaryToBigQuery:true; numEvents:10000000
  0014  query:RESHUFFLE; exportSummaryToBigQuery:true; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000         115.8                     86335.7                     9200000              
  0001  *** not run ***
  0002          69.7                    143404.1                       83527              
  0003          57.0                    175472.5                        9054              
  0004  *** not run ***
  0005  *** not run ***
  0006  *** not run ***
  0007  *** not run ***
  0008  *** not run ***
  0009  *** not run ***
  0010  *** not run ***
  0011  *** not run ***
  0012  *** not run ***
  0013  *** not run ***
  0014  *** not run ***
  0015          -1.0                        -1.0                          -1              
        *** Job was unexpectedly updated ***
  0016  *** not run ***
==========================================================================================

Exception in thread "main" java.lang.RuntimeException: Execution was not successful
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:176)
	at org.apache.beam.sdk.nexmark.Main.main(Main.java:467)

> Task :sdks:java:testing:nexmark:run FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 54s
126 actionable tasks: 2 executed, 124 up-to-date

Publishing build scan...
https://gradle.com/s/hngc6pzvjhh2s

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Dataflow #8972

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/8972/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org