You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/09 00:13:04 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#430
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/430/display/redirect?page=changes>
Changes:
[noreply] Add display data for JdbcIO.write (#15460)
------------------------------------------
[...truncated 238.97 KB...]
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-09T00:11:54.005Z RUNNING Query10
2021-09-09T00:11:54.458Z no activity
2021-09-09T00:11:54.865Z no activity
2021-09-09T00:12:09.565Z DONE Query13
==========================================================================================
Run started 2021-09-09T00:06:11.589Z and ran for PT358.004S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 17.9 557165.1 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 *** not run ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 46.1 216750.5 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-09T00:12:09.904Z RUNNING Query10
2021-09-09T00:12:10.833Z no activity
2021-09-09T00:12:25.861Z RUNNING Query10
2021-09-09T00:12:27.266Z no activity
2021-09-09T00:12:42.320Z RUNNING Query10
2021-09-09T00:12:43.305Z no activity
2021-09-09T00:12:58.412Z DONE Query10
==========================================================================================
Run started 2021-09-09T00:06:11.589Z and ran for PT406.960S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 17.9 557165.1 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 83.8 119327.5 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 46.1 216750.5 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-09T00:06:11.589Z and ran for PT407.378S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 17.9 557165.1 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 83.8 119327.5 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 46.1 216750.5 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909000125
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e898726764aba4cb37a4e8b2db54e2d88670ebc2ab309d4d68549f1f20a6e2eb
Deleted: sha256:bc81e1c498d189cab4f4c8acb10e26c716e858739bdbc5687a3fd55680010f22
Deleted: sha256:a0fd4e79a52b9961171774854434a9958474e79b6276ebdae495e83a164c1f12
Deleted: sha256:6a87547fe08ec09f481594da1af27af0160e24d38fc08dff743d32fea2d9a06d
Deleted: sha256:a51f09b6870c12df7e621e8fd2bc917f0a0607f8189f6016c9ed1710ea0040bf
Deleted: sha256:3e91ceda8fc6cfcde622c839b8d81b46cbdb45cb5ad671df1df17ead4aa7de4f
Deleted: sha256:7d64b6cf51f087099af20ed9dc0abef71e5c8252ebdf1d2d9f70a73ac4689046
Deleted: sha256:60aebea114bb7f30bd71b8c22f2b3e35592a059544d37607b413d692df1cc3b8
Deleted: sha256:854f2dae5ca3205063de5bfa78f27f5e64b530ce4c9f8524811b0c006521e3b9
Deleted: sha256:06c7fa0b451b6322ea6e912dd65e772cd7aa3aa35af20055443fb917dbe522ae
Deleted: sha256:087d0b98a9ee37b4c8ac8edffc3e6d48a72bb9c1347ea6c6d3b3a05936d6070a
Deleted: sha256:cd1f7e8b7686cab852c45526493c798d0da98b081e112a27c31738a0fc6fd82d
Deleted: sha256:4e1f0b16e6dee5a6225b11b097b2c953a3f68aebac0ae4c5c533b3135e61803d
Deleted: sha256:c4e9bb9a19e48ae301590c5eb1090dd88e6f518ccd24eb551ba79f51861013a6
Deleted: sha256:0e7d864969c94d04a566a9113fbe1f82dab7d9385d99ee40181ef64e4337803d
Deleted: sha256:d596ea109f2a97c3bc258c4b426ace3df606885a34f8a3feb49d51a3c09302d9
Deleted: sha256:d3a6689b8ab770fe049e44bfcf30589f7127213576df6482b304f7b461643180
Deleted: sha256:7a2f50cd7e744ee0e68684097cffc7e63a22523c87f5531dbcee61dd73dfe495
Deleted: sha256:2f41b26f7955bbbbdf053931a47a352464dcb4a6d42077e002bd8ef9140ce36e
Deleted: sha256:b31a196dd198fcd7cabd5d2b6db7bb93238d58efabaa66858b652629605e9897
Deleted: sha256:197bdd1074b3b1b5e7fcab07a3ea80f0214b9a868b53e08ba1b9899b98536aac
Deleted: sha256:84a8a81bb1f86171477af104f8815500455baabf8cba8081ad159538f792f052
Deleted: sha256:826ed2bc74b78eb2e13b19c11cbd7cf182ffbc77d13be327c3fbd1ed416fbb82
Deleted: sha256:294ca7fc0cdee56786055762fb078b856d4d0a8fd33103851955f19db45336ca
Deleted: sha256:c3c6721bfbfd0e5eb53e2f3b32d6af5f3868cb8eecef23acd567e15fbf62a08e
Deleted: sha256:c90d886cb0d37344f463b397b29a847f676513756a4da2ed388da62a7795915f
Deleted: sha256:daea9cdf5f000b127efb5c5c0d2b28ada955e259d9f7d6908478d0b0baf4b1cd
Deleted: sha256:703cf56c9cede0e187588179596aa697f51775cba3e10b309804e699f2d77bc3
Deleted: sha256:06df760c0d49519e95a040f79d83e9abe150e23558416d84224d588d9b9c0dc0
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909000125]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 22s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/72edmun5dzbwk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow_V2 #438
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/438/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#437
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/437/display/redirect?page=changes>
Changes:
[noreply] Added type annotations to some combiners missing it. (#15414)
[noreply] [BEAM-12634] JmsIO auto scaling feature (#15464)
[noreply] [BEAM-12662] Get Flink version from cluster. (#15223)
------------------------------------------
[...truncated 2.43 MB...]
Sep 10, 2021 7:19:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query12.Events
Sep 10, 2021 7:19:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query12.Events
Sep 10, 2021 7:19:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query12.Results
Sep 10, 2021 7:19:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query12.Results
2021-09-10T19:19:19.306Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2021-09-10T18:13:44.707Z and ran for PT3934.599S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 *** not run ***
0002 20.9 446101.9 77864
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 423.9 23588.7 4567
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-10T19:19:26.653Z CANCELLED Query1 (waiting for shutdown)
Sep 10, 2021 7:19:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query1.Events
Sep 10, 2021 7:19:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query1.Events
Sep 10, 2021 7:19:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query1.Results
Sep 10, 2021 7:19:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query1.Results
2021-09-10T19:19:26.674Z 0 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2021-09-10T18:13:44.707Z and ran for PT3941.967S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 20.9 446101.9 77864
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 423.9 23588.7 4567
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-10T18:13:44.707Z and ran for PT3942.245S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0001 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0002 20.9 446101.9 77864
0003 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0004 *** not run ***
0005 423.9 23588.7 4567
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0011 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0012 -1.0 -1.0 -1
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910181229
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abf181cd5bf11d4ab7718808e75785782b18255ba66876eaca262d8882dddfc1
Deleted: sha256:136501528a656289af7e5aa705b7ad79ecfc85e9b80532e5b2954fb8fbae1344
Deleted: sha256:03fe320d77df9717c54e37d02c19ea196f72f01613af0864e7783b685ef3df9e
Deleted: sha256:147c511d087f3bafe6a05bbbdc52f60e58a3cde5f9750de0ff9af60c62da3f72
Deleted: sha256:02641c5a85074c4adf1707e85b2c28612221424db50d44874d10d8833b01ae51
Deleted: sha256:b27acfcd4f4864791774db2cc8296c966062655ff7db1149e02db77937711749
Deleted: sha256:ab5d1bc09202d3beeb70798c06def48ab641cb994ec7315ce6ad5e1501fed914
Deleted: sha256:afc8bd48d31f108f7d4a668e19fbe9ba65fb84c4f89ff3d443b91f15b8c73976
Deleted: sha256:6b1e73049f4f5d796a380c80b86ef931c2ea7c3e246a5bfbb0f4d2a8188f1a13
Deleted: sha256:6892b5e1430d27f6d78b4f26d9779f68843e80d522c54aad71af8b7588f8aeed
Deleted: sha256:25cb0979c7c2f05b1634c3486b938b42e2e8f5a6d7e8ab2c704c27cbc3d5d9f7
Deleted: sha256:a2302800c950ab67bfd0ef7d40f53c14d7098f68566d094e7d4d32704d5cbafc
Deleted: sha256:e8da6f650a3f454cfa4995a6c73da7cb623aa9d0471ee2f1bcf9307ab976bc7e
Deleted: sha256:33623b1429d0a2044ada7df75c9c16a4218c1bfee0971821c7e2f03dc1564985
Deleted: sha256:f195b397f5eb723b035786dc8d9c53109b4de5332a66c7ceb25801a41724a661
Deleted: sha256:ae6ed1a185a8f5b8a69dffc0b41a8ca803ec78be1ec94ec8961813cd053b2645
Deleted: sha256:358ace1a9bee2c00f6448f538459b130778790afddb5f8c020e57d17798f878a
Deleted: sha256:0dc9a56731545ee59f37b2249d9638c785599e6bed63f74d6c625ce9e8951a70
Deleted: sha256:926c7d9ea60e93e4c3915d7d2318e0814ebe91c35257df8bbabb37d2b430d0cd
Deleted: sha256:58c5213535f20cb2ccdfe0d0585136c465ca47f337d648e496f3befb63a41808
Deleted: sha256:9165fec8bcabe19084d5cfcd2572b0d959a33b3187d8dfbc3159902731a502cb
Deleted: sha256:9ea435cf85898e7e6096c3a6cb3412374163ce2105178380ea8980d7193a576f
Deleted: sha256:760afe8e83bce4c496e548f175a5662c039a3ebf017edde1a85d89eb769a5de1
Deleted: sha256:58c8f57911c9e34edd4bdb71b796a02ca029b5a4390bfc4014645065d1ebd762
Deleted: sha256:233133ce56d8d95cfdd35cdd49511dee1502f57b51bc759aeb9123cae116ced0
Deleted: sha256:2156a10c8a131e39d71a25d4febf6e9044edd7a5431fbbecad9d4ce219a32da1
Deleted: sha256:c0521886233831e3628e77b8b36744ae66368d86088be7039e56382b6fa9e211
Deleted: sha256:43b2a21360f99834d806fe2017b2122faa7a829fd02206e9dcfea7a9ef438b16
Deleted: sha256:a3dc78fe6732407042535bb831b2648fc3bb894b667c7406ca75f8ea46372f87
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910181229]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abf181cd5bf11d4ab7718808e75785782b18255ba66876eaca262d8882dddfc1]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910181229] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abf181cd5bf11d4ab7718808e75785782b18255ba66876eaca262d8882dddfc1])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abf181cd5bf11d4ab7718808e75785782b18255ba66876eaca262d8882dddfc1
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abf181cd5bf11d4ab7718808e75785782b18255ba66876eaca262d8882dddfc1
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:abf181cd5bf11d4ab7718808e75785782b18255ba66876eaca262d8882dddfc1].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 7m 5s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/i4ictbycqztzo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 436 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 436 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/436/ to view the results.
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#435
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/435/display/redirect?page=changes>
Changes:
[ruwan.lambrichts] Clarify additional_bq_parameters argument
[esert] Bump a throttling counter on BigQueryRead retries due to
[noreply] [BEAM-5097] Increment counter for "small words" in go SDK example
------------------------------------------
[...truncated 453.40 KB...]
2021-09-10T06:28:52.313Z no activity
2021-09-10T06:29:07.351Z RUNNING Query1
Sep 10, 2021 6:29:07 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.elements, from namespace Query1.Events
Sep 10, 2021 6:29:07 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric event.bytes, from namespace Query1.Events
Sep 10, 2021 6:29:07 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.elements, from namespace Query1.Results
Sep 10, 2021 6:29:07 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric result.bytes, from namespace Query1.Results
2021-09-10T06:29:07.909Z 0 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:29:07 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-10T06:29:07.976Z no activity
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:29:23.004Z RUNNING Query1
2021-09-10T06:29:23.733Z 1 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:29:23 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:29:23.784Z new perf {"snapshots":null,"runtimeSec":4.504,"numEvents":52470,"eventsPerSec":11649.644760213145,"eventBytesPerSec":1502188.7211367674,"numResults":48176,"resultsPerSec":10696.269982238011,"resultBytesPerSec":1074932.7264653642,"startupDelaySec":208.63,"processingDelaySec":0.834,"shutdownDelaySec":8.246,"timeDilation":7.004884547069272,"errors":null,"jobId":null}
2021-09-10T06:29:38.820Z RUNNING Query1
2021-09-10T06:29:39.544Z 2 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:29:39 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:29:39.591Z new perf {"snapshots":null,"runtimeSec":22.745,"numEvents":3379338,"eventsPerSec":148574.98351285997,"eventBytesPerSec":1.9072517432402726E7,"numResults":3108804,"resultsPerSec":136680.76500329742,"resultBytesPerSec":1.3736301604748296E7,"startupDelaySec":208.63,"processingDelaySec":0.834,"shutdownDelaySec":5.813,"timeDilation":43.96350846339855,"errors":null,"jobId":null}
2021-09-10T06:29:54.632Z RUNNING Query1
2021-09-10T06:29:55.351Z 3 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:29:55 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:29:55.426Z new perf {"snapshots":null,"runtimeSec":34.105,"numEvents":6321240,"eventsPerSec":185346.43014220792,"eventBytesPerSec":2.3790568362410206E7,"numResults":5815431,"resultsPerSec":170515.49626154525,"resultBytesPerSec":1.713669203929043E7,"startupDelaySec":208.63,"processingDelaySec":0.834,"shutdownDelaySec":10.26,"timeDilation":29.319747837560477,"errors":null,"jobId":null}
2021-09-10T06:30:10.486Z RUNNING Query1
2021-09-10T06:30:11.025Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:30:11 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:30:11.141Z new perf {"snapshots":null,"runtimeSec":37.612,"numEvents":6992281,"eventsPerSec":185905.58864192278,"eventBytesPerSec":2.3862092364139102E7,"numResults":6432812,"resultsPerSec":171030.84122088694,"resultBytesPerSec":1.7188427629479952E7,"startupDelaySec":208.63,"processingDelaySec":0.834,"shutdownDelaySec":22.589,"timeDilation":26.585930022333297,"errors":null,"jobId":null}
2021-09-10T06:30:26.199Z RUNNING Query1
2021-09-10T06:30:27.252Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:30:27 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:30:27.337Z no activity
2021-09-10T06:30:42.429Z RUNNING Query1
2021-09-10T06:30:43.253Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:30:43 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:30:43.326Z no activity
2021-09-10T06:30:58.355Z RUNNING Query1
2021-09-10T06:30:58.979Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:30:59 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:30:59.024Z no activity
2021-09-10T06:31:14.116Z RUNNING Query1
2021-09-10T06:31:14.926Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:31:15 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-10T06:31:15.014Z no activity
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:31:30.052Z RUNNING Query1
2021-09-10T06:31:30.785Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:31:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:31:30.859Z no activity
2021-09-10T06:31:45.893Z RUNNING Query1
2021-09-10T06:31:46.794Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:31:46 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:31:46.842Z no activity
2021-09-10T06:32:01.879Z RUNNING Query1
2021-09-10T06:32:02.719Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:32:02 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:32:02.801Z no activity
2021-09-10T06:32:17.845Z RUNNING Query1
2021-09-10T06:32:18.576Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:32:18 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-10T06:32:18.629Z no activity
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:32:33.744Z RUNNING Query1
2021-09-10T06:32:34.440Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:32:34 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:32:34.511Z no activity
2021-09-10T06:32:49.547Z RUNNING Query1
2021-09-10T06:32:50.165Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:32:50 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:32:50.308Z no activity
2021-09-10T06:33:05.473Z RUNNING Query1
2021-09-10T06:33:06.047Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:33:06 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:33:06.096Z no activity
2021-09-10T06:33:21.140Z RUNNING Query1
2021-09-10T06:33:21.819Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:33:21 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-10T06:33:21.873Z no activity
2021-09-10T06:33:36.965Z DONE Query1
2021-09-10T06:33:37.017Z 4 samples not enough to calculate steady-state event rate
Sep 10, 2021 6:33:37 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
==========================================================================================
Run started 2021-09-10T06:21:23.395Z and ran for PT733.623S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 37.6 185905.6 6432812
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-10T06:21:23.395Z and ran for PT733.845S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 37.6 185905.6 6432812
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910062044
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ee27400a437760f59f61f0511d53caf815aa6e57a3d3575b2fec7cbc960cf6f
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910062044]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ee27400a437760f59f61f0511d53caf815aa6e57a3d3575b2fec7cbc960cf6f]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910062044] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ee27400a437760f59f61f0511d53caf815aa6e57a3d3575b2fec7cbc960cf6f])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ee27400a437760f59f61f0511d53caf815aa6e57a3d3575b2fec7cbc960cf6f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ee27400a437760f59f61f0511d53caf815aa6e57a3d3575b2fec7cbc960cf6f
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4ee27400a437760f59f61f0511d53caf815aa6e57a3d3575b2fec7cbc960cf6f].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 59s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/vekvjbqkk6txg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#434
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/434/display/redirect?page=changes>
Changes:
[noreply] Fix broken 'differences from pandas' link
[noreply] Added GroupBy row in Aggregation table.
[Luke Cwik] [BEAM-12769] Fix typo in test class name, CLass -> Class
[Etienne Chauchot] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a
[samuelw] [BEAM-12740] Remove matching to filter files when renaming gcs files in
[noreply] [BEAM-3304] Helper functions for triggers (#15430)
------------------------------------------
[...truncated 246.18 KB...]
INFO: 2021-09-10T00:20:12.952Z: Cleaning up.
Sep 10, 2021 12:20:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-10T00:20:13.075Z: Stopping **** pool...
Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-10T00:20:44.573Z: Finished operation Query13/Query13/GroupByKey/Read+Query13/Query13/ExpandIterable/ParMultiDo(Anonymous)+Query13/Query13/Query13.Serialize/ParMultiDo(Anonymous)+Query13/Query13.Debug/ParMultiDo(Monitor)+Query13/Query13.Stamp/ParMultiDo(Anonymous)+Query13.Format/ParMultiDo(Anonymous)+Query13.DevNull/ParMultiDo(Anonymous)
Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-10T00:20:44.932Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/19498 instances, 2/0 CPUs, 25/249166 disk GB, 0/2397 SSD disk GB, 1/264 instance groups, 1/267 managed instance groups, 1/493 instance templates, 1/727 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-10T00:20:44.974Z: Cleaning up.
Sep 10, 2021 12:20:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-10T00:20:45.074Z: Stopping **** pool...
Sep 10, 2021 12:21:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
2021-09-10T00:21:24.041Z Waiting for main pipeline to 'finish'
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2021-09-10T00:21:24.078Z RUNNING Query2
Sep 10, 2021 12:21:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2021-09-10T00:21:24.526Z Waiting for main pipeline to 'finish'
2021-09-10T00:21:24.650Z RUNNING Query13
2021-09-10T00:21:25.457Z new perf {"snapshots":null,"runtimeSec":19.975,"numEvents":10000000,"eventsPerSec":500625.7822277847,"eventBytesPerSec":6.425856806007509E7,"numResults":83527,"resultsPerSec":4181.576971214017,"resultBytesPerSec":66905.23153942428,"startupDelaySec":-93.347,"processingDelaySec":0.358,"shutdownDelaySec":73.372,"timeDilation":50.0595744680851,"errors":null,"jobId":null}
2021-09-10T00:21:26.300Z new perf {"snapshots":null,"runtimeSec":68.439,"numEvents":10000000,"eventsPerSec":146115.5189292655,"eventBytesPerSec":1.875487510045442E7,"numResults":10000000,"resultsPerSec":146115.5189292655,"resultBytesPerSec":1.875487510045442E7,"startupDelaySec":-108.432,"processingDelaySec":31.213,"shutdownDelaySec":39.993,"timeDilation":-1.0,"errors":null,"jobId":null}
2021-09-10T00:21:40.508Z RUNNING Query2
2021-09-10T00:21:41.384Z RUNNING Query13
2021-09-10T00:21:41.606Z no activity
2021-09-10T00:21:42.432Z no activity
2021-09-10T00:21:56.684Z RUNNING Query2
2021-09-10T00:21:57.596Z RUNNING Query13
2021-09-10T00:21:57.835Z no activity
2021-09-10T00:21:58.296Z no activity
2021-09-10T00:22:13.052Z RUNNING Query2
2021-09-10T00:22:13.371Z RUNNING Query13
2021-09-10T00:22:13.961Z no activity
2021-09-10T00:22:14.386Z no activity
2021-09-10T00:22:28.991Z RUNNING Query2
2021-09-10T00:22:29.428Z RUNNING Query13
2021-09-10T00:22:30.179Z no activity
2021-09-10T00:22:30.295Z no activity
2021-09-10T00:22:45.280Z DONE Query2
2021-09-10T00:22:45.352Z RUNNING Query13
==========================================================================================
Run started 2021-09-10T00:16:24.114Z and ran for PT381.299S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 20.0 500625.8 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-10T00:22:46.269Z no activity
2021-09-10T00:23:01.324Z RUNNING Query13
2021-09-10T00:23:02.108Z no activity
2021-09-10T00:23:17.196Z RUNNING Query13
2021-09-10T00:23:18.658Z no activity
2021-09-10T00:23:33.709Z RUNNING Query13
2021-09-10T00:23:34.718Z no activity
2021-09-10T00:23:49.765Z DONE Query13
==========================================================================================
Run started 2021-09-10T00:16:24.114Z and ran for PT445.696S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 20.0 500625.8 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 68.4 146115.5 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-10T00:16:24.114Z and ran for PT446.044S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0002 20.0 500625.8 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 68.4 146115.5 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000124
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000124]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000124] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d21dfaa8e2670cf601b05d36193560f9d15ad044d6941a51125965f23d7ef776].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 23m 20s
128 actionable tasks: 96 executed, 30 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ork4xsexfrrhg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#433
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/433/display/redirect?page=changes>
Changes:
[kawaigin] [BEAM-10708] Support streaming cache in beam_sql magic
------------------------------------------
[...truncated 234.96 KB...]
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 *** not run ***
0002 9.0 1110370.9 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 *** not run ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-09T18:11:16.378Z RUNNING Query10
2021-09-09T18:11:16.723Z no activity
2021-09-09T18:11:17.091Z no activity
2021-09-09T18:11:31.774Z RUNNING Query1
2021-09-09T18:11:32.234Z RUNNING Query10
2021-09-09T18:11:33.160Z no activity
2021-09-09T18:11:33.345Z no activity
2021-09-09T18:11:48.232Z DONE Query1
==========================================================================================
Run started 2021-09-09T18:05:37.262Z and ran for PT371.007S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 46.7 214201.6 9200000
0002 9.0 1110370.9 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 *** not run ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-09T18:11:48.429Z RUNNING Query10
2021-09-09T18:11:49.310Z no activity
2021-09-09T18:12:04.392Z DONE Query10
==========================================================================================
Run started 2021-09-09T18:05:37.262Z and ran for PT387.172S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 46.7 214201.6 9200000
0002 9.0 1110370.9 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 65.7 152139.8 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-09T18:05:37.262Z and ran for PT387.552S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 46.7 214201.6 9200000
0002 9.0 1110370.9 83527
0003 *** not run ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 *** not run ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 65.7 152139.8 100
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909180126
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3548dd6cb125259a21891d11371f04fffa6c78cf39899fcde98b1fe2681392d9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909180126]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3548dd6cb125259a21891d11371f04fffa6c78cf39899fcde98b1fe2681392d9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909180126] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3548dd6cb125259a21891d11371f04fffa6c78cf39899fcde98b1fe2681392d9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3548dd6cb125259a21891d11371f04fffa6c78cf39899fcde98b1fe2681392d9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3548dd6cb125259a21891d11371f04fffa6c78cf39899fcde98b1fe2681392d9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3548dd6cb125259a21891d11371f04fffa6c78cf39899fcde98b1fe2681392d9].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 30s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/b5j4g3sz3i5qk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#432
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/432/display/redirect>
Changes:
------------------------------------------
[...truncated 438.28 KB...]
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 *** not run ***
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Sep 09, 2021 12:13:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:13:42.619Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Sep 09, 2021 12:14:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:14:02.454Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
Sep 09, 2021 12:14:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:14:02.483Z: Resized **** pool to 1, though goal was 4. This could be a quota issue.
Sep 09, 2021 12:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:14:12.758Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate.
Sep 09, 2021 12:14:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:14:40.482Z: Workers have started successfully.
Sep 09, 2021 12:14:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:14:40.514Z: Workers have started successfully.
Sep 09, 2021 12:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-09T12:16:30.747Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/19467 instances, 2/0 CPUs, 30/259716 disk GB, 0/2397 SSD disk GB, 1/227 instance groups, 1/230 managed instance groups, 1/454 instance templates, 1/696 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 09, 2021 12:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:16:31.827Z: Cleaning up.
Sep 09, 2021 12:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:16:31.914Z: Stopping **** pool...
Sep 09, 2021 12:16:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-09T12:16:31.995Z: Stopping **** pool...
2021-09-09T12:17:12.381Z Waiting for main pipeline to 'finish'
Sep 09, 2021 12:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
2021-09-09T12:17:12.439Z RUNNING Query1
2021-09-09T12:17:13.265Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:17:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:17:13.384Z new perf {"snapshots":null,"runtimeSec":27.769,"numEvents":7634241,"eventsPerSec":274919.5505779827,"eventBytesPerSec":3.528868201951817E7,"numResults":7023452,"resultsPerSec":252924.19604595055,"resultBytesPerSec":2.5418959667254854E7,"startupDelaySec":-95.037,"processingDelaySec":1.011,"shutdownDelaySec":67.268,"timeDilation":36.009579026972524,"errors":null,"jobId":null}
2021-09-09T12:17:28.453Z RUNNING Query1
2021-09-09T12:17:29.077Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:17:29 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:17:29.127Z no activity
2021-09-09T12:17:44.165Z RUNNING Query1
2021-09-09T12:17:44.835Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:17:44 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:17:44.884Z no activity
2021-09-09T12:17:59.922Z RUNNING Query1
2021-09-09T12:18:00.645Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:18:00 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:18:00.701Z no activity
2021-09-09T12:18:15.802Z RUNNING Query1
2021-09-09T12:18:16.574Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:18:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:18:16.672Z no activity
2021-09-09T12:18:31.728Z RUNNING Query1
2021-09-09T12:18:32.393Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:18:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:18:32.515Z no activity
2021-09-09T12:18:47.590Z RUNNING Query1
2021-09-09T12:18:48.192Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:18:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
2021-09-09T12:18:48.246Z no activity
2021-09-09T12:19:03.305Z DONE Query1
2021-09-09T12:19:03.418Z 1 samples not enough to calculate steady-state event rate
Sep 09, 2021 12:19:03 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query1
==========================================================================================
Run started 2021-09-09T12:12:35.440Z and ran for PT387.978S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 27.8 274919.6 7023452
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-09T12:12:35.440Z and ran for PT388.257S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0001 27.8 274919.6 7023452
0002 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0003 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0004 *** not run ***
0005 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0006 *** not run ***
0007 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0008 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0009 *** not run ***
0010 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0011 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0012 -1.0 -1.0 -1
*** Job was unexpectedly updated ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909121142
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af9bab61aabf871b6639b4c4e04a27212ab0bd7cdaf4917b57130eeaac8580cd
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909121142]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af9bab61aabf871b6639b4c4e04a27212ab0bd7cdaf4917b57130eeaac8580cd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909121142] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af9bab61aabf871b6639b4c4e04a27212ab0bd7cdaf4917b57130eeaac8580cd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af9bab61aabf871b6639b4c4e04a27212ab0bd7cdaf4917b57130eeaac8580cd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af9bab61aabf871b6639b4c4e04a27212ab0bd7cdaf4917b57130eeaac8580cd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:af9bab61aabf871b6639b4c4e04a27212ab0bd7cdaf4917b57130eeaac8580cd].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 28s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/al5db2detbpfw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 431 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 431 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/431/ to view the results.