You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/20 06:12:05 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#475
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/475/display/redirect>
Changes:
------------------------------------------
[...truncated 254.07 KB...]
2021-09-20T06:11:57.887Z DONE Query11
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT387.410S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 *** not run ***
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-20T06:11:57.981Z DONE Query10
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT387.498S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 52.9 189161.1 100
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
2021-09-20T06:11:58.237Z DONE Query5
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT387.752S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 29.0 344720.6 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 52.9 189161.1 100
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-20T06:05:30.512Z and ran for PT388.015S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 25.8 387702.1 10000000
0001 22.6 442067.1 9200000
0002 11.4 876577.8 83527
0003 *** not run ***
0004 *** not run ***
0005 29.0 344720.6 4567
0006 *** not run ***
0007 *** not run ***
0008 17.4 573624.7 92833
0009 *** not run ***
0010 52.9 189161.1 100
0011 37.1 269251.5 1839657
0012 15.9 630318.3 199929
0013 46.7 213912.9 10000000
0014 *** not run ***
0015 *** not run ***
==========================================================================================
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920060115
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:140a9e517c720fe78052ec02a9da2db3c16da749f2775b0bbd1514a0d0066b0f
Deleted: sha256:757d58197f308498a7403183a476fadd5162baa794b3163096e06c0d1ae7f6a8
Deleted: sha256:c8745bf1fed3420ad7a90c175daf7830c5e9e9137f8353f12587a0c149412060
Deleted: sha256:6d027d8511d72a5725855376a115fdf2b530460a40180dd3bdee828e82eada40
Deleted: sha256:bce0c4d4597747e85180fc03100852827478ecf6a2ebba9a3079011d47125ae0
Deleted: sha256:c652cc1ba356291953be2bd84ee46272465f4273a4391bf6af54a039c9cbae61
Deleted: sha256:55cb14213c97638ab44a22727cd6911149651b4cc282d32b5d2eb37beeab483e
Deleted: sha256:fff4d553c117043116d84008a293f609d1c24601af2f4e7adc92842842434ff1
Deleted: sha256:d8d0bb0f1e931d4e62e24f36193b7e4daf3381aba6a1667cbb9934d2f8800097
Deleted: sha256:935ecd7ebf8a8c5ffc5a75e8140cad0354d3ce9d6e418616afc6d7dbcf2593f2
Deleted: sha256:c7fac1db61c972aecdf43914ecec814981f1c76bd0739a494c1a50a6cf2061d7
Deleted: sha256:c8de20dc723fb2176763e2518d3f419b1adff57a0c8c97fcc32fb1b0059d71d1
Deleted: sha256:a1618da14a5fda290e7142de4bcb8881e9e9a31bcc2d44a010b044051f751653
Deleted: sha256:0d78a80f257743286aaede483109c3b2adc8de01a68f2f702ce59ef60df9873a
Deleted: sha256:cba783331a4c73db7f9a6115be927bdbce6e6930d7116f80d97b387bf547bf41
Deleted: sha256:038d3e887ca31575e13423587b140c2ab237feae9e4bfcdc70920ace0c221dc3
Deleted: sha256:6e0e40b4160877f739e352124615c1db239b8cfd70dd2e3b17d90b9794e2162c
Deleted: sha256:3c9299f80f8b001c3046bcc9c8c6c77bc7e56e83943abe2899a4e1155824f898
Deleted: sha256:21555f13b944653d2431749baa0b7ae19617c80e07cb7661a31141c25b89c45c
Deleted: sha256:7e53b9354688c78710c63aadd70ce773ee84e1324e9031c6e20e5e63a3fa78fe
Deleted: sha256:813a4b8f68d5b2d0b467d53a8ad2352e5943730ed33c8db9a94f4c5beb69852a
Deleted: sha256:cbab55babb91bba2e3f701b35268e72caaed3a5b94d3523679e82b25c4c75512
Deleted: sha256:cfc84d147b06dd070683410247f07b5b042d0a365a5dbad717b82b722dd3cd2a
Deleted: sha256:73d0407f24919e5e18976932ab874ad9a51196ea44947eee7b2b55701532a85b
Deleted: sha256:0dd4470c626aba03c5b85e9ae02166c1a1f8f171968cce1394f4b0babfe23a8d
Deleted: sha256:1078e41402a2ae768e1437d40cb3f5667e92b0c5ce2b5755d2d726e15a8d3a79
Deleted: sha256:f97e17c32fd3a85cfbe85095818843ba23b8cca2666b2607b48eb932b155a9c4
Deleted: sha256:a020c374d2b77456625110d9daeed7c6443fd1291786490aa40ac8d1f649ff79
Deleted: sha256:4ec013cc908833a45925646ed28e5688a798e6c8178c258b752d2abb9a401697
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920060115]
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 22s
128 actionable tasks: 89 executed, 37 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dfgkq7es7l2oy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow_V2 #482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/482/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 481 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 481 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/481/ to view the results.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 480 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 480 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/480/ to view the results.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 479 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 479 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/479/ to view the results.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 478 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 478 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/478/ to view the results.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 477 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 477 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/477/ to view the results.
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/476/display/redirect>
Changes:
------------------------------------------
[...truncated 672.78 KB...]
2021-09-20T13:15:58.057Z RUNNING Query7
2021-09-20T13:15:58.653Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:15:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-20T13:15:58.712Z WARNING: streaming query appears to have been stuck for 57 min.
2021-09-20T13:15:58.712Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:16:13.787Z RUNNING Query7
2021-09-20T13:16:14.421Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:16:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:16:14.515Z WARNING: streaming query appears to have been stuck for 57 min.
2021-09-20T13:16:14.516Z no activity
2021-09-20T13:16:29.550Z RUNNING Query7
2021-09-20T13:16:30.162Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:16:30 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:16:30.224Z WARNING: streaming query appears to have been stuck for 58 min.
2021-09-20T13:16:30.224Z no activity
2021-09-20T13:16:45.252Z RUNNING Query7
2021-09-20T13:16:45.888Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:16:45 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:16:45.960Z WARNING: streaming query appears to have been stuck for 58 min.
2021-09-20T13:16:45.960Z no activity
2021-09-20T13:17:00.996Z RUNNING Query7
2021-09-20T13:17:01.630Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:17:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:17:01.689Z WARNING: streaming query appears to have been stuck for 58 min.
2021-09-20T13:17:01.689Z no activity
2021-09-20T13:17:16.725Z RUNNING Query7
2021-09-20T13:17:17.429Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:17:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:17:17.482Z WARNING: streaming query appears to have been stuck for 58 min.
2021-09-20T13:17:17.482Z no activity
2021-09-20T13:17:32.541Z RUNNING Query7
2021-09-20T13:17:33.227Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:17:33 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:17:33.293Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-20T13:17:33.293Z no activity
2021-09-20T13:17:48.329Z RUNNING Query7
2021-09-20T13:17:49.070Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:17:49 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:17:49.120Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-20T13:17:49.120Z no activity
2021-09-20T13:18:04.152Z RUNNING Query7
2021-09-20T13:18:04.880Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:18:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:18:04.934Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-20T13:18:04.934Z no activity
2021-09-20T13:18:19.971Z RUNNING Query7
2021-09-20T13:18:20.613Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:18:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:18:20.666Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-20T13:18:20.666Z no activity
2021-09-20T13:18:35.705Z RUNNING Query7
2021-09-20T13:18:36.321Z 5 samples not enough to calculate steady-state event rate
Sep 20, 2021 1:18:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-20T13:18:36.385Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
2021-09-20T13:18:36.415Z no activity
2021-09-20T13:18:51.457Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:18:52.023Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:18:52.023Z no activity
2021-09-20T13:19:07.055Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:19:07.914Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:19:07.914Z no activity
2021-09-20T13:19:22.942Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:19:23.596Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:19:23.596Z no activity
2021-09-20T13:19:38.625Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:19:39.154Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:19:39.155Z no activity
2021-09-20T13:19:54.181Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:19:54.712Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:19:54.712Z no activity
2021-09-20T13:20:09.749Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:20:10.626Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:20:10.626Z no activity
2021-09-20T13:20:25.665Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:20:26.387Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:20:26.388Z no activity
2021-09-20T13:20:41.420Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:20:42.059Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:20:42.059Z no activity
2021-09-20T13:20:57.092Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:20:57.678Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:20:57.678Z no activity
2021-09-20T13:21:12.709Z RUNNING Query7 (waiting for shutdown)
2021-09-20T13:21:13.254Z 5 samples not enough to calculate steady-state event rate
2021-09-20T13:21:13.254Z no activity
2021-09-20T13:21:28.286Z CANCELLED Query7 (waiting for shutdown)
2021-09-20T13:21:28.320Z 5 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2021-09-20T12:12:07.434Z and ran for PT4160.887S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 35.1 222172.3 7796915
0001 27.7 332796.9 8466583
0002 20.6 454049.2 77984
0003 82.9 120590.9 59748
0004 *** not run ***
0005 441.8 22636.2 4567
0006 *** not run ***
0007 192.2 51634.9 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 130.6 76549.2 92833
0009 *** not run ***
0010 106.8 90882.5 100
0011 529.3 18727.8 1823652
0012 118.0 84129.7 253176
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-09-20T12:12:07.434Z and ran for PT4161.114S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 35.1 222172.3 7796915
0001 27.7 332796.9 8466583
0002 20.6 454049.2 77984
0003 82.9 120590.9 59748
0004 *** not run ***
0005 441.8 22636.2 4567
0006 *** not run ***
0007 192.2 51634.9 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 130.6 76549.2 92833
0009 *** not run ***
0010 106.8 90882.5 100
0011 529.3 18727.8 1823652
0012 118.0 84129.7 253176
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920121118
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e6dd1fcb3bb988531285f400dd802d52363586be2b74724063508cc331307f0
Deleted: sha256:30b2d83edfed1e4d616c9eca17c98c60285b18c182850df20b2399dea4a97f6d
Deleted: sha256:65d6661d5cc3acda771f91d348cb353de5ccaaf06d0058aa8462cbe109ad4474
Deleted: sha256:81af10c00354e681536de0719533b411cf97cd27669bf9552311c7b6232b0484
Deleted: sha256:8b7ad016d3b2caabe8d2ca6dbb5885ff25b92d9e50d2c0c8088e39d68314ae79
Deleted: sha256:7f8e5162687b5316bc79134bf7c20ec8d65cb5c1e01fc5dac620bc342f3efc7a
Deleted: sha256:2e7b1bfb272b5440a840daa6f6e34ea5abf935f010d9b4845334ed298442cb6e
Deleted: sha256:e40c5f37465e242a3bbd1df525c7f8624fb9423c0975f735cb79f59c7aceceef
Deleted: sha256:bdd8c3cf9facd5e8e201920bb108ed610fe88b17c2276d4e00fa8dda5db86eac
Deleted: sha256:d79c3ba36459699a9cbbf3d7953ba4e4b4a49a8e25507ec83b8e8012af4993a9
Deleted: sha256:6c48b35437d7e7cbe33a31c16cd353202779545844a48be25328ca5b298d2639
Deleted: sha256:ae4e4b9e4b64bc07ad7dc88a9ea992a17523b39b9d18e51f791b9856947ec882
Deleted: sha256:0716dbc6a98c9843e743e496aa7a8b2ded4d1e3147c6f93681049baf4a4efbd0
Deleted: sha256:62d4f7acd1c4c6513a27a43482b90fb1a556c771ed61c9f72273ecaac7f0e1c0
Deleted: sha256:0d43e341711caf66c107afb7b1feaa7d0b62d0269cecf373d71e9d08aa02dc6e
Deleted: sha256:474cea82c2b5e5e5c0df329a1511e9134a734e5834235870d4670892ce207eb7
Deleted: sha256:17222c6d5c808026fe1480d96dec882deb36c3ac2038beafc866d4f8ef79c07e
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920121118]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e6dd1fcb3bb988531285f400dd802d52363586be2b74724063508cc331307f0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210920121118] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e6dd1fcb3bb988531285f400dd802d52363586be2b74724063508cc331307f0])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e6dd1fcb3bb988531285f400dd802d52363586be2b74724063508cc331307f0
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e6dd1fcb3bb988531285f400dd802d52363586be2b74724063508cc331307f0
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:3e6dd1fcb3bb988531285f400dd802d52363586be2b74724063508cc331307f0].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 10m 16s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/2o77sj2sx34sw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org