You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/13 13:24:07 UTC
Build failed in Jenkins:
beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 #568
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/568/display/redirect>
Changes:
------------------------------------------
[...truncated 684.20 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:19:04.273Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-13T13:19:04.273Z no activity
2021-10-13T13:19:19.330Z RUNNING Query7
2021-10-13T13:19:20.150Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:19:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:19:20.235Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-13T13:19:20.235Z no activity
2021-10-13T13:19:35.269Z RUNNING Query7
2021-10-13T13:19:35.953Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:19:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:19:36.008Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-13T13:19:36.008Z no activity
2021-10-13T13:19:51.042Z RUNNING Query7
2021-10-13T13:19:51.665Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:19:51 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T13:19:51.719Z WARNING: streaming query appears to have been stuck for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:19:51.719Z no activity
2021-10-13T13:20:06.753Z RUNNING Query7
2021-10-13T13:20:07.471Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:20:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T13:20:07.544Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-13T13:20:07.544Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:20:22.589Z RUNNING Query7
2021-10-13T13:20:23.320Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:20:23 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:20:23.389Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-13T13:20:23.389Z no activity
2021-10-13T13:20:38.426Z RUNNING Query7
2021-10-13T13:20:39.042Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:20:39 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:20:39.116Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-13T13:20:39.116Z no activity
2021-10-13T13:20:54.168Z RUNNING Query7
2021-10-13T13:20:54.756Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:20:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:20:54.811Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-13T13:20:54.811Z no activity
2021-10-13T13:21:09.846Z RUNNING Query7
2021-10-13T13:21:10.644Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:21:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T13:21:10.702Z WARNING: streaming query appears to have been stuck for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:21:10.702Z no activity
2021-10-13T13:21:25.735Z RUNNING Query7
2021-10-13T13:21:26.384Z sample of 78.8 sec not long enough to calculate steady-state event rate
Oct 13, 2021 1:21:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T13:21:26.433Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
2021-10-13T13:21:26.467Z no activity
2021-10-13T13:21:41.511Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:21:42.084Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:21:42.084Z no activity
2021-10-13T13:21:57.122Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:21:57.731Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:21:57.731Z no activity
2021-10-13T13:22:12.758Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:22:13.516Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:22:13.516Z no activity
2021-10-13T13:22:28.551Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:22:29.150Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:22:29.150Z no activity
2021-10-13T13:22:44.187Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:22:44.837Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:22:44.837Z no activity
2021-10-13T13:22:59.884Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:23:00.484Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:23:00.484Z no activity
2021-10-13T13:23:15.517Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:23:16.150Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:23:16.150Z no activity
2021-10-13T13:23:31.198Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:23:31.812Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:23:31.812Z no activity
2021-10-13T13:23:46.840Z RUNNING Query7 (waiting for shutdown)
2021-10-13T13:23:47.494Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-10-13T13:23:47.494Z no activity
2021-10-13T13:24:02.566Z CANCELLED Query7 (waiting for shutdown)
2021-10-13T13:24:02.595Z sample of 78.8 sec not long enough to calculate steady-state event rate
==========================================================================================
Run started 2021-10-13T12:12:00.565Z and ran for PT4322.030S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 39.2 210735.8 8267376
0001 28.5 296320.7 7762127
0002 17.9 409054.9 57031
0003 85.9 114626.9 58452
0004 *** not run ***
0005 391.6 24569.8 4420
0006 *** not run ***
0007 367.8 26901.3 99
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 126.5 76192.1 89650
0009 *** not run ***
0010 113.1 86665.9 100
0011 541.7 17654.0 1759376
0012 149.7 64268.6 351083
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-13T12:12:00.565Z and ran for PT4322.234S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 39.2 210735.8 8267376
0001 28.5 296320.7 7762127
0002 17.9 409054.9 57031
0003 85.9 114626.9 58452
0004 *** not run ***
0005 391.6 24569.8 4420
0006 *** not run ***
0007 367.8 26901.3 99
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 126.5 76192.1 89650
0009 *** not run ***
0010 113.1 86665.9 100
0011 541.7 17654.0 1759376
0012 149.7 64268.6 351083
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013121128
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d88a9b1ea207e9dacc73d9a536df40662456eadacc7c0086175ee7a65df927b
Deleted: sha256:c70f91ee83425a52677661a4fbff6b47a326fe282e44f330d305960ab657ccd4
Deleted: sha256:2e1443c707888de7d13b7f9df28661ab2ca564e84c39ade9678c08e39176ad54
Deleted: sha256:f05b711cba82f982d70fa0333a7eceea1528ebce523a99d82ce021dea353a142
Deleted: sha256:5930a642dc5c467b8681faf2e55aec9fb6db4af4a505b6c9a12a888317af27cc
Deleted: sha256:edaef490338685bc2bd280ed932de0653b5d62134217fecd0effcfa31d296c8a
Deleted: sha256:7671d7fce1fb0337cae840c1ee0725ab7583979b3e3f1d0ac5ed955b622317e4
Deleted: sha256:fb0e0ab00b127112509a6d6c48c22ce2e4cc12402b800c63c66164e49d5e4d44
Deleted: sha256:35c0575cd40a8ecce97a3d9e27ef2f3365921f4558b7895f82c03fc3d46d2420
Deleted: sha256:3f9d2c09ad23067ceea87e54cd57b73bd7f41d301e7fb32543568ea06e8c7b5d
Deleted: sha256:bfa70285092408dc03cac3d713f02642986ac457430b27bd0177a5d47a193b07
Deleted: sha256:df599e660f90a2182e289c4fc3fc06769043c2a143e3eeaf82a69a755d59ff54
Deleted: sha256:8376117ecb274351d8efef93b286f673d92f3443bbbb7d0ae8fec7ab302220f5
Deleted: sha256:10261300ec4d2ba5d366c767d5434f4e1bc512bfddde3bcdbb5e995642c64c28
Deleted: sha256:bac38c9971055aba20654aba503cc1e38650e1db5a290b2c6315ce8c37b7eb44
Deleted: sha256:6c69fca30b8ec693c9faa73bd505f2f8e3937a5e10928362a2efc21a40836a73
Deleted: sha256:aed9b71044dfd21d88f48ae0efd7c411877b657106bcf1fbb514ebe76a235070
Deleted: sha256:9d51538696e1f82ea675aad0ab78804226d0f7e55be79288594a058ca9329fe2
Deleted: sha256:372eb69133b5d3d8effc5a9ae7a2289e5710f0573e7fe76cb0e985949bda9018
Deleted: sha256:6535d79204218e54e8c219edf092f6b684e97214d9ff45cba2f8ba810d470230
Deleted: sha256:07305a5b925ecd9d7cd6b0c3f1541dbb89b2b2a3581c668646837cadf1b9fa0e
Deleted: sha256:a53fcb7439a27f80f602a8c33f031545edbf5ed77f4dc2463c28fe07853310ff
Deleted: sha256:5727675d1ec14cc743ab403ca37969d821277b47142c41a608fe9e70a1d5013f
Deleted: sha256:edfff533d7f99bb0bc8b4183369c2a45fe28f926c36e654154cd01bf8d300cf2
Deleted: sha256:3e7015ee55eea83ccd341b2149bb8712fac214e76d7c4c381af742af21c4b403
Deleted: sha256:1172ca0199e146feaa5fb26d977f7f6d5b2013de207084620a4dc0c49e4fab51
Deleted: sha256:7589aa8b49d6182c8b93751b4b508c6c5d9df160b57b910a02638d057c121a46
Deleted: sha256:67356b801c2d2c0adc72bac097d34a16d634a5ae2b7684f8b57125774dfcaedb
Deleted: sha256:ba09c337bba35d3a2a28a9b3d4c522b4541ac82bcaf1d2f3b7ee67f9997972ed
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013121128]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d88a9b1ea207e9dacc73d9a536df40662456eadacc7c0086175ee7a65df927b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013121128] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d88a9b1ea207e9dacc73d9a536df40662456eadacc7c0086175ee7a65df927b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d88a9b1ea207e9dacc73d9a536df40662456eadacc7c0086175ee7a65df927b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d88a9b1ea207e9dacc73d9a536df40662456eadacc7c0086175ee7a65df927b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4d88a9b1ea207e9dacc73d9a536df40662456eadacc7c0086175ee7a65df927b].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 12m 40s
123 actionable tasks: 11 executed, 112 up-to-date
Publishing build scan...
https://gradle.com/s/dz46fyeifloeg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 #570
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/570/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 #569
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/569/display/redirect?page=changes>
Changes:
[dmitrii_kuzin] [BEAM-12730] Custom delimiter always bytes
[noreply] Minor: Add base_func to Series.aggregate expression names (#15706)
[noreply] [BEAM-13013] Extend cross language expansion. (#15698)
[noreply] Minor: Clarify confusing boolean logic for selecting PerWindowInvoker
[noreply] [BEAM-4424] Execute hooks in enabling order (#15713)
------------------------------------------
[...truncated 665.50 KB...]
2021-10-13T19:15:38.987Z no activity
2021-10-13T19:15:54.080Z RUNNING Query7
2021-10-13T19:15:54.728Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:15:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T19:15:54.808Z WARNING: streaming query appears to have been stuck for 56 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:15:54.808Z no activity
2021-10-13T19:16:09.873Z RUNNING Query7
2021-10-13T19:16:10.572Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:16:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T19:16:10.627Z WARNING: streaming query appears to have been stuck for 56 min.
2021-10-13T19:16:10.627Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:16:25.663Z RUNNING Query7
2021-10-13T19:16:26.358Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:16:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:16:26.466Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-13T19:16:26.466Z no activity
2021-10-13T19:16:41.499Z RUNNING Query7
2021-10-13T19:16:42.252Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:16:42 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:16:42.308Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-13T19:16:42.308Z no activity
2021-10-13T19:16:57.369Z RUNNING Query7
2021-10-13T19:16:57.981Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:16:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:16:58.041Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-13T19:16:58.041Z no activity
2021-10-13T19:17:13.068Z RUNNING Query7
2021-10-13T19:17:13.681Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:17:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T19:17:13.736Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-13T19:17:13.736Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:17:28.782Z RUNNING Query7
2021-10-13T19:17:29.563Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:17:29 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:17:29.645Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-13T19:17:29.645Z no activity
2021-10-13T19:17:44.672Z RUNNING Query7
2021-10-13T19:17:45.322Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:17:45 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:17:45.394Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-13T19:17:45.395Z no activity
2021-10-13T19:18:00.429Z RUNNING Query7
2021-10-13T19:18:01.060Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:18:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:18:01.122Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-13T19:18:01.122Z no activity
2021-10-13T19:18:16.160Z RUNNING Query7
2021-10-13T19:18:16.924Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:18:16 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:18:16.981Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-13T19:18:16.981Z no activity
2021-10-13T19:18:32.014Z RUNNING Query7
2021-10-13T19:18:32.712Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:18:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:18:32.767Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-13T19:18:32.767Z no activity
2021-10-13T19:18:47.801Z RUNNING Query7
2021-10-13T19:18:48.411Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:18:48 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:18:48.481Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-13T19:18:48.481Z no activity
2021-10-13T19:19:03.514Z RUNNING Query7
2021-10-13T19:19:04.122Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:19:04 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-13T19:19:04.173Z WARNING: streaming query appears to have been stuck for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:19:04.173Z no activity
2021-10-13T19:19:19.229Z RUNNING Query7
2021-10-13T19:19:19.867Z sample of 31.4 sec not long enough to calculate steady-state event rate
Oct 13, 2021 7:19:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-13T19:19:19.939Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
2021-10-13T19:19:19.975Z no activity
2021-10-13T19:19:35.007Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:19:35.769Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:19:35.770Z no activity
2021-10-13T19:19:50.792Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:19:51.327Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:19:51.327Z no activity
2021-10-13T19:20:06.366Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:20:06.912Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:20:06.912Z no activity
2021-10-13T19:20:21.936Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:20:22.648Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:20:22.648Z no activity
2021-10-13T19:20:37.678Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:20:38.217Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:20:38.217Z no activity
2021-10-13T19:20:53.645Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:20:54.196Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:20:54.196Z no activity
2021-10-13T19:21:09.228Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:21:10.084Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:21:10.084Z no activity
2021-10-13T19:21:25.118Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:21:25.848Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:21:25.848Z no activity
2021-10-13T19:21:40.881Z RUNNING Query7 (waiting for shutdown)
2021-10-13T19:21:41.609Z sample of 31.4 sec not long enough to calculate steady-state event rate
2021-10-13T19:21:41.609Z no activity
2021-10-13T19:21:56.742Z CANCELLED Query7 (waiting for shutdown)
2021-10-13T19:21:56.780Z sample of 31.4 sec not long enough to calculate steady-state event rate
==========================================================================================
Run started 2021-10-13T18:11:14.911Z and ran for PT4241.870S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 31.5 238840.8 7518471
0001 36.2 186045.8 6200787
0002 18.3 449873.9 70636
0003 78.5 123125.8 57137
0004 *** not run ***
0005 378.0 25661.9 4492
0006 *** not run ***
0007 283.1 35179.0 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 111.2 89937.0 92833
0009 *** not run ***
0010 139.5 71667.6 100
0011 462.9 21516.4 1832305
0012 122.6 79275.1 262376
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-13T18:11:14.911Z and ran for PT4242.067S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 31.5 238840.8 7518471
0001 36.2 186045.8 6200787
0002 18.3 449873.9 70636
0003 78.5 123125.8 57137
0004 *** not run ***
0005 378.0 25661.9 4492
0006 *** not run ***
0007 283.1 35179.0 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 111.2 89937.0 92833
0009 *** not run ***
0010 139.5 71667.6 100
0011 462.9 21516.4 1832305
0012 122.6 79275.1 262376
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013181042
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113947b0fb20409fde740c6bb96fee66b753928b8740668a408f152218757d78
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013181042]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113947b0fb20409fde740c6bb96fee66b753928b8740668a408f152218757d78]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013181042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113947b0fb20409fde740c6bb96fee66b753928b8740668a408f152218757d78])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113947b0fb20409fde740c6bb96fee66b753928b8740668a408f152218757d78
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113947b0fb20409fde740c6bb96fee66b753928b8740668a408f152218757d78
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:113947b0fb20409fde740c6bb96fee66b753928b8740668a408f152218757d78].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 11m 20s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/rzxco62qxpxpa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org