You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/17 04:00:27 UTC
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 582 - Aborted!
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 582 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/582/ to view the results.
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Dataflow_V2 #587
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/587/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 586 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 586 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/586/ to view the results.
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#585
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/585/display/redirect>
Changes:
------------------------------------------
[...truncated 667.20 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:18:04.754Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-17T19:18:04.754Z no activity
2021-10-17T19:18:19.795Z RUNNING Query7
2021-10-17T19:18:20.475Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:18:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T19:18:20.534Z WARNING: streaming query appears to have been stuck for 57 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:18:20.534Z no activity
2021-10-17T19:18:35.560Z RUNNING Query7
2021-10-17T19:18:36.199Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:18:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:18:36.253Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-17T19:18:36.253Z no activity
2021-10-17T19:18:51.293Z RUNNING Query7
2021-10-17T19:18:51.913Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:18:51 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:18:51.970Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-17T19:18:51.970Z no activity
2021-10-17T19:19:06.999Z RUNNING Query7
2021-10-17T19:19:07.672Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:19:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T19:19:07.726Z WARNING: streaming query appears to have been stuck for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:19:07.726Z no activity
2021-10-17T19:19:22.759Z RUNNING Query7
2021-10-17T19:19:23.376Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:19:23 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:19:23.444Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T19:19:23.444Z no activity
2021-10-17T19:19:38.485Z RUNNING Query7
2021-10-17T19:19:39.053Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:19:39 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:19:39.113Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T19:19:39.113Z no activity
2021-10-17T19:19:54.164Z RUNNING Query7
2021-10-17T19:19:54.829Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:19:54 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T19:19:54.882Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T19:19:54.882Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:20:09.912Z RUNNING Query7
2021-10-17T19:20:10.527Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:20:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:20:10.574Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-17T19:20:10.574Z no activity
2021-10-17T19:20:25.606Z RUNNING Query7
2021-10-17T19:20:26.248Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:20:26 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:20:26.312Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-17T19:20:26.312Z no activity
2021-10-17T19:20:41.376Z RUNNING Query7
2021-10-17T19:20:42.100Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:20:42 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:20:42.153Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-17T19:20:42.153Z no activity
2021-10-17T19:20:57.182Z RUNNING Query7
2021-10-17T19:20:57.872Z sample of 62.3 sec not long enough to calculate steady-state event rate
Oct 17, 2021 7:20:57 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T19:20:57.940Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T19:20:57.988Z no activity
2021-10-17T19:21:13.020Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:21:13.686Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:21:13.686Z no activity
2021-10-17T19:21:28.719Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:21:29.265Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:21:29.266Z no activity
2021-10-17T19:21:44.294Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:21:44.859Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:21:44.860Z no activity
2021-10-17T19:21:59.891Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:22:00.498Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:22:00.498Z no activity
2021-10-17T19:22:15.539Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:22:16.206Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:22:16.207Z no activity
2021-10-17T19:22:31.252Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:22:31.860Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:22:31.860Z no activity
2021-10-17T19:22:46.902Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:22:47.583Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:22:47.583Z no activity
2021-10-17T19:23:02.618Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:23:03.235Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:23:03.235Z no activity
2021-10-17T19:23:18.266Z RUNNING Query7 (waiting for shutdown)
2021-10-17T19:23:18.895Z sample of 62.3 sec not long enough to calculate steady-state event rate
2021-10-17T19:23:18.895Z no activity
2021-10-17T19:23:33.931Z CANCELLED Query7 (waiting for shutdown)
2021-10-17T19:23:33.964Z sample of 62.3 sec not long enough to calculate steady-state event rate
==========================================================================================
Run started 2021-10-17T18:13:33.683Z and ran for PT4200.281S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 32.2 222409.9 7155148
0001 25.3 294873.0 6867470
0002 19.3 463873.9 72948
0003 76.1 125449.5 56511
0004 *** not run ***
0005 418.0 23923.2 4567
0006 *** not run ***
0007 266.5 34658.3 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 96.3 101186.3 90414
0009 *** not run ***
0010 86.8 104724.4 100
0011 507.6 19124.6 1785838
0012 124.5 78673.1 268578
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-17T18:13:33.683Z and ran for PT4200.590S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 32.2 222409.9 7155148
0001 25.3 294873.0 6867470
0002 19.3 463873.9 72948
0003 76.1 125449.5 56511
0004 *** not run ***
0005 418.0 23923.2 4567
0006 *** not run ***
0007 266.5 34658.3 100
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 96.3 101186.3 90414
0009 *** not run ***
0010 86.8 104724.4 100
0011 507.6 19124.6 1785838
0012 124.5 78673.1 268578
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017181256
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c615e9b2ba98c66445e37d3d42b448d7319434774569b01c898a2d4ea63664b
Deleted: sha256:6d5a51fe971009d47a206c322f7a1cf2917d699febefa283ccc8ccbb772f81b2
Deleted: sha256:785027806e94088ecc4cf1e82ecc152b4835b95351a828ffd3312c1783d2b1f2
Deleted: sha256:933ee6c6bc58a437addf59ccf6a0a52f45246e9be1f04c9a555731ad3e062f58
Deleted: sha256:2b9ccbe77ac1db928bb5eec01c44a1a0c150e5fb5fc401356933720a1a179686
Deleted: sha256:c32fe63d09878c69056a80d6bb134bf2de7e7d6e8153a6dfbbfeff805fb0a776
Deleted: sha256:481a2d39aedf817699d65d91ea9c3e9c9b55753c0dc444922d83a5bfd625cb37
Deleted: sha256:d1ddf8aece7ef429ed5f127f74a04aa163d77ed362e8bfac7f2270832f8239fe
Deleted: sha256:a6024c89e3f3255fa3f7ab0c71052dc89eddeb031626495fb61faf69df0341f6
Deleted: sha256:c17131b0e8189e1a06a5f089796d749c18db2ae4425552c76eebedd1cc73c304
Deleted: sha256:aa50d59f23b795efe79e396799b185c62462dfe477ab1eaefc994ec5ca600303
Deleted: sha256:e827d4c3ee5746aa82b2109afd33b38e931de556aef459eebaf5789e5d5e65a1
Deleted: sha256:d8822200a8e2b99c3707d48e0c16e243a7871dc24d0e4a828f6e106e0cae3b45
Deleted: sha256:518e995d450e0c37cd7b1ffbac32565b051f7aaaa52027733aa447513b02c965
Deleted: sha256:58e538df884c34b2b8326fd6a99d9899da65b4f02a29cb7fd07877dcfdb56c64
Deleted: sha256:4dccb0d466b27896df9db8ab7c3dd2ef53f9faaf4b2a57047f60f9fb1a5415b8
Deleted: sha256:96348fdd06b417796a614346649a3a3c73ee5c8e98e684eb7a4172c6252af0e2
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017181256]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c615e9b2ba98c66445e37d3d42b448d7319434774569b01c898a2d4ea63664b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017181256] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c615e9b2ba98c66445e37d3d42b448d7319434774569b01c898a2d4ea63664b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c615e9b2ba98c66445e37d3d42b448d7319434774569b01c898a2d4ea63664b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c615e9b2ba98c66445e37d3d42b448d7319434774569b01c898a2d4ea63664b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c615e9b2ba98c66445e37d3d42b448d7319434774569b01c898a2d4ea63664b].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 10m 43s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/3psdegpu6mlok
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 584 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 584 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/584/ to view the results.
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2
#583
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/583/display/redirect>
Changes:
------------------------------------------
[...truncated 658.73 KB...]
2021-10-17T07:19:23.399Z RUNNING Query7
2021-10-17T07:19:24.040Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:19:24 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:19:24.102Z WARNING: streaming query appears to have been stuck for 57 min.
2021-10-17T07:19:24.102Z no activity
2021-10-17T07:19:39.146Z RUNNING Query7
2021-10-17T07:19:39.813Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:19:39.923Z WARNING: streaming query appears to have been stuck for 57 min.
Oct 17, 2021 7:19:39 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:19:39.924Z no activity
2021-10-17T07:19:54.965Z RUNNING Query7
2021-10-17T07:19:55.612Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:19:55 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:19:55.672Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T07:19:55.673Z no activity
2021-10-17T07:20:10.712Z RUNNING Query7
2021-10-17T07:20:11.360Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:20:11 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:11.421Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T07:20:11.421Z no activity
2021-10-17T07:20:26.504Z RUNNING Query7
2021-10-17T07:20:27.145Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:20:27 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:27.193Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T07:20:27.193Z no activity
2021-10-17T07:20:42.260Z RUNNING Query7
2021-10-17T07:20:42.942Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:20:43 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:43.000Z WARNING: streaming query appears to have been stuck for 58 min.
2021-10-17T07:20:43.001Z no activity
2021-10-17T07:20:58.032Z RUNNING Query7
2021-10-17T07:20:58.707Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:20:58 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T07:20:58.760Z WARNING: streaming query appears to have been stuck for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:20:58.760Z no activity
2021-10-17T07:21:13.816Z RUNNING Query7
2021-10-17T07:21:14.428Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:21:14 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T07:21:14.494Z WARNING: streaming query appears to have been stuck for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:21:14.494Z no activity
2021-10-17T07:21:29.524Z RUNNING Query7
2021-10-17T07:21:30.110Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:21:30 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:21:30.189Z WARNING: streaming query appears to have been stuck for 59 min.
2021-10-17T07:21:30.189Z no activity
2021-10-17T07:21:45.234Z RUNNING Query7
2021-10-17T07:21:45.858Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:21:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T07:21:45.939Z WARNING: streaming query appears to have been stuck for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:21:45.939Z no activity
2021-10-17T07:22:00.977Z RUNNING Query7
2021-10-17T07:22:01.619Z 7 samples not enough to calculate steady-state event rate
Oct 17, 2021 7:22:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-10-17T07:22:01.677Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-10-17T07:22:01.716Z no activity
2021-10-17T07:22:16.754Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:22:17.341Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:22:17.341Z no activity
2021-10-17T07:22:32.394Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:22:33.018Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:22:33.018Z no activity
2021-10-17T07:22:48.053Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:22:48.707Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:22:48.707Z no activity
2021-10-17T07:23:03.772Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:05.113Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:23:05.113Z no activity
2021-10-17T07:23:20.180Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:20.839Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:23:20.839Z no activity
2021-10-17T07:23:35.888Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:36.600Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:23:36.600Z no activity
2021-10-17T07:23:51.667Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:23:52.317Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:23:52.318Z no activity
2021-10-17T07:24:07.347Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:24:07.977Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:24:07.977Z no activity
2021-10-17T07:24:23.028Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:24:23.686Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:24:23.686Z no activity
2021-10-17T07:24:38.716Z RUNNING Query7 (waiting for shutdown)
2021-10-17T07:24:39.306Z 7 samples not enough to calculate steady-state event rate
2021-10-17T07:24:39.306Z no activity
2021-10-17T07:24:54.349Z CANCELLED Query7 (waiting for shutdown)
2021-10-17T07:24:54.387Z 7 samples not enough to calculate steady-state event rate
==========================================================================================
Run started 2021-10-17T06:15:26.899Z and ran for PT4167.489S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 30.9 182245.2 5629009
0001 26.6 307747.4 7518417
0002 18.5 481252.7 68518
0003 73.0 131398.1 56865
0004 *** not run ***
0005 429.3 23262.5 4563
0006 *** not run ***
0007 171.5 57885.0 97
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 107.2 92679.0 92273
0009 *** not run ***
0010 94.7 105566.4 100
0011 365.0 26212.2 1761576
0012 140.3 70429.9 357543
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
==========================================================================================
Run started 2021-10-17T06:15:26.899Z and ran for PT4167.734S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; numEvents:10000000
0001 query:CURRENCY_CONVERSION; numEvents:10000000
0002 query:SELECTION; numEvents:10000000
0003 query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
0004 query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
0005 query:HOT_ITEMS; numEvents:10000000
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
0007 query:HIGHEST_BID; numEvents:10000000
0008 query:MONITOR_NEW_USERS; numEvents:10000000
0009 query:WINNING_BIDS; numEvents:1000000
0010 query:LOG_TO_SHARDED_FILES; numEvents:10000000
0011 query:USER_SESSIONS; numEvents:10000000
0012 query:PROCESSING_TIME_WINDOWS; numEvents:10000000
0013 query:PORTABILITY_BATCH; numEvents:10000000
0014 query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
0015 query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 30.9 182245.2 5629009
0001 26.6 307747.4 7518417
0002 18.5 481252.7 68518
0003 73.0 131398.1 56865
0004 *** not run ***
0005 429.3 23262.5 4563
0006 *** not run ***
0007 171.5 57885.0 97
*** Cancelling streaming job since it appeared stuck for 60 min. ***
0008 107.2 92679.0 92273
0009 *** not run ***
0010 94.7 105566.4 100
0011 365.0 26212.2 1761576
0012 140.3 70429.9 357543
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
==========================================================================================
Exception in thread "main" java.lang.RuntimeException: Execution was not successful
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)
> Task :sdks:java:testing:nexmark:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017061429
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db
Deleted: sha256:7c0eeed3d22c4045ca6c44030531098f75456044dca4e550c4b55482cec9bdce
Deleted: sha256:9ac0179a557668aac820dbc50dbd2b26a898b7eaa9d2dd81360d02d25412c82b
Deleted: sha256:d208046b292eca33c60925213dfb5145336eb36513ef9c58c7a120dc128def86
Deleted: sha256:4f83b15e586d0e7a3a5926a1d986a42761142e5f963a935cf1b8a857e6bfe99b
Deleted: sha256:4376199383f1523e7147b77a644abad3de9d37bab2c6ea959e56ed9eb1f67f0c
Deleted: sha256:fc612b4b0af09f196197846ebf27a4b64e4ecb70cde5fc8e8301c1d64dd4f448
Deleted: sha256:4cf0c268058f9f9a0fa0b71bf3de9f80c262d7513a94098266a4c7929f8386f4
Deleted: sha256:fe435ddd05d0406de44244a986279d7d2a9a1c5250919014b8bbd7fdd21f2251
Deleted: sha256:c25dcaf02202bd762760d663e82b0cc2cf2401131c8196eca8fee60b7aa254e9
Deleted: sha256:9b34e6d92ca847e961ccff3683d7bb08ebdee6f0470842ae8610475a0ed0178a
Deleted: sha256:c686c7eed035a3dbf9b782874fc80b275553152961d8b1af46a855664c8e5d15
Deleted: sha256:3d949cae1dc7cf0d7bbda44da98cde2c79807aead31204260c3fc63e4f3401e6
Deleted: sha256:d6dda41f59306fa0358494ac14192c42f4c42bce96ea635c605e79ffd3f8aea3
Deleted: sha256:5b1db67487de963e94750e8e5f1c82d1b3cc6d58f6b13cec33ddbf28689b5277
Deleted: sha256:2b441ad9b6a6db529c3a7fbec387e45ffa31a70074d183924f43851c512bcc6e
Deleted: sha256:6a7eba722e6fb65dd0a7e7f72883e162580e99c844286a3f0dafb3f0cc7048c4
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017061429]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211017061429] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:083e7a3f30660380ab40a414ed8d91e5ee50c4226176b796834dfc7aaf98d1db].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 10m 31s
123 actionable tasks: 10 executed, 113 up-to-date
Publishing build scan...
https://gradle.com/s/y3ughvg2xsgwa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org