You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/29 16:00:30 UTC

beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 - Build # 512 - Aborted!

beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 - Build # 512 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/512/ to view the results.

Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 #515

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/515/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 - Build # 514 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 - Build # 514 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/514/ to view the results.

Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11 #513

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java11/513/display/redirect?page=changes>

Changes:

[samuelw] [BEAM-12942] Validate pubsub messages before they are published in

[clairem] [BEAM-12628] make useReflectApi default to true

[noreply] [BEAM-12856] Change hard-coded limits for reading from a UnboundedReader


------------------------------------------
[...truncated 670.44 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:49:05.335Z RUNNING Query7
2021-09-29T19:49:06.038Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:49:06 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:49:06.113Z WARNING: streaming query appears to have been stuck for 56 min.
2021-09-29T19:49:06.113Z no activity
2021-09-29T19:49:21.141Z RUNNING Query7
2021-09-29T19:49:21.713Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:49:21 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:49:21.771Z WARNING: streaming query appears to have been stuck for 56 min.
2021-09-29T19:49:21.771Z no activity
2021-09-29T19:49:36.813Z RUNNING Query7
2021-09-29T19:49:37.423Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:49:37 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:49:37.475Z WARNING: streaming query appears to have been stuck for 57 min.
2021-09-29T19:49:37.475Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:49:52.509Z RUNNING Query7
2021-09-29T19:49:53.107Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:49:53 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:49:53.193Z WARNING: streaming query appears to have been stuck for 57 min.
2021-09-29T19:49:53.193Z no activity
2021-09-29T19:50:08.224Z RUNNING Query7
2021-09-29T19:50:08.735Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:50:08 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:50:08.789Z WARNING: streaming query appears to have been stuck for 57 min.
2021-09-29T19:50:08.789Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:50:23.818Z RUNNING Query7
2021-09-29T19:50:24.406Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:50:24 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:50:24.474Z WARNING: streaming query appears to have been stuck for 57 min.
2021-09-29T19:50:24.474Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:50:39.505Z RUNNING Query7
2021-09-29T19:50:40.110Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:50:40 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:50:40.177Z WARNING: streaming query appears to have been stuck for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:50:40.177Z no activity
2021-09-29T19:50:55.203Z RUNNING Query7
2021-09-29T19:50:55.804Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:50:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:50:55.857Z WARNING: streaming query appears to have been stuck for 58 min.
2021-09-29T19:50:55.857Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:51:10.896Z RUNNING Query7
2021-09-29T19:51:11.470Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:51:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:51:11.521Z WARNING: streaming query appears to have been stuck for 58 min.
2021-09-29T19:51:11.521Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:51:26.555Z RUNNING Query7
2021-09-29T19:51:27.272Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:51:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:51:27.358Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-29T19:51:27.358Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:51:42.388Z RUNNING Query7
2021-09-29T19:51:43.098Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:51:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:51:43.174Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-29T19:51:43.174Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:51:58.203Z RUNNING Query7
2021-09-29T19:51:58.827Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:51:58 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:51:58.893Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-29T19:51:58.893Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:52:13.924Z RUNNING Query7
2021-09-29T19:52:14.590Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:52:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-09-29T19:52:14.643Z WARNING: streaming query appears to have been stuck for 59 min.
2021-09-29T19:52:14.643Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:52:29.697Z RUNNING Query7
2021-09-29T19:52:30.369Z sample of 62.8 sec not long enough to calculate steady-state event rate
Sep 29, 2021 7:52:30 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-09-29T19:52:30.448Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
2021-09-29T19:52:30.502Z no activity
2021-09-29T19:52:45.531Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:52:46.145Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:52:46.145Z no activity
2021-09-29T19:53:01.176Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:53:01.844Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:53:01.844Z no activity
2021-09-29T19:53:16.873Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:53:17.653Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:53:17.653Z no activity
2021-09-29T19:53:32.690Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:53:33.229Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:53:33.229Z no activity
2021-09-29T19:53:48.258Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:53:48.861Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:53:48.861Z no activity
2021-09-29T19:54:03.897Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:54:04.488Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:54:04.488Z no activity
2021-09-29T19:54:19.516Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:54:20.098Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:54:20.098Z no activity
2021-09-29T19:54:35.132Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:54:35.725Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:54:35.725Z no activity
2021-09-29T19:54:50.757Z RUNNING Query7 (waiting for shutdown)
2021-09-29T19:54:51.383Z sample of 62.8 sec not long enough to calculate steady-state event rate
2021-09-29T19:54:51.383Z no activity
2021-09-29T19:55:06.422Z CANCELLED Query7 (waiting for shutdown)
2021-09-29T19:55:06.463Z sample of 62.8 sec not long enough to calculate steady-state event rate

==========================================================================================
Run started 2021-09-29T18:42:59.081Z and ran for PT4327.382S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          42.4                    200461.8                     8507196              
  0001          28.9                    310733.2                     8269745              
  0002          20.5                    469838.0                       79287              
  0003          81.4                    122896.9                       59507              
  0004  *** not run ***
  0005         452.1                     21928.2                        4524              
  0006  *** not run ***
  0007         316.1                     31313.8                         100              
        *** Cancelling streaming job since it appeared stuck for 60 min. ***
  0008         105.5                     92941.2                       90992              
  0009  *** not run ***
  0010         110.6                     90414.3                         100              
  0011         462.3                     21633.3                     1839657              
  0012         145.8                     68575.8                      302982              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================


==========================================================================================
Run started 2021-09-29T18:42:59.081Z and ran for PT4327.577S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          42.4                    200461.8                     8507196              
  0001          28.9                    310733.2                     8269745              
  0002          20.5                    469838.0                       79287              
  0003          81.4                    122896.9                       59507              
  0004  *** not run ***
  0005         452.1                     21928.2                        4524              
  0006  *** not run ***
  0007         316.1                     31313.8                         100              
        *** Cancelling streaming job since it appeared stuck for 60 min. ***
  0008         105.5                     92941.2                       90992              
  0009  *** not run ***
  0010         110.6                     90414.3                         100              
  0011         462.3                     21633.3                     1839657              
  0012         145.8                     68575.8                      302982              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================

Exception in thread "main" java.lang.RuntimeException: Execution was not successful
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
	at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)

> Task :sdks:java:testing:nexmark:run FAILED

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210929184121
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6daf6c8ca47883bb19b0e907c64fc16af80e4659848dc193466cb8401eeae605
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210929184121]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6daf6c8ca47883bb19b0e907c64fc16af80e4659848dc193466cb8401eeae605]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210929184121] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6daf6c8ca47883bb19b0e907c64fc16af80e4659848dc193466cb8401eeae605])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6daf6c8ca47883bb19b0e907c64fc16af80e4659848dc193466cb8401eeae605
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6daf6c8ca47883bb19b0e907c64fc16af80e4659848dc193466cb8401eeae605
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6daf6c8ca47883bb19b0e907c64fc16af80e4659848dc193466cb8401eeae605].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 14m 9s
123 actionable tasks: 10 executed, 113 up-to-date

Publishing build scan...
https://gradle.com/s/jcu4vitanwqdy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org