You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/31 19:59:28 UTC

Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2 #397

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/397/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-12802] Refactor DataStreamsDecoder so that it becomes aware of the

[ajamato] [BEAM-11994] Instantiate a new ServiceCallMetric before each request to

[Ankur Goenka] Remove duplicate 2.33.0 section

[noreply] add python spark example in documentation (#15426)


------------------------------------------
[...truncated 676.04 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:53:19.836Z RUNNING Query7
2021-08-31T19:53:20.683Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:53:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:53:20.750Z WARNING: streaming query appears to have been stuck for 56 min.
2021-08-31T19:53:20.750Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:53:35.786Z RUNNING Query7
2021-08-31T19:53:36.601Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:53:36 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:53:36.684Z WARNING: streaming query appears to have been stuck for 56 min.
2021-08-31T19:53:36.685Z no activity
2021-08-31T19:53:51.717Z RUNNING Query7
2021-08-31T19:53:52.382Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:53:52 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:53:52.463Z WARNING: streaming query appears to have been stuck for 57 min.
2021-08-31T19:53:52.463Z no activity
2021-08-31T19:54:07.552Z RUNNING Query7
2021-08-31T19:54:08.339Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:54:08 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:54:08.440Z WARNING: streaming query appears to have been stuck for 57 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:54:08.440Z no activity
2021-08-31T19:54:23.475Z RUNNING Query7
2021-08-31T19:54:24.171Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:54:24 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:54:24.250Z WARNING: streaming query appears to have been stuck for 57 min.
2021-08-31T19:54:24.251Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:54:39.306Z RUNNING Query7
2021-08-31T19:54:40.030Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:54:40 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:54:40.103Z WARNING: streaming query appears to have been stuck for 58 min.
2021-08-31T19:54:40.103Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:54:55.135Z RUNNING Query7
2021-08-31T19:54:55.881Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:54:55 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:54:55.968Z WARNING: streaming query appears to have been stuck for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:54:55.968Z no activity
2021-08-31T19:55:11.015Z RUNNING Query7
2021-08-31T19:55:11.794Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:55:11 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:55:11.857Z WARNING: streaming query appears to have been stuck for 58 min.
2021-08-31T19:55:11.857Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:55:26.891Z RUNNING Query7
2021-08-31T19:55:27.535Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:55:27 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:55:27.593Z WARNING: streaming query appears to have been stuck for 58 min.
2021-08-31T19:55:27.593Z no activity
2021-08-31T19:55:42.634Z RUNNING Query7
2021-08-31T19:55:43.302Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:55:43 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:55:43.365Z WARNING: streaming query appears to have been stuck for 59 min.
2021-08-31T19:55:43.365Z no activity
2021-08-31T19:55:58.410Z RUNNING Query7
2021-08-31T19:55:59.139Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:55:59 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:55:59.198Z WARNING: streaming query appears to have been stuck for 59 min.
2021-08-31T19:55:59.198Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:56:14.235Z RUNNING Query7
2021-08-31T19:56:14.915Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:56:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:56:14.993Z WARNING: streaming query appears to have been stuck for 59 min.
2021-08-31T19:56:14.993Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:56:30.025Z RUNNING Query7
2021-08-31T19:56:30.619Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:56:30 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:56:30.686Z WARNING: streaming query appears to have been stuck for 59 min.
2021-08-31T19:56:30.686Z no activity
2021-08-31T19:56:45.722Z RUNNING Query7
2021-08-31T19:56:46.427Z 7 samples not enough to calculate steady-state event rate
Aug 31, 2021 7:56:46 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-08-31T19:56:46.490Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-08-31T19:56:46.548Z no activity
2021-08-31T19:57:01.610Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:57:02.377Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:57:02.377Z no activity
2021-08-31T19:57:17.429Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:57:18.097Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:57:18.097Z no activity
2021-08-31T19:57:33.133Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:57:33.784Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:57:33.784Z no activity
2021-08-31T19:57:48.838Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:57:49.461Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:57:49.461Z no activity
2021-08-31T19:58:04.498Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:58:05.179Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:58:05.180Z no activity
2021-08-31T19:58:20.236Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:58:20.934Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:58:20.934Z no activity
2021-08-31T19:58:35.972Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:58:36.673Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:58:36.673Z no activity
2021-08-31T19:58:51.716Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:58:52.347Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:58:52.347Z no activity
2021-08-31T19:59:07.456Z RUNNING Query7 (waiting for shutdown)
2021-08-31T19:59:08.194Z 7 samples not enough to calculate steady-state event rate
2021-08-31T19:59:08.194Z no activity
2021-08-31T19:59:23.237Z CANCELLED Query7 (waiting for shutdown)
2021-08-31T19:59:23.272Z 7 samples not enough to calculate steady-state event rate

==========================================================================================
Run started 2021-08-31T18:48:59.985Z and ran for PT4223.288S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          37.2                    208104.9                     7739836              
  0001          29.3                    261096.3                     7047644              
  0002          21.6                    410837.7                       72609              
  0003          80.2                    124722.5                       59507              
  0004  *** not run ***
  0005         595.7                     16785.6                        4567              
  0006  *** not run ***
  0007         266.8                     36771.5                         100              
        *** Cancelling streaming job since it appeared stuck for 60 min. ***
  0008         119.0                     81986.4                       90599              
  0009  *** not run ***
  0010         145.9                     67887.1                         100              
  0011         552.5                     18098.6                     1839657              
  0012         132.5                     75464.9                      270538              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================


==========================================================================================
Run started 2021-08-31T18:48:59.985Z and ran for PT4223.529S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          37.2                    208104.9                     7739836              
  0001          29.3                    261096.3                     7047644              
  0002          21.6                    410837.7                       72609              
  0003          80.2                    124722.5                       59507              
  0004  *** not run ***
  0005         595.7                     16785.6                        4567              
  0006  *** not run ***
  0007         266.8                     36771.5                         100              
        *** Cancelling streaming job since it appeared stuck for 60 min. ***
  0008         119.0                     81986.4                       90599              
  0009  *** not run ***
  0010         145.9                     67887.1                         100              
  0011         552.5                     18098.6                     1839657              
  0012         132.5                     75464.9                      270538              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================

Exception in thread "main" java.lang.RuntimeException: Execution was not successful
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
	at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)

> Task :sdks:java:testing:nexmark:run FAILED

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210831184809
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cf211ccf99bff284fcba873e3bb798644fb5429bcea5253768631c9bf9a8125
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210831184809]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cf211ccf99bff284fcba873e3bb798644fb5429bcea5253768631c9bf9a8125]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210831184809] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cf211ccf99bff284fcba873e3bb798644fb5429bcea5253768631c9bf9a8125])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cf211ccf99bff284fcba873e3bb798644fb5429bcea5253768631c9bf9a8125
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cf211ccf99bff284fcba873e3bb798644fb5429bcea5253768631c9bf9a8125
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7cf211ccf99bff284fcba873e3bb798644fb5429bcea5253768631c9bf9a8125].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 11m 22s
123 actionable tasks: 10 executed, 113 up-to-date

Publishing build scan...
https://gradle.com/s/alk7jhcsxb3uc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Dataflow_V2 #399

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/399/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 398 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 398 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/398/ to view the results.