You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/07/22 04:00:25 UTC

beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 234 - Aborted!

beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 234 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/234/ to view the results.

Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Dataflow_V2 #236

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/236/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2 #235

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/235/display/redirect?page=changes>

Changes:

[noreply] Default to Runner v2 for Python Streaming jobs. (#15140)

[ankurgoenka] Moving to 2.33.0-SNAPSHOT on master branch.


------------------------------------------
[...truncated 805.89 KB...]
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:38:29.493Z WARNING: streaming query appears to have been stuck for 57 min.
2021-07-22T07:38:29.493Z no activity
2021-07-22T07:38:44.533Z RUNNING Query7
2021-07-22T07:38:45.205Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:38:45 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:38:45.286Z WARNING: streaming query appears to have been stuck for 58 min.
2021-07-22T07:38:45.286Z no activity
2021-07-22T07:39:00.322Z RUNNING Query7
2021-07-22T07:39:00.958Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:39:01 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:39:01.017Z WARNING: streaming query appears to have been stuck for 58 min.
2021-07-22T07:39:01.017Z no activity
2021-07-22T07:39:16.058Z RUNNING Query7
2021-07-22T07:39:16.761Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:39:16 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-07-22T07:39:16.819Z WARNING: streaming query appears to have been stuck for 58 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:39:16.819Z no activity
2021-07-22T07:39:31.874Z RUNNING Query7
2021-07-22T07:39:32.512Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:39:32 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-07-22T07:39:32.602Z WARNING: streaming query appears to have been stuck for 58 min.
2021-07-22T07:39:32.602Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:39:47.634Z RUNNING Query7
2021-07-22T07:39:48.272Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:39:48 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-07-22T07:39:48.328Z WARNING: streaming query appears to have been stuck for 59 min.
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:39:48.328Z no activity
2021-07-22T07:40:03.366Z RUNNING Query7
2021-07-22T07:40:04.035Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:40:04 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-07-22T07:40:04.099Z WARNING: streaming query appears to have been stuck for 59 min.
2021-07-22T07:40:04.099Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:40:19.139Z RUNNING Query7
2021-07-22T07:40:19.822Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:40:19 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-07-22T07:40:19.879Z WARNING: streaming query appears to have been stuck for 59 min.
2021-07-22T07:40:19.879Z no activity
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:40:34.930Z RUNNING Query7
2021-07-22T07:40:35.885Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:40:35 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:40:35.969Z WARNING: streaming query appears to have been stuck for 59 min.
2021-07-22T07:40:35.970Z no activity
2021-07-22T07:40:51.001Z RUNNING Query7
2021-07-22T07:40:51.647Z sample of 78.8 sec not long enough to calculate steady-state event rate
Jul 22, 2021 7:40:51 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query7
2021-07-22T07:40:51.713Z ERROR: streaming query appears to have been stuck for 60 minutes, cancelling job.
2021-07-22T07:40:51.747Z no activity
2021-07-22T07:41:06.798Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:41:07.447Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:41:07.448Z no activity
2021-07-22T07:41:22.476Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:41:23.123Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:41:23.123Z no activity
2021-07-22T07:41:38.153Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:41:38.824Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:41:38.824Z no activity
2021-07-22T07:41:53.857Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:41:54.472Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:41:54.472Z no activity
2021-07-22T07:42:09.499Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:42:10.064Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:42:10.064Z no activity
2021-07-22T07:42:25.088Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:42:25.633Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:42:25.633Z no activity
2021-07-22T07:42:40.665Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:42:41.182Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:42:41.182Z no activity
2021-07-22T07:42:56.214Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:42:56.794Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:42:56.794Z no activity
2021-07-22T07:43:11.828Z RUNNING Query7 (waiting for shutdown)
2021-07-22T07:43:12.429Z sample of 78.8 sec not long enough to calculate steady-state event rate
2021-07-22T07:43:12.429Z no activity
2021-07-22T07:43:27.462Z CANCELLED Query7 (waiting for shutdown)
2021-07-22T07:43:27.489Z sample of 78.8 sec not long enough to calculate steady-state event rate

==========================================================================================
Run started 2021-07-22T06:29:55.794Z and ran for PT4411.696S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          34.8                    244286.9                     8499962              
  0001          31.6                    279935.9                     8130789              
  0002          18.4                    499714.0                       72474              
  0003          81.6                    122505.5                       59507              
  0004  *** not run ***
  0005         681.4                     14675.0                        4567              
  0006  *** not run ***
  0007         399.7                     24972.7                          98              
        *** Cancelling streaming job since it appeared stuck for 60 min. ***
  0008         115.0                     86926.3                       92833              
  0009  *** not run ***
  0010         142.3                     69447.0                         100              
  0011         420.5                     23780.6                     1839657              
  0012         133.2                     74426.8                      277242              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================


==========================================================================================
Run started 2021-07-22T06:29:55.794Z and ran for PT4411.903S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          34.8                    244286.9                     8499962              
  0001          31.6                    279935.9                     8130789              
  0002          18.4                    499714.0                       72474              
  0003          81.6                    122505.5                       59507              
  0004  *** not run ***
  0005         681.4                     14675.0                        4567              
  0006  *** not run ***
  0007         399.7                     24972.7                          98              
        *** Cancelling streaming job since it appeared stuck for 60 min. ***
  0008         115.0                     86926.3                       92833              
  0009  *** not run ***
  0010         142.3                     69447.0                         100              
  0011         420.5                     23780.6                     1839657              
  0012         133.2                     74426.8                      277242              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================

Exception in thread "main" java.lang.RuntimeException: Execution was not successful
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:186)
	at org.apache.beam.sdk.nexmark.Main.main(Main.java:495)

> Task :sdks:java:testing:nexmark:run FAILED

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210722062757
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:576b469f803020921ffccef1733b13c4d085d440216f8b2e883a921b3d7dba15
Deleted: sha256:fcf166dd6398f8a419036a9649ff0ac98004d103cef8c7d19c1f93386c7873a3
Deleted: sha256:ef09587b1fcbab5e296f6b1b18b2ae94a36e4c54395792b1af0a18b08f34d849
Deleted: sha256:d0f51f5b6c3886fe9775972b757a2a4bb845605e7430a636dc80b6f3e64a4673
Deleted: sha256:1143efed16cc788128b99085cacde585125b3caf48b5304ff3ddfc58f82a32b4
Deleted: sha256:8a329d347d2a8c7b3366056654600757fda7b67a21549f19c972e75676dd010f
Deleted: sha256:45e141b3e723d818c6459b87797a33e15443cef8dc7739a337e3110f189de5d1
Deleted: sha256:4871ed7e5b6485d3ac8713c4cb85b8a9c4f1a1b86f9f719ade7b1eceedbb8e45
Deleted: sha256:41470c1bcd53a3c6a32d07c7008a9c709993cb7b599a3d78f579dd9185b25fa5
Deleted: sha256:34f55008ace5fa963188a6b92476349860ea2e20166d14fc8ca5b349f78a06cf
Deleted: sha256:478c3c45ac28a9cfb965990a4d49b333358d17b03ff90228f7efa73ee24d24fa
Deleted: sha256:4f058bb0fa4f0af22d873cc253ef7ffd37cdc7d572c34bd931ae2c80c38ab5da
Deleted: sha256:6383371f4bcb23b5a97c0c2c8b2e93bcafa0468ffa277ef598b8241739eedb3a
Deleted: sha256:b2f1bfa4b3d4ff70e99019f8ca3171a5f003c0b2614dd5723700c816982142b3
Deleted: sha256:cd49c64a62d38adede001acf9d0877279060a182ecc5380d5b88973e443ce37a
Deleted: sha256:4fd276bedb24453304da3d499bc147e25ff6e54062bf774631452dfd7ec3ce1f
Deleted: sha256:b988e08fca43093a0f60e5bf3b24d8052a5579184d7c4c972c7e7e06dc8e53c3
Deleted: sha256:e70ac8f4591ad10819c5bfee97990ef3e94c10613b7cfb1c44f5e87a1aba0ec2
Deleted: sha256:45437dda1afd8451e9e3887e0056009b7075086339492d1b722b4f2f8b5a9a9b
Deleted: sha256:39d24a4486446ff5db15421384235b8253a87ff07c26b612055c4105706b227f
Deleted: sha256:d4b0489ef95a2cfb0c0d40bfe3930b906f51bb6721cc276e5489df0b38f6fdb5
Deleted: sha256:eabc2f590ad0d69bafc5c2fa7ba5a484c521b05246cb73f529607c870d06417d
Deleted: sha256:e29b202770fbe16605a77f0f65ee7becd9430196fb3482e0062d21e719813740
Deleted: sha256:791b76978d5cd7e583a1114a6cc509efaf1b2bd8e1c2447140e2920a0a15c0f1
Deleted: sha256:4a1f4a261e3f4d25152fa10dde9199bf3293a9d0cb240d81bc25831692a07866
Deleted: sha256:bfe81124a226f3f50fa75929eded896396b80905f2e7547e2bbbf1dfd1788fd1
Deleted: sha256:2bbbb8f4c65ecb77fb915faa3d47529d9e58fb4f3e27fd6f0578b985abec7d59
Deleted: sha256:97a59cd3052efea42c5358eab33f692e3b2eacf43ada9e794a7a8952d83b6031
Deleted: sha256:84fcac1fa9a243dc6b009cfc83769e1a3e3f9d5fc3d5ecc2f90544a2107c3e9c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:576b469f803020921ffccef1733b13c4d085d440216f8b2e883a921b3d7dba15
  Associated tags:
 - 20210722062757
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210722062757
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210722062757].
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:576b469f803020921ffccef1733b13c4d085d440216f8b2e883a921b3d7dba15].

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 15m 44s
129 actionable tasks: 15 executed, 114 up-to-date

Publishing build scan...
https://gradle.com/s/6x5nxfhfhstro

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org