You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/01/20 18:27:03 UTC

Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2 #965

See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/965/display/redirect?page=changes>

Changes:

[Pablo Estrada] Revert "Merge pull request #15863 from [BEAM-13184] Autosharding for

[Pablo Estrada] BEAM-13611 reactivating jdbcio xlang test

[noreply] Merge pull request #16371 from [BEAM-13518][Playground] Beam Playground

[noreply] Update Java FnAPI beam master (#16572)


------------------------------------------
[...truncated 617.02 KB...]
2022-01-20T18:24:00.194Z RUNNING Query11
2022-01-20T18:24:00.205Z RUNNING Query5 (waiting for shutdown)
2022-01-20T18:24:01.061Z 8 samples not enough to calculate steady-state event rate
2022-01-20T18:24:01.061Z no activity
2022-01-20T18:24:01.062Z 5 samples not enough to calculate steady-state event rate
Jan 20, 2022 6:24:01 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2022-01-20T18:24:01.186Z no activity
SEVERE: Failed to get metric fatal, from namespace Query11
2022-01-20T18:24:16.097Z RUNNING Query5 (waiting for shutdown)
2022-01-20T18:24:16.224Z RUNNING Query11
2022-01-20T18:24:16.871Z 8 samples not enough to calculate steady-state event rate
2022-01-20T18:24:16.872Z no activity
2022-01-20T18:24:17.162Z 5 samples not enough to calculate steady-state event rate
Jan 20, 2022 6:24:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2022-01-20T18:24:17.243Z no activity
2022-01-20T18:24:31.906Z RUNNING Query5 (waiting for shutdown)
2022-01-20T18:24:32.272Z RUNNING Query11
2022-01-20T18:24:32.482Z 8 samples not enough to calculate steady-state event rate
2022-01-20T18:24:32.482Z no activity
2022-01-20T18:24:32.863Z 5 samples not enough to calculate steady-state event rate
Jan 20, 2022 6:24:32 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2022-01-20T18:24:32.961Z streaming query appears to have finished waiting for completion.
SEVERE: Failed to get metric fatal, from namespace Query11
2022-01-20T18:24:32.961Z no activity
2022-01-20T18:24:47.530Z RUNNING Query5 (waiting for shutdown)
2022-01-20T18:24:47.991Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:24:48.322Z 8 samples not enough to calculate steady-state event rate
2022-01-20T18:24:48.322Z no activity
2022-01-20T18:24:48.620Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:24:48.620Z no activity
2022-01-20T18:25:03.372Z DONE Query5 (waiting for shutdown)
2022-01-20T18:25:03.409Z 8 samples not enough to calculate steady-state event rate

==========================================================================================
Run started 2022-01-20T18:12:24.231Z and ran for PT759.178S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:RESHUFFLE; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          46.0                    217207.2                    10000000              
  0001          25.3                    395851.5                     9200000              
  0002          23.9                    418077.7                       83527              
  0003          76.4                    130874.6                       59507              
  0004  *** not run ***
  0005         335.8                     29776.5                        4567              
  0006  *** not run ***
  0007         190.0                     52639.6                         100              
  0008          85.5                    116901.6                       92833              
  0009  *** not run ***
  0010         127.9                     78198.3                         100              
  0011  *** not run ***
  0012         114.5                     87305.7                      324511              
  0013  *** not run ***
  0014         117.0                     85435.8                    10000000              
  0015  *** not run ***
  0016  *** not run ***
==========================================================================================

2022-01-20T18:25:03.671Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:25:04.317Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:25:04.317Z no activity
2022-01-20T18:25:19.373Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:25:20.065Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:25:20.065Z no activity
2022-01-20T18:25:35.141Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:25:35.916Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:25:35.916Z no activity
2022-01-20T18:25:50.965Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:25:51.823Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:25:51.823Z no activity
2022-01-20T18:26:06.852Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:26:07.492Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:26:07.492Z no activity
2022-01-20T18:26:22.548Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:26:26.780Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:26:26.780Z no activity
2022-01-20T18:26:41.814Z RUNNING Query11 (waiting for shutdown)
2022-01-20T18:26:42.799Z 5 samples not enough to calculate steady-state event rate
2022-01-20T18:26:42.800Z no activity
2022-01-20T18:26:57.865Z DONE Query11 (waiting for shutdown)
2022-01-20T18:26:57.911Z 5 samples not enough to calculate steady-state event rate

==========================================================================================
Run started 2022-01-20T18:12:24.231Z and ran for PT873.680S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:RESHUFFLE; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          46.0                    217207.2                    10000000              
  0001          25.3                    395851.5                     9200000              
  0002          23.9                    418077.7                       83527              
  0003          76.4                    130874.6                       59507              
  0004  *** not run ***
  0005         335.8                     29776.5                        4567              
  0006  *** not run ***
  0007         190.0                     52639.6                         100              
  0008          85.5                    116901.6                       92833              
  0009  *** not run ***
  0010         127.9                     78198.3                         100              
  0011         462.8                     21608.5                     1839657              
  0012         114.5                     87305.7                      324511              
  0013  *** not run ***
  0014         117.0                     85435.8                    10000000              
  0015  *** not run ***
  0016  *** not run ***
==========================================================================================


==========================================================================================
Run started 2022-01-20T18:12:24.231Z and ran for PT873.920S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:RESHUFFLE; numEvents:10000000
  0015  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0016  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          46.0                    217207.2                    10000000              
  0001          25.3                    395851.5                     9200000              
  0002          23.9                    418077.7                       83527              
  0003          76.4                    130874.6                       59507              
  0004  *** not run ***
  0005         335.8                     29776.5                        4567              
  0006  *** not run ***
  0007         190.0                     52639.6                         100              
  0008          85.5                    116901.6                       92833              
  0009  *** not run ***
  0010         127.9                     78198.3                         100              
  0011         462.8                     21608.5                     1839657              
  0012         114.5                     87305.7                      324511              
  0013  *** not run ***
  0014         117.0                     85435.8                    10000000              
  0015  *** not run ***
  0016  *** not run ***
==========================================================================================


> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220120181143
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:602f328d3279fa8618e51a93da90a47a7a924d3b4d416bd61f2b3cdd735ee26c
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220120181143]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:602f328d3279fa8618e51a93da90a47a7a924d3b4d416bd61f2b3cdd735ee26c]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220120181143] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:602f328d3279fa8618e51a93da90a47a7a924d3b4d416bd61f2b3cdd735ee26c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a07483cf70fb1ba8d85cf8234b38d5feb791a81b5c8a96acce42d1ed2ca689bb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a07483cf70fb1ba8d85cf8234b38d5feb791a81b5c8a96acce42d1ed2ca689bb
ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404', 'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding': 'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip', 'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private', 'date': 'Thu, 20 Jan 2022 18:27:01 GMT', 'x-frame-options': 'SAMEORIGIN', 'content-type': 'application/json'}
Failed to compute blob liveness for manifest: 'sha256:a07483cf70fb1ba8d85cf8234b38d5feb791a81b5c8a96acce42d1ed2ca689bb': None

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 290

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 15m 21s
131 actionable tasks: 9 executed, 122 up-to-date

Publishing build scan...
https://gradle.com/s/vod7ko4c2dikc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Dataflow_V2 #969

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/969/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 968 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 968 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/968/ to view the results.

beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 967 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 967 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/967/ to view the results.

beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 966 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2 - Build # 966 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2/966/ to view the results.