You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/12/22 10:00:33 UTC

beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17 - Build # 23 - Aborted!

beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17 - Build # 23 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/23/ to view the results.

Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17 #26

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/26/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17 - Build # 25 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17 - Build # 25 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/25/ to view the results.

Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17 #24

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/24/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add microbenchmark for row coder.

[Robert Bradshaw] Compile RowCoderImpl with Cython.

[Robert Bradshaw] RowCoder optimizations.

[Robert Bradshaw] Further optimizations for common case of components in order.

[Robert Bradshaw] Optimize rows with null fields.

[Robert Bradshaw] RowCoder lint.


------------------------------------------
[...truncated 561.12 KB...]
2021-12-22T12:29:19.470Z 5 samples not enough to calculate steady-state event rate
Dec 22, 2021 12:29:19 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2021-12-22T12:29:19.534Z no activity
2021-12-22T12:29:20.271Z RUNNING Query5
2021-12-22T12:29:20.907Z 3 samples not enough to calculate steady-state event rate
Dec 22, 2021 12:29:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query5
2021-12-22T12:29:20.986Z streaming query appears to have finished waiting for completion.
2021-12-22T12:29:20.986Z no activity
2021-12-22T12:29:34.566Z RUNNING Query11
2021-12-22T12:29:35.108Z 5 samples not enough to calculate steady-state event rate
Dec 22, 2021 12:29:35 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2021-12-22T12:29:35.159Z no activity
2021-12-22T12:29:36.010Z RUNNING Query5 (waiting for shutdown)
2021-12-22T12:29:36.757Z 3 samples not enough to calculate steady-state event rate
2021-12-22T12:29:36.757Z no activity
2021-12-22T12:29:50.184Z RUNNING Query11
2021-12-22T12:29:52.185Z RUNNING Query5 (waiting for shutdown)
2021-12-22T12:29:55.970Z 5 samples not enough to calculate steady-state event rate
Dec 22, 2021 12:29:56 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2021-12-22T12:29:56.817Z no activity
2021-12-22T12:29:58.465Z 3 samples not enough to calculate steady-state event rate
2021-12-22T12:29:58.465Z no activity
2021-12-22T12:30:11.858Z RUNNING Query11
2021-12-22T12:30:12.432Z 5 samples not enough to calculate steady-state event rate
Dec 22, 2021 12:30:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2021-12-22T12:30:12.521Z streaming query appears to have finished waiting for completion.
SEVERE: Failed to get metric fatal, from namespace Query11
2021-12-22T12:30:12.521Z no activity
2021-12-22T12:30:13.489Z RUNNING Query5 (waiting for shutdown)
2021-12-22T12:30:14.162Z 3 samples not enough to calculate steady-state event rate
2021-12-22T12:30:14.162Z no activity
2021-12-22T12:30:27.552Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:30:28.136Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:30:28.136Z no activity
2021-12-22T12:30:29.185Z RUNNING Query5 (waiting for shutdown)
2021-12-22T12:30:29.817Z 3 samples not enough to calculate steady-state event rate
2021-12-22T12:30:29.817Z no activity
2021-12-22T12:30:43.167Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:30:43.763Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:30:43.763Z no activity
2021-12-22T12:30:44.839Z RUNNING Query5 (waiting for shutdown)
2021-12-22T12:30:45.435Z 3 samples not enough to calculate steady-state event rate
2021-12-22T12:30:45.435Z no activity
2021-12-22T12:30:58.810Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:30:59.410Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:30:59.410Z no activity
2021-12-22T12:31:00.457Z RUNNING Query5 (waiting for shutdown)
2021-12-22T12:31:01.194Z 3 samples not enough to calculate steady-state event rate
2021-12-22T12:31:01.194Z no activity
2021-12-22T12:31:14.453Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:31:15.084Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:31:15.084Z no activity
2021-12-22T12:31:16.248Z DONE Query5 (waiting for shutdown)
2021-12-22T12:31:16.298Z 3 samples not enough to calculate steady-state event rate

==========================================================================================
Run started 2021-12-22T12:17:01.886Z and ran for PT854.412S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          41.7                    239767.9                    10000000              
  0001          36.4                    274763.0                     9200000              
  0002          23.1                    433181.7                       83527              
  0003          73.7                    135641.0                       59507              
  0004  *** not run ***
  0005         425.3                     23513.9                        4567              
  0006  *** not run ***
  0007         147.7                     67726.4                         100              
  0008         134.1                     74568.4                       92841              
  0009  *** not run ***
  0010         113.0                     88508.1                         100              
  0011  *** not run ***
  0012         131.6                     75990.7                      338974              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================

2021-12-22T12:31:30.116Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:31:30.789Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:31:30.789Z no activity
2021-12-22T12:31:45.821Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:31:46.538Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:31:46.538Z no activity
2021-12-22T12:32:01.567Z RUNNING Query11 (waiting for shutdown)
2021-12-22T12:32:02.181Z 5 samples not enough to calculate steady-state event rate
2021-12-22T12:32:02.181Z no activity
2021-12-22T12:32:17.222Z DONE Query11 (waiting for shutdown)
2021-12-22T12:32:17.253Z 5 samples not enough to calculate steady-state event rate

==========================================================================================
Run started 2021-12-22T12:17:01.886Z and ran for PT915.367S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          41.7                    239767.9                    10000000              
  0001          36.4                    274763.0                     9200000              
  0002          23.1                    433181.7                       83527              
  0003          73.7                    135641.0                       59507              
  0004  *** not run ***
  0005         425.3                     23513.9                        4567              
  0006  *** not run ***
  0007         147.7                     67726.4                         100              
  0008         134.1                     74568.4                       92841              
  0009  *** not run ***
  0010         113.0                     88508.1                         100              
  0011         490.3                     20395.6                     1839657              
  0012         131.6                     75990.7                      338974              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================


==========================================================================================
Run started 2021-12-22T12:17:01.886Z and ran for PT915.626S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; numEvents:10000000
  0001  query:CURRENCY_CONVERSION; numEvents:10000000
  0002  query:SELECTION; numEvents:10000000
  0003  query:LOCAL_ITEM_SUGGESTION; numEvents:10000000
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; numEvents:1000000
  0005  query:HOT_ITEMS; numEvents:10000000
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; numEvents:1000000
  0007  query:HIGHEST_BID; numEvents:10000000
  0008  query:MONITOR_NEW_USERS; numEvents:10000000
  0009  query:WINNING_BIDS; numEvents:1000000
  0010  query:LOG_TO_SHARDED_FILES; numEvents:10000000
  0011  query:USER_SESSIONS; numEvents:10000000
  0012  query:PROCESSING_TIME_WINDOWS; numEvents:10000000
  0013  query:PORTABILITY_BATCH; numEvents:10000000
  0014  query:BOUNDED_SIDE_INPUT_JOIN; numEvents:10000000
  0015  query:SESSION_SIDE_INPUT_JOIN; numEvents:10000000

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000          41.7                    239767.9                    10000000              
  0001          36.4                    274763.0                     9200000              
  0002          23.1                    433181.7                       83527              
  0003          73.7                    135641.0                       59507              
  0004  *** not run ***
  0005         425.3                     23513.9                        4567              
  0006  *** not run ***
  0007         147.7                     67726.4                         100              
  0008         134.1                     74568.4                       92841              
  0009  *** not run ***
  0010         113.0                     88508.1                         100              
  0011         490.3                     20395.6                     1839657              
  0012         131.6                     75990.7                      338974              
  0013  *** not run ***
  0014  *** not run ***
  0015  *** not run ***
==========================================================================================


> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222121542
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f35f3386d2174b430f7e3c3919df37ceac33d7a20e5cf7cc1406d2b053f5281c
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222121542]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f35f3386d2174b430f7e3c3919df37ceac33d7a20e5cf7cc1406d2b053f5281c]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211222121542] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:f35f3386d2174b430f7e3c3919df37ceac33d7a20e5cf7cc1406d2b053f5281c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:93d9252cf8b81a51c4117a02c95abbfa8bf809c32e6a8986a5a8e44465eb3f0a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:93d9252cf8b81a51c4117a02c95abbfa8bf809c32e6a8986a5a8e44465eb3f0a
ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404', 'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding': 'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip', 'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private', 'date': 'Wed, 22 Dec 2021 12:32:21 GMT', 'x-frame-options': 'SAMEORIGIN', 'content-type': 'application/json'}
Failed to compute blob liveness for manifest: 'sha256:93d9252cf8b81a51c4117a02c95abbfa8bf809c32e6a8986a5a8e44465eb3f0a': None

> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow_V2_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 281

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 47s
94 actionable tasks: 9 executed, 85 up-to-date

Publishing build scan...
https://gradle.com/s/iw2hdj4wxw5pu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org