You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/07/07 01:22:41 UTC

Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #2790

See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2790/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)

[bulat.safiullin] [BEAM-14040] [Website] add io connectors table

[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line

[stranniknm] [BEAM-14079] playground - improve accessibility

[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate

[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week

[noreply] Fix import path

[noreply] [BEAM-13925] Fix one more import path

[noreply] Add a StatefulDoFn test that sets event time timer within allowed

[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content

[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support

[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging

[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br

[bulat.safiullin] [BEAM-14040] [Website] add empty line

[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO

[bulat.safiullin] [BEAM-14040] [Website] change td

[vitaly.terentyev] [BEAM-2766] Fix checkstyle

[bulat.safiullin] [BEAM-14041] [Website] update built io transforms

[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[Moritz Mack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.

[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database

[bulat.safiullin] [BEAM-14040] [Website] change links color

[Moritz Mack] [adhoc] Update owners for aws modules

[Yichi Zhang] Remove unused prebuild_sdk_container_base_iamge option from validate

[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules

[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test

[noreply] Add deterministic dict coding via key sorting. (#17037)

[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page

[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a

[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.

[dhuntsperger] fixing filename formatting in response to feedback

[dhuntsperger] adding extra step emphasizing runner setupt

[dhuntsperger] reorganized instructions to emphasize setup steps for runners

[Moritz Mack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS

[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java

[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current

[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a

[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…

[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish

[yiru] fix setting

[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support

[noreply] Adding pydoc for StateHandler (#17091)

[vachan] Update display data to include BQ information.

[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)

[hengfeng] feat: add more custom metrics

[aydar.zaynutdinov] [BEAM-13976][Website]

[aydar.zaynutdinov] [BEAM-14040][Website]

[aydar.zaynutdinov] [BEAM-14041][Website]

[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)

[noreply] Minor: Make ScopedReadStateSupplier final (#16992)

[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)

[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)

[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in

[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)

[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application

[noreply] Minor: Make serializableCoder warning gramatically correct english

[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners

[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner

[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)

[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,

[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.

[bulat.safiullin] [BEAM-13992] [Website] change code tags

[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)

[noreply] Populate environment capabilities in v1beta3 protos. (#17042)

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,

[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test for

[bulat.safiullin] [BEAM-13992] [Website] change text

[Moritz Mack] [adhoc] Minor cleanup for aws2 tests

[Moritz Mack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs

[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines

[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in

[danielamartinmtz] Updated documentation including cluster specs.

[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)

[noreply] [BEAM-14128] Eliminating quadratic behavior of

[danielamartinmtz] Removed code used for testing.

[noreply] [BEAM-13972] Add RunInference interface (#16917)

[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish

[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation

[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in

[yiru] fix checkstyle

[yiru] spotlessapply

[noreply] Deprecate tags.go (#17025)

[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)

[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for

[noreply] [BEAM-13925] Add weekly automation to update our reviewer config

[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile

[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)

[noreply] Pin setup-gcloud to v0 instead of master (#17123)

[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)

[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API

[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link

[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam

[noreply] Update Changes.md w/Go pipeline pre-process fix.

[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)

[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition

[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo

[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)

[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file

[Moritz Mack] [adhoc] Move aws IT tests to testing package according to best practices

[bulat.safiullin] [BEAM-13991] [Website] add content, add styles

[noreply] fixes static checks and go lint issues (#17138)

[Kyle Weaver] Don't print in task configuration.

[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK

[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests

[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource

[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.

[vachan] Annotating Read API tests.

[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)

[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)

[Robert Bradshaw] Coders cleanup.

[Robert Bradshaw] Add tests for RowCoder.

[Robert Bradshaw] Normalize capitalization, comments.

[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces

[Moritz Mack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init

[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points

[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image

[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)

[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit

[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite

[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.

[noreply] Minor: Bump timeout for Java PreCommit (#17157)

[noreply] [BEAM-14152] Disable flaky

[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch

[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.

[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the

[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF

[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in

[noreply] Add option to add modules to JDK add-open (#17110)

[noreply] [BEAM-13015] Clarify ownership of the list for state caching across

[bulat.safiullin] [BEAM-13991] [Website] add empty line

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[noreply] [BEAM-14134] Optimize memory allocations for various core coders

[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller

[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes

[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension

[bulat.safiullin] [BEAM-13991] [Website] change link color

[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)

[noreply] Remove unreachable code in container.go (#17166)

[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)

[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -

[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.

[bulat.safiullin] [BEAM-14164] [Website] change styles

[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.

[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.

[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.

[Kyle Weaver] [BEAM-14139] Update CHANGES.md

[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill

[marco.robles] [BEAM-8218] PulsarIO Connector

[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)

[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs

[benjamin.gonzalez] [BEAM-12572] SpotlessApply

[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.

[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)

[hengfeng] feat: remove the metadata table after the pipeline finishes

[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)

[Robert Bradshaw] Add some comments.

[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)

[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python

[noreply] Explicitly import estimator from tensorflow (#17168)

[thiagotnunes] test: add test for metadata table dropping

[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)

[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)

[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to

[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections

[noreply] Only reset transform.label if it is correctly assigned (#17192)

[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth

[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[chamikaramj] Convert URLs to local jars when constructing filesToStage

[thiagotnunes] test: disable SpannerIO.readChangeStream test

[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy

[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test

[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace

[bulat.safiullin] [BEAM-13991] [Website] change text

[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0

[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x

[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on

[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline

[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for

[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test

[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test

[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)

[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports

[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)

[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang

[bulat.safiullin] [BEAM-13992] [Website] update text

[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test

[Kiley Sok] ignore test

[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on

[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)

[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO

[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field

[noreply] [BEAM-14179] Fix possibly null value

[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)

[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)

[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc

[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner

[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable

[bingyeli] update query

[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.

[Robert Bradshaw] Skip failing test for now.

[Kyle Weaver] [BEAM-14225] load balance jenkins jobs

[noreply] [BEAM-13951] Update release guide with pointers on updating

[Kiley Sok] Update python container version

[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting

[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause

[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence

[noreply] delint go sdk (#17247)

[Heejong Lee] add test

[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by

[noreply] [BEAM-14192] Update legacy container version (#17210)

[noreply] Fix mishandling of API with BQIO (#17211)

[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features

[Kyle Weaver] Add self-descriptive message for expected errors.

[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"

[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)

[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config

[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions

[noreply] [BEAM-10529] nullable xlang coder (#16923)

[noreply] Fix go fmt break in core/typex/special.go (#17266)

[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)

[noreply] Pr-bot Don't count all reviews as approvals (#17269)

[noreply] Fix postcommits (#17263)

[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)

[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do

[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)

[noreply] [BEAM-13519] Solve race issues when the server responds with an error

[Robert Bradshaw] Cleanup docs on Shared.

[Kyle Weaver] Nit: correct description for precommit cron jobs.

[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.

[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE

[johnjcasey] [BEAM-14256] remove .RELEASE

[Danny McCormick] Fix dependency issue causing failures

[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.

[noreply] Allow get_coder(None).

[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise

[noreply] [BEAM-13952] Sickbay

[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow

[noreply] [Website] Contribution guide page indent bug fix (#17287)

[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing

[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)

[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)

[nishantjain] [BEAM-14000] Elastic search IO doesnot work when both username/password

[noreply] Avoid pr-bot state desync (#17299)

[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)

[noreply] Minor: Prefer registered schema in SQL docs (#17298)

[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.

[Kyle Weaver] Add ansicolor and ws-cleanup plugins.

[noreply] [Playground] add meta tags (#17207)

[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)

[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)

[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)

[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet

[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[nishantjain] Fixes issue with httpclientbuilder - Use the existing builder instead of

[nishantjain] moves sslcontext towards starting of function

[Moritz Mack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.

[noreply] [BEAM-13015] Lookup the container for the step once when registering

[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)

[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing

[noreply] [BEAM-11745] Fix author list rendering (#17308)

[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)

[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17

[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job

[noreply] Factors enable_prime flag in when checking use_unified_worker conditions

[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)

[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)

[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)

[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go

[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()

[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes

[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)

[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion

[noreply] Update python beam-master container image. (#17313)

[bulat.safiullin] [BEAM-14247] [Website] add image

[Kenneth Knowles] Upgrade to Gradle 7.4

[Kenneth Knowles] Remove Python module dependency on Dataflow worker

[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks

[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.

[noreply] [BEAM-10708] Updated beam_sql error message (#17314)

[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)

[noreply] Improvements to Beam/Spark quickstart. (#17129)

[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite

[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting

[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors

[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External

[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer

[Robert Bradshaw] Install typescript closure packages.

[Robert Bradshaw] npm audit fix

[Robert Bradshaw] Move more imports out of base.

[Robert Bradshaw] Changes needed to compile with ts closure plugin.

[Robert Bradshaw] Use ttsc and ts-closure-transform plugin.

[Robert Bradshaw] Serialization registration to actually get serialization working.

[Robert Bradshaw] Container images working on local runner.

[Robert Bradshaw] Add a portable job server that proxies the Dataflow backend. (#17189)

[Robert Bradshaw] Improvements to dataflow job service for non-Python jobs.

[Robert Bradshaw] Get dataflow working.

[Robert Bradshaw] User friendly pipeline options.

[Robert Bradshaw] Less classes, more functions.

[pandiana] BigQueryServicesImpl: reduce number of threads spawned by

[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin

[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)

[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)

[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)

[noreply] [BEAM-14288] Skip flaking test

[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs

[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)

[Robert Bradshaw] Add new nullable standard coder.

[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.

[Robert Bradshaw] Make Apache Rat happy.

[Robert Bradshaw] Disable broken codecov.

[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java

[bulat.safiullin] [BEAM-14247] [Website] center image

[noreply] Fix test ordering issue (#17350)

[buqian] Do not pass null to MoreObjects.firstNonNull as default value

[ningkang0957] [BEAM-14288] Fixed flaky test

[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)

[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container

[Heejong Lee] [BEAM-14300] Fix Java precommit failure

[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"

[relax] handle changing schemas in Storage API sink

[noreply] [BEAM-13982] A base class for run inference (#16970)

[ningkang0957] Enumerates all possible expected strings when asserting

[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical

[nishantjain] adds unit test

[nishantjain] changes unit test to directly built restclient

[nishantjain] changes name of unit test

[noreply] Fix a couple style issues (#17361)

[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)

[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)

[noreply] Bump minimist (#17290)

[noreply] Bump ansi-regex (#17291)

[noreply] Bump nanoid (#17292)

[noreply] Bump lodash (#17293)

[noreply] Bump url-parse (#17294)

[noreply] Bump moment (#17328)

[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO

[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest

[Heejong Lee] remove null

[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample

[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer

[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)

[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)

[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)

[noreply] Respect output coder for TextIO. (#17367)

[Heejong Lee] better error msg

[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog

[andyye333] Change func to PTransform

[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)

[noreply] Merge pull request #17375: [BEAM-8691] Declare newer

[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the

[Heejong Lee] update from comments

[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility

[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package

[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)

[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates

[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as

[nishantjain] adds test to all elasticsearch folder

[nishantjain] updates changes.md

[nishantjain] spotless fix

[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)

[relax] mark static thread as a daemon thread

[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)

[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0

[Moritz Mack] [BEAM-14335] Spotless Spark sources

[Moritz Mack] [BEAM-14323] Improve IDE integration of Spark cross version builds

[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)

[noreply] Update .asf.yaml (#17409)

[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing

[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()

[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)

[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix

[Robert Bradshaw] Remove last uses of base.ts.

[yiru] fix: BigQuery Storage Connector trace id population missing bracket

[Robert Bradshaw] Remove unneedd file.

[Robert Bradshaw] Remove more uneeded/unused files.

[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)

[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform

[noreply] Update Beam website to release 2.38.0 (#17378)

[Heejong Lee] update

[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns

[noreply] Minor: Update release guide regarding archive.apache.org (#17419)

[Heejong Lee] allows remote host

[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)

[Moritz Mack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid

[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)

[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"

[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument

[ihr] Update Java katas to Beam 2.38

[noreply] [BEAM-13657] Sunset python 3.6 (#17252)

[noreply] Removes unsupported Python 3.6 from the release validation script

[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)

[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)

[noreply] Create apache-hop-with-dataflow.md

[noreply] Add files via upload

[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow

[noreply] Add files via upload

[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1

[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17

[noreply] Update apache-hop-with-dataflow.md

[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file

[Robert Bradshaw] Cleanup tests.

[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)

[Heejong Lee] improve compatibility with python rowcoder

[Robert Bradshaw] Minor cleanups to coder tests.

[noreply] Updates opencensus-api dependency to the latest version - 0.31.0

[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)

[noreply] Updated the dep and golden for screen diff integration tests (#17442)

[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)

[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare

[ahmedabualsaud] added tempLocation to test pipeline options

[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread

[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)

[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)

[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)

[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)

[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)

[noreply] Update authors.yml

[ahmedabualsaud] using tempRoot for temp bucket location

[noreply] Quote pip install package name

[ahmedabualsaud] small fixes

[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)

[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)

[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)

[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis

[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)

[noreply] Minor: Fix release script for `current` symlinks (#17457)

[noreply] Minor: fix typo (#17452)

[noreply] Change return type for PytorchInferenceRunner (#17460)

[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)

[Heejong Lee] add test

[noreply] Remove unnecessary decorator from RunInference interface (#17463)

[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)

[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)

[Robert Bradshaw] Add element weighting parameter to BatchElements.

[noreply] Updated goldens for the screen diff integration tests (#17467)

[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)

[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs

[noreply] Merge pull request #17447 from [BEAM-14357] Fix

[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)

[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while

[noreply] BEAM-14187 Fix NPE (#17454)

[noreply] [BEAM-11105] Stateful watermark estimation (#17374)

[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)

[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)

[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for

[Alexey Romanenko] [BEAM-12918] Add PostCommit_Java_Tpcds_Spark job

[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being

[noreply] [BEAM-14374] Fix module import error in FullyQualifiedNamedTransform

[noreply] Improvement to Seed job configuration to launch against PRs (#17468)

[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)

[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform

[noreply] [BEAM-14351] Inherit from Coder. (#17437)

[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit

[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io

[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home

[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page

[noreply] [BEAM-14376] Typo in method description doc

[noreply] Add default classpath when not present (#17491)

[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict

[Robert Bradshaw] Allow arithmetic between deferred scalars.

[Robert Bradshaw] Clearer test.

[thiagotnunes] fix: update javadocs for ChangeStreamMetrics

[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for

[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav

[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html

[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side

[noreply] [BEAM-14351] Fix the template and move the announcement to the next

[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle

[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package

[Robert Bradshaw] Addressing issues from the review.

[noreply] Apply suggestions from code review.

[Robert Bradshaw] Post-merge fixes.

[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)

[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to

[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference

[noreply] Add SQL in Notebooks blog post (#17481)

[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp

[noreply] Revert "Improvement to Seed job configuration to launch against PRs

[ilion.beyst] Minor: fix typo

[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from

[noreply] [BEAM-11105] Add manual watermark estimation (#17475)

[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)

[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)

[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow

[noreply] Add website link log to notify user of pre-build workflow. (#17498)

[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)

[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"

[Brian Hulette] BEAM-14231: bypass schema cache for

[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python

[noreply] [BEAM-10265] Display error message if trying to infer recursive schema

[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)

[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation

[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated

[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling

[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)

[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ

[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to

[noreply] [BEAM-14064] fix es io windowing (#17112)

[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)

[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test

[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.

[noreply] [BEAM-11106] Support drain in Go SDK (#17432)

[noreply] add __Init__ to inference. (#17514)

[Danny McCormick] Delete tags.go

[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template

[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section

[ahmedabualsaud] fix test decotrator typo

[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff

[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations

[noreply] re-add testing package to pydoc (#17524)

[Heejong Lee] add test

[noreply] [BEAM-14250] Amended the workaround (#17531)

[noreply] [BEAM-11104] Fix broken split result validation (#17546)

[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)

[noreply] Merge pull request #17417: [BEAM-14388] Address some performance

[Robert Bradshaw] Update tests to use our actual serialization libraries.

[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)

[Robert Bradshaw] Another pass at TODOs, removing finished items.

[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)

[Yichi Zhang] Moving to 2.40.0-SNAPSHOT on master branch.

[Yichi Zhang] Move master readme.md to 2.40.0

[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs

[thiagotnunes] BEAM-14419: Remove invalid mod type

[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink

[noreply] Upgrade python sdk container requirements. (#17549)

[noreply] Merge pull request #17497: [BEAM-11205] Update GCP Libraries BOM version

[Heejong Lee] [BEAM-14146] Python Streaming job failing to drain with BigQueryIO write

[noreply] [BEAM-12603] Add retry on grpc data channel and remove retry from test.

[noreply] Merge pull request #17359: [BEAM-14303] Add a way to exclude output

[Robert Bradshaw] [BEAM-14426] Allow skipping of any output when writing an empty

[Kenneth Knowles] Add parameter for service account impersonation in GCP credentials

[noreply] [BEAM-14347] Allow users to optimize DoFn execution with a single

[noreply] [BEAM-5878] Add (failing) kwonly-argument test (#17509)

[Heejong Lee] add test

[bulat.safiullin] [BEAM-14428] change text, change styling of connectors and contribute

[noreply] Merge pull request #17490 from [BEAM-14370] [Website] Add new page about

[noreply] [BEAM-14332] Refactored cluster management for Flink on Dataproc

[noreply] [BEAM-13988] Update mtime to use time.UnixMilli() calls (#17578)

[noreply] Fixing patching error on missing dependencies (#17564)

[elias.segundo] Changing elegibility to AllNodeElegibility

[noreply] Merge pull request #17517 from [BEAM-14383] Improve "FailedRows" errors

[Heejong Lee] add test without mock

[randomstep] [BEAM-14096] bump junit-quickcheck to 1.0

[chamikaramj] Adds code reviewers for GCP I/O connectors and KafkaIO to Beam OWNERS

[andyye333] Add extra details to PubSub matcher errors

[Danny McCormick] [BEAM-14441] Add GitHub issue templates

[noreply] Merge pull request #17559 from [BEAM-14423] Add exception injection

[noreply] [BEAM-11104] Allow self-checkpointing SDFs to return without finishing

[noreply] Merge pull request #17544 from [BEAM-14415] Exception handling tests for

[noreply] Merge pull request #17565 from [BEAM-14413] add Kafka exception test

[noreply] Merge pull request #17555 from [BEAM-14417] Adding exception handling

[noreply] [BEAM-14433] Improve Go split error message. (#17575)

[noreply] [BEAM-14429] Force java load test on dataflow runner v2

[noreply] Merge pull request #17577 from [BEAM-14435] Adding exception handling

[johnjcasey] [BEAM-14448] add datastore test

[Danny McCormick] [BEAM-14446] Update some docs to point to GitHub issues

[noreply] [BEAM-14347] Add generic registration functions for iters and emitters

[yathu] [BEAM-14423] Add test cases for BigtableIO.BigtableWriterFn fails due to

[noreply] [BEAM-14169] Add Credentials rotation cron job for clusters (#17383)

[noreply] [BEAM-14347] Add generic registration for accumulators (#17579)

[Danny McCormick] More doc updates

[Danny McCormick] Update issueManagement fields

[Pablo Estrada] Revert "Merge pull request #17517 from [BEAM-14383] Improve "FailedRows"

[noreply] [BEAM-14229] Fix SyntheticUnboundedSource duplication from checkpoint

[Heejong Lee] [BEAM-14455] Add UUID to sub-schemas for PythonExternalTransform

[Heejong Lee] [BEAM-14430] Adding a logical type support for Python callables to Row

[noreply] [BEAM-14347] Rename registration package to register (#17603)

[noreply] [BEAM-11104] Add self-checkpointing integration test (#17590)

[noreply] [BEAM-5492] Python Dataflow integration tests should export the pipeline

[noreply] [BEAM-14396] Bump httplib2 upper bound. (#17602)

[noreply] [BEAM-11104] Add self-checkpointing to CHANGES.md (#17612)

[noreply] [BEAM-14081] [CdapIO] Add context classes for CDAP plugins (#17104)

[Danny McCormick] Fix website build

[Danny McCormick] Remove extraneous comment line

[noreply] [BEAM-12526] Add Dependabot (#17563)

[noreply] Remove python 3.6 postcommit from mass_comment.py (#17630)

[Danny McCormick] Ask for beam version + other dependencies

[Danny McCormick] We don't need outage

[Danny McCormick] Cut p4

[noreply] [BEAM-14347] Add some benchmarks for generic registration (#17613)

[chamikaramj] Updates CHANGES.md to include some recently discovered known issues

[noreply] Correctly route go dependency changes to go label (#17632)

[noreply] [BEAM-13695] Add jamm jvm options to Java 11 (#17178)

[Heejong Lee] add urn, type inference for PythonCallableSource

[Heejong Lee] fix lint errors

[noreply] [BEAM-14334] Fix leakage of SparkContext in Spark runner tests to remove

[noreply] Typo & link update (#17633)

[Danny McCormick] Pare down to fewer templates

[ihr] [BEAM-14006] Update Python katas to 2.38 and fix issue with one test

[noreply] Trigger go precommits on go mod/sum changes (#17636)

[ilion.beyst] minor: don't capture stderr in kata tests

[noreply] Revert "[BEAM-14429] Force java load test on dataflow runner v2

[Robert Bradshaw] Use WindowedValue.withValue rather than WindowedValue.of in

[Robert Bradshaw] [BEAM-14464] More efficient grouping keys in precombiner table.

[noreply] [BEAM-14347] Add generic registration feature to CHANGES (#17643)

[noreply] Better test assertion. (#17551)

[noreply] Bump github.com/google/go-cmp from 0.5.7 to 0.5.8 in /sdks (#17628)

[noreply] Bump github.com/testcontainers/testcontainers-go in /sdks (#17627)

[noreply] Bump github.com/lib/pq from 1.10.4 to 1.10.5 in /sdks (#17626)

[noreply] Merge pull request #17584 from [BEAM-14415] Exception handling tests and

[noreply] Bump cloud.google.com/go/pubsub from 1.18.0 to 1.21.1 in /sdks (#17646)

[noreply] Merge pull request #17408 from [BEAM-14312] [Website] change section

[Robert Bradshaw] Add skip_if_empty attribute to base class to fix test.

[Heejong Lee] move logical types def

[Heejong Lee] add micros_instant urn

[noreply] Bump cloud.google.com/go/bigquery from 1.28.0 to 1.32.0 in /sdks

[Heejong Lee] put a default type hint for PythonCallableSource

[Heejong Lee] add comment

[noreply] [BEAM-14347] Add function for simple function registration (#17650)

[noreply] Revert "Better test assertion. (#17551)"

[noreply] Drop dataclasses requirement, we only support python 3.7+ (#17640)

[Moritz Mack] [BEAM-14334] Remove remaining forkEvery 1 from all Spark tests and stop

[noreply] Bump github.com/spf13/cobra from 1.3.0 to 1.4.0 in /sdks (#17647)

[noreply] [BEAM-14465] Reduce DefaultS3ClientBuilderFactory logging to debug level

[noreply] Merge pull request #17365 from [BEAM-12482] Update Schema Destination

[noreply] [BEAM-14014] Support impersonation credentials in dataflow runner

[noreply] [BEAM-14469] Allow nil primary returns from TrySplit in  a single-window

[noreply] Add some auto-starting runners to the typescript SDK. (#17580)

[noreply] [BEAM-14371] (and BEAM-14372) - enable a couple staticchecks (#17670)

[noreply] [BEAM-14470] Use Generic Registrations in loadtests. (#17673)

[noreply] [BEAM-13015] Update the SDK harness grouping table to be memory bounded

[noreply] [BEAM-13982] Added output of logging for python E2E pytests (#17637)

[noreply] [BEAM-14473] Throw error if using globally windowed, unbounded side

[noreply] [BEAM-14440] Add basic fuzz tests to the coders package (#17587)

[noreply] [BEAM-14035 ] Implement BigQuerySchema Read/Write TransformProvider

[noreply] Add Akvelon to case-studies (#17611)

[noreply] Merge pull request #17520 from BEAM-12356 Close DatasetService leaked

[noreply] Adding eslint and lint configuration to TypeScript SDK (#17676)

[noreply] Update release-guide.md

[noreply] Update release-guide.md

[noreply] [BEAM-14411] Re-enable TypecodersTest, fix most issues (#17547)

[Heejong Lee] [BEAM-14478] Fix missing 'projectId' attribute error

[noreply] Merge pull request #17678 from [BEAM-14460] [Playground] WIP. Fix error

[Alexey Romanenko] [BEAM-14035] Fix checkstyle issue

[noreply] [BEAM-14441] Automatically assign issue labels based on responses to

[noreply] README update for the Docker Error 255 during Website launch on Apple

[noreply] [BEAM-12000] Update programming-guide.md (#17679)

[noreply] [BEAM-14467] Fix bug where run_pytest.sh does not elevate errors raised

[Heejong Lee] [BEAM-14471] Adding testcases and examples for xlang Python

[yathu] Add labels for typescript PRs

[noreply] [BEAM-14474] Suppress 'Mean of empty slice' Runtime Warning in dataframe

[noreply] [BEAM-10529] update KafkaIO Xlang integration test to publish and

[noreply] Fix a few small linting bugs (#17695)

[noreply] Bump github.com/lib/pq from 1.10.5 to 1.10.6 in /sdks (#17691)

[noreply] Update release-guide.md

[chamikaramj] Corrects I/O connectors availability status in Beam Website.

[singh.vikash2310] fixed typos in README.md

[Jan Lukavský] [BEAM-14492] add flinkConfDir to FlinkPipelineOptions

[noreply] Update the PTransform and associated APIs to be less class-based.

[noreply] Vortex performance improvement: Enable multiple stream clients per

[noreply] [BEAM-14488] Alias async flags. (#17711)

[noreply] [BEAM-14487] Make drain & update terminal states. (#17710)

[noreply] [BEAM-14484] Improve behavior surrounding primary roots in

[noreply] Improve validation error message (#17719)

[noreply] Remove unused validation configurations. (#17705)

[bulat.safiullin] [BEAM-14418] added arrows to slider

[noreply] Minor: Bump Dataflow container versions (#17684)

[noreply] Bump google.golang.org/grpc from 1.45.0 to 1.46.2 in /sdks (#17677)

[noreply] Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks

[noreply] [BEAM-13015] Only create a TimerBundleTracker if there are timers.

[Heejong Lee] update

[noreply] Add clarification on Filter transform's input function to pydoc.

[noreply] [BEAM-14367]Flaky timeout in

[relax] DLQ for BQ Storage Api writes

[noreply] [BEAM-14494] Tag rc dockre container with format ${RELEASE}rc${RC_NUM}

[noreply] [BEAM-11578] Fix TypeError in dataflow_metrics has 0 distribution sum

[noreply] [BEAM-14499] Step global, unbounded side input case back to warning

[noreply] [BEAM-14484] Step back unexpected primary handling to warnings (#17724)

[yiru] fix: Add a retry code to insertall retry policy

[noreply] [BEAM-14486] Document pubsubio & fix its behavior. (#17709)

[noreply] [BEAM-14489] Remove non-SDF version of TextIO. (#17712)

[Heejong Lee] add DataframeTransform wrapper

[noreply] [BEAM-14298] resolve dependency

[noreply] Fix -- linting issue (#17738)

[noreply] Fix 'NoneType' object has no attribute error

[noreply] [BEAM-12308] change expected value in kakfa IT (#17740)

[noreply] [BEAM-14053] [CdapIO] Add wrapper class for CDAP plugin (#17150)

[Robert Bradshaw] fix compile after merge

[noreply] [BEAM-14129] Clean up PubsubLiteIO by removing options that no longer

[noreply] [BEAM-14496] Ensure that precombine is inheriting one of the timestamps

[noreply] [BEAM-14139] Remove unused Flink 1.11 directory (#17750)

[noreply] [BEAM-14044] Allow ModelLoader to forward BatchElements args (#17527)

[noreply] [BEAM-14481] Remove unnecessary context (#17737)

[noreply] [BEAM-9324] Fix incompatibility of direct runner with cython (#17728)

[noreply] [BEAM-14503] Add support for Flink 1.15 (#17739)

[noreply] Update Beam website to release 2.39.0 (#17690)

[noreply] [BEAM-14509] Add several flags to dataflow runner (#17752)

[Yichi Zhang] Fix 2.38.0 download page.

[noreply] [BEAM-14494] Fix publish_docker_images.sh (#17756)

[Kiley Sok] Update beam-master version for legacy

[Robert Bradshaw] spotless

[noreply] Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks

[Robert Bradshaw] Only flush every Nth element.

[chamikaramj] Adds Java cross-language transforms for invoking Python Map and FlatMap

[noreply] [BEAM-14336] Re-enable `flight_delays_it_test` with

[noreply] [BEAM-11106] small nits to truncate sdf exec unit (#17755)

[noreply] Added standard logging when exception is thrown (#17717)

[noreply] [BEAM-13829] Enable worker status in Go

[noreply] [BEAM-14519] Add website page for Go dependencies (#17766)

[noreply] [BEAM-11106] Validate that DoFn returns Process continuation when

[noreply] [BEAM-14505] Add Dataflow streaming pipeline update support to the Go

[Heejong Lee] Fix NonType error when importing google.api_core fails

[noreply] [BEAM-13972] Update documentation for run inference (#17508)

[noreply] [BEAM-14502] Fix: Splitting scans into smaller chunks to buffer reads

[noreply] [BEAM-14218] Add resource location hints to base inference runner.

[noreply] [BEAM-14442] Ask for repro steps/redirect to user list in bug template

[noreply] [BEAM-14166] Push logic in RowWithGetters down into getters and use

[noreply] cleaned up TypeScript in coders.ts (#17689)

[noreply] [BEAM-14170] - Create a test that runs sickbayed tests (#17471)

[nielm] Fix SpannerIO service call metrics and improve tests.

[noreply] Commit message guidance

[noreply] [BEAM-14255] Drop clock abstraction (#17671)

[noreply] Adds __repr__ to NullableCoder (#17757)

[Kenneth Knowles] Fix parsing of -PenableCheckerFramework in build

[noreply] Merge pull request #17683 from [BEAM-14475] add test cases to GcsUtil

[noreply] [BEAM-14410] Add test to demonstrate BEAM-14410 issue in non-cython

[noreply] [BEAM-14449] Support cluster provisioning when using Flink on Dataproc

[noreply] [BEAM-14527] Implement "Beam Summit 2022" banner (#17776)

[noreply] Merge pull request #17222 from [BEAM-12164] Feat: Add new restriction

[noreply] Merge pull request #17598 from [BEAM-14451] Support export to BigQuery

[Kenneth Knowles] Fix additional nullness errors in BigQueryIO

[noreply] Add typing information to RunInferrence. (#17762)

[yathu] [BEAM-13984] followup Fix precommit

[noreply] [BEAM-14513] Add read transform and initial healthcare client (#17748)

[noreply] [BEAM-14536] Handle 0.0 splits in offsetrange restriction (#17782)

[noreply] [BEAM-14470] Use lifecycle method names directly. (#17790)

[noreply] [BEAM-14297] add nullable annotations and an integration test (#17742)

[noreply] Only generate Javadocs for latest Spark runner version (Spark 3) to fix

[noreply] Fail Javadoc aggregateJavadoc task if there's an error (#17801)

[noreply] Merge pull request #17753 from [BEAM-14510] adding exception tests to

[noreply] feat: allow for unknown values in change streams (#17655)

[noreply] Support JdbcIO autosharding in Python (#16921)

[noreply] [BEAM-14511] Growable Tracker for Go SDK (#17754)

[noreply] [BEAM-14539] Ensure that the print stream can handle larger byte arrays

[noreply] [BEAM-10976] Fix bug with bundle finalization on SDFs (and a small doc

[noreply] Bump google.golang.org/grpc from 1.46.2 to 1.47.0 in /sdks (#17806)

[noreply] Rename pytorch files (#17798)

[noreply] Merge pull request #17492 from [BEAM-13945] (FIX) Update Java BQ

[noreply] [BEAM-11105] Add more watermark estimation docs for go (#17785)

[noreply] [BEAM-11106] documentation for SDF truncation in Go (#17781)

[yathu] [BEAM-14471] Fix PytestUnknownMarkingWarning

[noreply] [BEAM-11167] Updates dill package to version 0.3.5.1 (#17669)

[noreply] [BEAM-6258] Use gRPC 1.33.1 as min version to ensure that we pickup

[noreply] [BEAM-14441] Enable GitHub issues (#17812)

[Pablo Estrada] Revert "Merge pull request #17492 from [BEAM-13945] (FIX) Update Java BQ

[noreply] Alias worker_harness_container_image to sdk_container_image (#17817)

[noreply] [BEAM-14546] Fix errant pass for empty collections in Count (#17813)

[noreply] Merge pull request #17741 from [BEAM-14504] Add support for including

[noreply] Merge pull request #18374 from [BEAM-13945] Roll forward JSON support

[noreply] Merge pull request #17792 from [BEAM-13756] [Playground] Merge Log and

[noreply] Merge pull request #17779: [BEAM-14529] Add integer to float64

[Robert Bradshaw] Populate missing display data for remotely expanded transforms.

[Robert Bradshaw] Add an option to run Python operations in-line when invoked as a remote

[Robert Bradshaw] Pass options underlying runner in remote job service.

[noreply] [BEAM-14556] Honor the formatter installed on the root handler. (#17820)

[noreply] Update Jira -> Issues in the Readme

[Alexey Romanenko] [BEAM-12918] Add PostCommit_Java_Tpcds_Dataflow job

[noreply] [Fixes #18679] Ensure that usage of metrics on a template job reports an

[noreply] Clean up uses of == instead of === in ts sdk (#17732)

[Robert Bradshaw] Comment, lint fixes.

[noreply] Mount GCP credentials in local docker environments. (#19265)

[noreply] [BEAM-14068]Add Pytorch inference IT test and example (#17462)

[noreply] [Playground] [Hotfix] Remove autoscrolling from embedded editor (#21717)

[andyye333] Add Pytorch support for batched keyed examples

[andyye333] Add general support for non-batchable kwargs params; Add

[noreply] [BEAM-12554] Create new instances of FileSink in sink_fn (#17708)

[Danny McCormick] Gather metrics on GH Issues

[Danny McCormick] Fixes

[Danny McCormick] Fixes

[noreply] DataflowRunner: Experiment added to disable unbounded PCcollection

[Danny McCormick] Comment + naming fix

[Danny McCormick] Conflicts fix

[Danny McCormick] Ordering

[Danny McCormick] Different fallback for prs/issues

[vachan] Fix for increased FAILED_PRECONDITION errors in BQ Read API.

[noreply] More flexible Python Callable type. (#17767)

[noreply] Fix typos in README (#17675)

[vachan] Adding comments.

[noreply] Bump google.golang.org/api from 0.81.0 to 0.83.0 in /sdks (#21743)

[noreply] Bump cloud.google.com/go/pubsub from 1.21.1 to 1.22.2 in /sdks

[nielm] Add transform names to help debug flaky test

[noreply] Add ability to self-assign issues for non-committers (#21719)

[Danny McCormick] Fix sync time

[noreply] Dont try to generate jiras as part of dependency report (#21753)

[noreply] Allow users to comment `.take-issue` without taking (#21755)

[naireenhussain] convert windmill min timestamp to beam min timestamp

[noreply] Merge pull request: [Beam-14528]: Add ISO time format support for

[noreply] Update all links to in progress jiras to issues (#21749)

[Danny McCormick] Update dashboards to use gh data instead of jira data

[noreply] Merge pull request #21746: Exclude GCP Java packages from Dependabot

[Danny McCormick] Stop collecting jira metrics

[noreply] Update .test-infra/metrics/grafana/dashboards/source_data_freshness.json

[noreply] Better cross langauge support for dataframe reads. (#21762)

[Robert Bradshaw] Streaming-related runner fixes.

[Robert Bradshaw] Improvements to auto-started services.

[Robert Bradshaw] Fix version, asserts for remote execution.

[Robert Bradshaw] Add IO dependencies.

[noreply] Add template_location flag to Go Dataflow runner (#21774)

[Robert Bradshaw] Add several cross-language IOs.

[Robert Bradshaw] Disable tests that require new release is required for out-of-the-box

[noreply] [BEAM-14406] Drain test for SDF truncation in Go SDK (#17814)

[noreply] More Jira -> Issues doc updates (#21770)

[Danny McCormick] Move to contains notation

[noreply] [BEAM-11104] Add code snippet for Go SDK Self-Checkpointing (#17956)

[noreply] [BEAM-13769]Add no_xdist marker for cloudpickle test (#17538)

[Danny McCormick] Mark issues as triaged when they are assigned

[Danny McCormick] fix query to get all updated issues

[noreply] [BEAM-14533] Bump cloudpickle to 2.1.0 (#17780)

[noreply] Add basic byte size estimation for batches (#17771)

[noreply] Add @yields_batches and @yields_elements (#19268)

[noreply] [BEAM-14535] Added support for pandas in sklearn inference runner

[noreply] Merge ModelLoader and InferenceRunner into same class. (#21795)

[noreply] Merge pull request #17589 from [BEAM-14422] Exception testing for

[noreply] Add README for image classification example (#21758)

[anandinguva98] fixup: bug

[noreply] Fix every PR linking to PR 123 (#21802)

[noreply] Add native PubSub IO prototype to Go (#17955)

[noreply] Allow creation of dynamically defined transforms in the Python expansion

[noreply] Make keying of examples explicit. (#21777)

[chamikaramj] Automatically enable Runner v2 for pipelines that use cross-language

[noreply] Refactor code according to keyedModelHandler changes (#21819)

[noreply] Add RunInference API to CHANGES.md (#21754)

[Kenneth Knowles] Do not allow postcommit jobs phrase triggering

[noreply] Refactor API code to base.py in RunInference (#21801)

[noreply] Provide a diagnostic error message when a filesystem scheme is not

[nielm] Add Spanner Integration tests to verify exception handling

[Kiley Sok] Disable more triggers

[noreply] [BEAM-14532] Add integration testing to fhirio Read transform (#17803)

[noreply] Merge pull request #17794 from [#21252] Enforce pubsub message

[noreply] Separated pandas and numpy implementations of sklearn. (#21803)

[noreply] Composite triggers and unit tests for Go SDK (#21756)

[Kiley Sok] Enable phrase trigger for a few post commits

[Kiley Sok] spotless

[noreply] [BEAM-14557] Read and Seek Runner Capabilities in Go SDK  (#17821)

[noreply] [BEAM-13806] Add x-lang BigQuery IO integration test to Go SDK. (#16818)

[bulat.safiullin] [BEAM-13229] side nav bug fixed

[bulat.safiullin] fix links for pipelines

[Jan Lukavský] [BEAM-14265] Add watermark hold for all timers

[noreply] Bump Python beam-master container (#21820)

[noreply] Split PytorchModelHandler into PytorchModelHandlerTensor and

[noreply] Fix Hadoop Downloader Range not correct (#21778)

[noreply] [BEAM-14036] Read Configuration for Pub/Sub SchemaTransform (#17730)

[noreply] [Go SDK] Add more info to Worker Status API (#21776)

[noreply] Make PeriodicImpulse generates unbounded PCollection (#21815)

[noreply] [BEAM-14267] Update watchForNewFiles to allow watching updated files

[noreply] fix timestamp conversion in Google Cloud Datastore Connector (#17789)

[noreply] Update references to Jira to GH for the Go label (#21830)

[noreply] [#21853] Adjust Go cross-compile to target entire package (#21854)

[Kenneth Knowles] Adjust Jenkins configuration to allow more memory per JVM

[noreply] [BEAM-14553] Add destination coder to FileResultCoder components

[noreply] copyedited README for RunInference examples (#21855)

[noreply] Document and test overriding batch type inference (#21844)

[noreply] Update references to Jira to GH for the Python SDK (#21831)

[noreply] add highlights to changes (#21865)

[noreply] Merge pull request #21793: [21794 ] Fix output timestamp in Dataflow.

[noreply] Adding more info to the sdk_worker_parallelism description (#21839)

[noreply] Add Bert Language Modeling example (#21818)

[noreply] [BEAM-14524] Returning NamedTuple from RunInference transform (#17773)

[noreply] Unit tests for RunInference keyed/unkeyed Modelhandler and examples

[noreply] Remove kwargs and add explicit runinference_args (#21806)

[noreply] Modify README for 3 pytorch examples (#21871)

[noreply] Sickbay Pytorch example IT test (#21857)

[noreply] Add required=True to Pytorch image classification example (#21883)

[egalpin] Drops usage of setWindowingStrategyInternal in favour of direct use of

[noreply] Switch go todos from issue # syntax to links (#21890)

[Valentyn Tymofieiev] Rollback dill.

[johnjcasey] 21742 add warning for risky kafka configuration

[johnjcasey] 21742 run spotless

[yathu] Unsickbay copy_rewrite_token tests

[noreply] Add Pytorch image segmentation example (#21766)

[noreply] Add README documentation for scikit-learn MNIST example (#21887)

[noreply] Decompose labels for new issues (#21888)

[noreply] Use Go 1.18 for go-licenses (#21896)

[egalpin] Gives unique names to ES IO Write windowing

[noreply] [BEAM-12903] Cron job to cleanup Dataproc leaked resources (#21779)

[noreply] [BEAM-7209][BEAM-9351][BEAM-9428] Upgrade Hive to version 3.1.3 (#17749)

[noreply] Sharding IO tests (Kafka, Debezium, JDBC, Kinesis, Neo4j) from the

[yathu] [BEAM-3177][BEAM-5468] Add pipeline options to set default logging level

[noreply] Merge pull request #17604 from [BEAM-14315] Match updated files

[noreply] Merge pull request #21781 from Sklearn Mnist example and IT test

[Pablo Estrada] Update Python base image requirements

[noreply] Get the latest version of go-licenses (#21901)

[noreply] Hide internal helpers added to DoFn for batched DoFns (#21860)

[noreply] Updated documentation for ml.inference docs. (#21868)

[Pablo Estrada] Moving to 2.41.0-SNAPSHOT on master branch.

[noreply] Add a type hint to nexmark query 3 joinFn (#21873)

[Kenneth Knowles] Revert "convert windmill min timestamp to beam min timestamp"

[noreply] Fix a few small config issues (#21909)

[Danny McCormick] Update py to python label

[noreply] Daily p0/p1/flaky reports for issues (#21725)

[noreply] Remove dataframe warnings from py38-docs logs (#21861)

[noreply] Update references to Jira to GH for the Java SDK (#21836)

[noreply] [21709] - Fix for "beam_PostCommit_Java_ValidatesRunner_Samza Failing"

[noreply] Update references to jira to GH for the Runners (#21835)

[noreply] Update remaining references to Jira to GH (#21834)

[ahmedabualsaud] test fixes

[ahmedabualsaud] no need for this line

[Kenneth Knowles] Re-activate nullness checking for some of sdks/java/core/coders

[Kenneth Knowles] Suppress unneeded spotbugs unused store warnings

[Kenneth Knowles] Eliminate nullness errors in KafkaIO

[yathu] Fix beam_PostCommit_Java_Sickbay build

[Alexey Romanenko] [BEAM-12918] Add PostCommit_Java_Tpcds_Flink job

[noreply] Expand pr bot to python (#21791)

[noreply] Update run inference documentation (#21921)

[noreply] Consider skipped checks successful (#21924)

[bulat.safiullin] [Website] add publishdate attribute to frontmatter

[noreply] Add guidance on self-assigning/closing to issue templates (#21931)

[rszper] Correcting the regex for the Dataflow job name.

[noreply] Update names.py

[noreply] [Website] add new case-study, fix styles, add related images (#21891)

[noreply] Merge pull request #21928 from [Fixes #21927] Compress

[noreply] BigQueryIO: Adding the BASIC view setting to getTable request  (#21879)

[Pablo Estrada] Removing playground from main page to remove scrolling issue

[noreply] Merge pull request #21940 from [21941] Fix no output timestamp case

[Pablo Estrada] Blog post and updates for release 2.40.0

[noreply] Modified KafkaIO.Read SDF->Legacy forced override to fail if configured

[noreply] Canonicalize standard_coders.yaml booleans

[alexey.inkin] Do not re-create PlaygroundState (#21950)

[noreply] [BEAM-13590]Update Pytest version to support Python 3.10 (#17791)

[noreply] Fix target email for flaky test/p0/p1 reports

[noreply] Add unit testing for graphx/user.go (#21962)

[bulat.safiullin] [Website] add lyft to quote cards on homepage, use relative paths for

[noreply] Update documentations and document generation (#21965)

[noreply] Add ExecuteBundles transform to Go FhirIO (#21840)

[noreply] Bump cloud.google.com/go/datastore from 1.6.0 to 1.8.0 in /sdks (#21973)

[noreply] Bump google.golang.org/api from 0.83.0 to 0.85.0 in /sdks (#21974)

[noreply] [Go SDK] Adds a snippet for GBK in BPG (#21842)

[noreply] Update parameterized requirement in /sdks/python (#21975)

[noreply] Merge pull request #21981 from [Playground] Upgrade Flutter linter, fix

[andyye333] Move wrapper class outside run()

[noreply] Clean up redundant articles, prepositions, conjunctions appeared

[noreply] Fix FlatMap numpy array bug (#22006)

[Robert Bradshaw] More strongly typed outputs.

[alexey.inkin] Add an abstract layer for analytics, fix logging change of snippet, fix

[noreply] Fix issues with test ordering (#21986)

[Robert Bradshaw] spotless

[Robert Bradshaw] Post-merge fix.

[noreply] Followup fix FileIOTest.testMatchWatchForNewFiles flaky (#21877)

[Robert Bradshaw] Fix test expectations.

[noreply] Fix links for issue report (#22033)

[noreply] Merge pull request #21953 from Implement

[bulat.safiullin] [Website] add guard expressions to fix-menu and page-nav

[noreply] Enable close issue as not planned (#22032)

[noreply] Rename README.md to ACTIONS.md (#22043)

[noreply] Removes examples of unscalable sinks from documentation. (#22020)

[noreply] Unify to a single issue report (#22045)

[noreply] Remove colon in issue report

[noreply] Bump cloud.google.com/go/pubsub from 1.22.2 to 1.23.0 in /sdks (#22036)

[noreply] Fix vendored dependency issue and other style checks (#22046)

[noreply] Bump shell-quote (#21983)

[noreply] Revert "[BEAM-13590]Update Pytest version to support Python 3.10

[noreply] Bump cloud.google.com/go/bigquery from 1.32.0 to 1.34.1 in /sdks

[noreply] Bump github.com/spf13/cobra from 1.4.0 to 1.5.0 in /sdks (#21955)

[yathu] checkStlye Fix: remove redundant static and public in interface. camel

[noreply] Fix DEADLINE_EXCEEDED flakiness  (#22035)

[noreply] Fix SpannerIO flakes (#22023)

[noreply] 22011 remove checks on client.close() except when

[noreply] update flutter version to 3.0.1-stable (#22062)

[noreply] Add randomness to integration test job names to avoid collisions

[noreply] Give @pcoet triage permission (#22068)

[noreply] Issue#20877 Updated Interactive Beam README (#22034)

[damondouglas] Implement PubsubSchemaTransformMessageToFactory

[bulat.safiullin] [Website] add scroll-spy to body in case-studies/baseof.html

[noreply] Update issue bot to javascript and add label management (#22067)

[noreply] Clean up issue management doc page

[noreply] [BEAM-13015, #21250, fixes #22053] Improve PCollectionConsumerRegistry

[noreply] sharding GCP IO tests from the javaPostCommit task (#21800)

[noreply] Bump cloud.google.com/go/storage from 1.22.1 to 1.23.0 in /sdks (#22038)

[noreply] Followup sharding javaPostCommit (#22081)

[Moritz Mack] Deprecate runner support for Spark 2.4 (closes #22094)

[noreply] remove mention of dill in release notes as it's not relevant. (#22087)

[noreply] [#21634] Add comments on FieldValueGetter. (#21982)

[noreply] Bump google.golang.org/api from 0.85.0 to 0.86.0 in /sdks (#22092)

[noreply] [BEAM-6597] Replace ProgressRequestCallback with BundleProgressReporter

[noreply] [Go SDK] Go Lint fixes  (#21967)

[noreply] Fix #21869: Close GRPC connections on cancel (#21874)

[noreply] Add FlatMap(<builtin>) known issue to 2.40.0 blog (#22101)

[noreply] [BEAM-14347] Update docs to prefer generic registration functions

[Andrew Pilloud] Projection Pushdown optimizer on by default

[noreply] Merge pull request #21752 from Feature/beam 13852 reimplement with

[noreply] Change wording of Pytorch LM example (#22099)

[noreply] Fix missing model_params in Pytorch docstring  (#22100)

[noreply] Test and fix FlatMap(<builtin>) issue (#22104)

[noreply] Fix InputStream on platform with 4 bytie long (#22107)

[noreply] [BEAM-14187] Fix NPE at initializeForKeyedRead in IsmReaderImpl (#22111)

[noreply] Remove unused legacy dataflow translate code (#22019)

[noreply] Fixes #21698: Use normal Container snapshots for Go Load Tests (#22102)

[noreply] Change default, options, and explanation for issue priority (#22116)

[noreply] Minor: Bump flake8 to 4.0.1 (#22110)

[noreply] Add sdk_harness_log_level_overrides option for python sdk (#22077)

[noreply] Fix typo in Pytorch Bert Language Modeling (#22114)

[noreply] Fix #21977: Add Search transform to Go FhirIO (#21979)

[noreply] Python: Use RowTypeConstraint for normalizing all schema-inferrable user

[noreply] changing nameBase value to Java_GCP_IO_Direct (#22128)

[noreply] Bump dataflow fnapi java sdk version (#22127)

[noreply] Sharding IO tests(amazon web services and amazon web services 2) from

[noreply] Go SDK: Update memfs to parse the List() pattern as a glob, not a regexp

[noreply] Bump cloud.google.com/go/pubsub from 1.23.0 to 1.23.1 in /sdks (#22122)

[noreply] [BEAM-11103] Add blog post for go 2.40 release (#17723)

[noreply] Fix test_row_coder_fail_early_bad_schema fails run after

[noreply] Tune ByteStringCoder allocations (#22144)

[noreply] Enable passing tests on dataflow runner v2. (#22136)

[noreply] Merge pull request #17727 from [BEAM-9482] Fix "provided port is already

[noreply] Fix date for go 2.40 blog post

[noreply] Fix month for 2.40 go blog post

[noreply] [BEAM-14545] Optimize copies in dataflow v1 shuffle reader. (#17802)

[noreply] Tune StreamingModeExecutionContext allocations (#22142)

[noreply] [BEAM-3221] Improve documentation around split request and response

[noreply] Fix documentation about hand implemented global aggregations (#22173)

[noreply] Merge pull request #21872 from Standardizing output of WriteToBigQuery


------------------------------------------
[...truncated 1.12 MB...]

> Task :sdks:java:container:java8:docker
Caching disabled for task ':sdks:java:container:java8:docker' because:
  Gradle would require more information to cache this task
Task ':sdks:java:container:java8:docker' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/container/java8/build/docker> Command: docker build --no-cache --build-arg pull_licenses=true --build-arg java_version=8 -t apache/beam_java8_sdk:2.41.0.dev .
Successfully started process 'command 'docker''
Sending build context to Docker daemon  222.3MB
Step 1/21 : ARG java_version
Step 2/21 : FROM openjdk:${java_version}-bullseye
 ---> 2a8331246713
Step 3/21 : MAINTAINER "Apache Beam <de...@beam.apache.org>"
 ---> Running in c10cce6533bd
Removing intermediate container c10cce6533bd
 ---> 97e7363079ea
Step 4/21 : ARG pull_licenses
 ---> Running in 7dec44d773e6
Removing intermediate container 7dec44d773e6
 ---> 93f133cb5ada
Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
 ---> 098695c2eb31
Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
 ---> 649e872aba4b
Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
 ---> 66acb6794bab
Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> abaed1a96ecf
Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> 5607eb3d8455
Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/
 ---> c13e6376d5b0
Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 97e381d07992
Step 12/21 : COPY target/LICENSE /opt/apache/beam/
 ---> b43a718a7d13
Step 13/21 : COPY target/NOTICE /opt/apache/beam/
 ---> 63c50b48a737
Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
 ---> a8aeb8fc4daf
Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/
 ---> 480f58df4098
Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE
 ---> Running in 5f0e86f939c4
Removing intermediate container 5f0e86f939c4
 ---> 827b1d15feca
Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 49e8832f974e
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 70fc79ca09c2
Removing intermediate container 70fc79ca09c2
 ---> c0a02d87e1eb
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in ef8b1fa19a01
Removing intermediate container ef8b1fa19a01
 ---> bb2b1d107abb
Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/
 ---> b51c26a84f3e
Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 40cad2e917e0
Removing intermediate container 40cad2e917e0
 ---> ea892e004cce
Successfully built ea892e004cce
Successfully tagged apache/beam_java8_sdk:2.41.0.dev
:sdks:java:container:java8:docker (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 13.291 secs.
:runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':' Thread 3,5,main]) started.

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
Custom actions are attached to task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer'.
Caching disabled for task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' because:
  Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker tag apache/beam_java8_sdk:2.41.0.dev us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043
Successfully started process 'command 'docker''
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud docker -- push us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043
Successfully started process 'command 'gcloud''
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
b17ec0f95b8c: Preparing
dfa29f4c14de: Preparing
3c247e41ffdf: Preparing
1423ea1f724c: Preparing
b0eca5498859: Preparing
e1493315ddee: Preparing
c6b9159d7e0f: Preparing
9da658f1f6f5: Preparing
c01e565cf4ce: Preparing
63a1160aa155: Preparing
21a7b7deedf8: Preparing
dcd1218cbbf3: Preparing
554561790a3b: Preparing
89b6eab8cf07: Preparing
5998de09cc22: Preparing
e1493315ddee: Waiting
89f3c2569d89: Preparing
c6b9159d7e0f: Waiting
cc63c81d3b06: Preparing
c01e565cf4ce: Waiting
369123a7ed65: Preparing
9da658f1f6f5: Waiting
5afd661c6106: Preparing
63a1160aa155: Waiting
66183893ba24: Preparing
6840c8ff46bd: Preparing
dcd1218cbbf3: Waiting
89b6eab8cf07: Waiting
97d5fec864d8: Preparing
5998de09cc22: Waiting
21a7b7deedf8: Waiting
89f3c2569d89: Waiting
cc63c81d3b06: Waiting
369123a7ed65: Waiting
66183893ba24: Waiting
97d5fec864d8: Waiting
b0eca5498859: Pushed
dfa29f4c14de: Pushed
1423ea1f724c: Pushed
3c247e41ffdf: Pushed
b17ec0f95b8c: Pushed
c6b9159d7e0f: Pushed
9da658f1f6f5: Pushed
63a1160aa155: Pushed
dcd1218cbbf3: Pushed
c01e565cf4ce: Pushed
21a7b7deedf8: Pushed
89f3c2569d89: Layer already exists
cc63c81d3b06: Layer already exists
369123a7ed65: Layer already exists
5afd661c6106: Layer already exists
66183893ba24: Layer already exists
6840c8ff46bd: Layer already exists
97d5fec864d8: Layer already exists
5998de09cc22: Pushed
89b6eab8cf07: Pushed
e1493315ddee: Pushed
554561790a3b: Pushed
20220707012043: digest: sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99 size: 4935
:runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 12.052 secs.
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) started.
producer locations for task group 0 (Thread[included builds,5,main]) started.
producer locations for task group 0 (Thread[included builds,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 3 started executing tests.

> Task :sdks:java:io:kafka:integrationTest
Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'.
Build cache key for task ':sdks:java:io:kafka:integrationTest' is e6165017453708c90acedc4195d1bcc0
Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because:
  Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 3'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=34.68.207.198:32401,35.184.253.158:32403,34.134.10.248:32404","--kafkaTopic=beam-runnerv2","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=use_runner_v2,shuffle_mode=appliance,use_unified_****","--sdkContainerImage=us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043","--region=us-central1"] -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.4/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 3'
Successfully started process 'Gradle Test Executor 3'

org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.41.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]

Gradle Test Executor 3 finished executing tests.

> Task :sdks:java:io:kafka:integrationTest FAILED

org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
    java.lang.IllegalStateException: withTopic() is required
        at org.apache.beam.sdk.util.Preconditions.checkStateNotNull(Preconditions.java:471)
        at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2906)
        at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2699)
        at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
        at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
        at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:376)
        at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:173)

1 test completed, 1 failed
Finished generating test XML results (0.005 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.005 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 3.841 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':' Thread 3,5,main]) started.

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
  Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043
Successfully started process 'command 'gcloud''
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707012043] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2e0b2a335933ab60ea7b4c2f35f386c780d1867e87df942bcaca0f0168677c99].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 8.936 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':' Thread 3,5,main]) started.

> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1m 58s
156 actionable tasks: 18 executed, 1 from cache, 137 up-to-date

Publishing build scan...
https://gradle.com/s/jvzi7l2f7ud6w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PerformanceTests_Kafka_IO #2794

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2794/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #2793

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2793/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] add refresh to page-nav.js

[noreply] Propogate error messages from GcsUtil (#22079)

[noreply] Reenable Jenkins comment triggers (#22169)

[noreply] Add `schema_options` and `field_options` on RowTypeConstraint (#22133)


------------------------------------------
[...truncated 1.12 MB...]
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/container/java8/build/docker> Command: docker build --no-cache --build-arg pull_licenses=true --build-arg java_version=8 -t apache/beam_java8_sdk:2.41.0.dev .
Successfully started process 'command 'docker''
Sending build context to Docker daemon  222.3MB
Step 1/21 : ARG java_version
Step 2/21 : FROM openjdk:${java_version}-bullseye
 ---> 2a8331246713
Step 3/21 : MAINTAINER "Apache Beam <de...@beam.apache.org>"
 ---> Running in 036a047c6103
Removing intermediate container 036a047c6103
 ---> b5c958825be1
Step 4/21 : ARG pull_licenses
 ---> Running in 98559f3f124d
Removing intermediate container 98559f3f124d
 ---> 818abcdaa544
Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
 ---> 905c42d7fbec
Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
 ---> d10eccdadafd
Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
 ---> 5405b861d6fa
Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> 36575f2249d6
Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> 1d4178cbd263
Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/
 ---> c198d5f92f79
Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 716c3a5f4458
Step 12/21 : COPY target/LICENSE /opt/apache/beam/
 ---> 92c626502cb5
Step 13/21 : COPY target/NOTICE /opt/apache/beam/
 ---> f733f6562d42
Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
 ---> ec509e61c2f9
Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/
 ---> 479ff613ecb4
Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE
 ---> Running in e484b046e1b2
Removing intermediate container e484b046e1b2
 ---> 85fabe54e165
Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> ea4712c7855e
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 62c311f83c43
Removing intermediate container 62c311f83c43
 ---> f376721066d3
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in 5d877836b07e
Removing intermediate container 5d877836b07e
 ---> c2e0089e675d
Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/
 ---> b8bbc4d7a009
Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 998a12b39896
Removing intermediate container 998a12b39896
 ---> 6f4110802bd1
Successfully built 6f4110802bd1
Successfully tagged apache/beam_java8_sdk:2.41.0.dev
:sdks:java:container:java8:docker (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 19.406 secs.
:runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':' Thread 7,5,main]) started.

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
Custom actions are attached to task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer'.
Caching disabled for task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' because:
  Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker tag apache/beam_java8_sdk:2.41.0.dev us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129
Successfully started process 'command 'docker''
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud docker -- push us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129
Successfully started process 'command 'gcloud''
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
738391b73149: Preparing
61c851dc1c4d: Preparing
5daced3d5774: Preparing
4ef504ba8393: Preparing
cc956d2017e1: Preparing
d40163cad970: Preparing
596c13cdfa47: Preparing
f1a00f503751: Preparing
c2f965859184: Preparing
28cde5973f7e: Preparing
68d3cf9a81b8: Preparing
855ebed82db9: Preparing
4955111d9bfb: Preparing
1cd8ed967077: Preparing
7459b6316aa7: Preparing
89f3c2569d89: Preparing
cc63c81d3b06: Preparing
369123a7ed65: Preparing
5afd661c6106: Preparing
66183893ba24: Preparing
6840c8ff46bd: Preparing
97d5fec864d8: Preparing
d40163cad970: Waiting
596c13cdfa47: Waiting
f1a00f503751: Waiting
c2f965859184: Waiting
28cde5973f7e: Waiting
68d3cf9a81b8: Waiting
855ebed82db9: Waiting
4955111d9bfb: Waiting
1cd8ed967077: Waiting
cc63c81d3b06: Waiting
7459b6316aa7: Waiting
5afd661c6106: Waiting
89f3c2569d89: Waiting
369123a7ed65: Waiting
97d5fec864d8: Waiting
66183893ba24: Waiting
6840c8ff46bd: Waiting
cc956d2017e1: Pushed
61c851dc1c4d: Pushed
4ef504ba8393: Pushed
5daced3d5774: Pushed
738391b73149: Pushed
f1a00f503751: Pushed
596c13cdfa47: Pushed
d40163cad970: Pushed
28cde5973f7e: Pushed
c2f965859184: Pushed
68d3cf9a81b8: Pushed
855ebed82db9: Pushed
89f3c2569d89: Layer already exists
cc63c81d3b06: Layer already exists
369123a7ed65: Layer already exists
5afd661c6106: Layer already exists
66183893ba24: Layer already exists
6840c8ff46bd: Layer already exists
97d5fec864d8: Layer already exists
1cd8ed967077: Pushed
7459b6316aa7: Pushed
4955111d9bfb: Pushed
20220707191129: digest: sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc size: 4935
:runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 14.494 secs.
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** for ':' Thread 5,5,main]) started.
producer locations for task group 0 (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 2 started executing tests.

> Task :sdks:java:io:kafka:integrationTest
Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'.
Build cache key for task ':sdks:java:io:kafka:integrationTest' is f45a71bf56df102095197b470e341004
Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because:
  Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=35.225.227.56:32401,35.222.178.165:32403,104.154.63.14:32404","--kafkaTopic=beam-runnerv2","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=use_runner_v2,shuffle_mode=appliance,use_unified_****","--sdkContainerImage=us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129","--region=us-central1"] -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.4/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2'
Successfully started process 'Gradle Test Executor 2'

org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.41.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]

Gradle Test Executor 2 finished executing tests.

> Task :sdks:java:io:kafka:integrationTest

org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
    java.lang.IllegalStateException: withTopic() is required
        at org.apache.beam.sdk.util.Preconditions.checkStateNotNull(Preconditions.java:471)
        at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2906)
        at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2699)
        at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
        at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
        at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:376)
        at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:173)

1 test completed, 1 failed
Finished generating test XML results (0.006 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.006 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>

> Task :sdks:java:io:kafka:integrationTest FAILED
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 4.983 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':' Thread 5,5,main]) started.

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
  Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129
Successfully started process 'command 'gcloud''
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 9.088 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':' Thread 5,5,main]) started.

> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1m 48s
156 actionable tasks: 18 executed, 1 from cache, 137 up-to-date

Publishing build scan...
https://gradle.com/s/lz3oltnjj64du

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #2792

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2792/display/redirect>

Changes:


------------------------------------------
[...truncated 16.85 KB...]
+ read -r usedPort
+ '[' 32404 = 30544 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30695 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30706 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31851 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31058 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31659 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31005 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 32267 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31425 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 32402 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31333 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30251 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31035 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31605 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31565 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30885 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30673 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 32219 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30855 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30419 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 30746 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 32491 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 32676 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31352 ']'
+ IFS=
+ read -r usedPort
+ '[' 32404 = 31977 ']'
+ IFS=
+ read -r usedPort
+ false
+ echo 32404
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins2436593601987209666.sh
+ sed -i -e s/32400/32401/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml>
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins1391048525983215024.sh
+ sed -i -e s/32401/32403/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml>
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4309528127218357046.sh
+ sed -i -e s/32402/32404/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml>
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins9088494525109892004.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster>
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2792
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792'
+ apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster>
+ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster'>
++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster>
storageclass.storage.k8s.io/kafka-broker unchanged
storageclass.storage.k8s.io/kafka-zookeeper unchanged
clusterrole.rbac.authorization.k8s.io/node-reader unchanged
clusterrolebinding.rbac.authorization.k8s.io/kafka-node-reader configured
role.rbac.authorization.k8s.io/pod-labler created
rolebinding.rbac.authorization.k8s.io/kafka-pod-labler created
configmap/zookeeper-config created
service/pzoo created
service/zookeeper created
statefulset.apps/pzoo created
service/outside-0 created
service/outside-1 created
service/outside-2 created
configmap/broker-config created
service/broker created
service/bootstrap created
statefulset.apps/kafka created
configmap/kafka-config created
job.batch/kafka-config-eff079ec created
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins6487759204249088846.sh
+ set -eo pipefail
+ eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-0
++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-0
+ sed 's/^/KAFKA_BROKER_0=/'
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2792
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792'
+ loadBalancerIP outside-0
+ local name=outside-0
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 1 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 2 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 3 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=34.123.196.223
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 34.123.196.223 ]]
+ echo 34.123.196.223
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins6357954215754908092.sh
+ set -eo pipefail
+ eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1
++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1
+ sed 's/^/KAFKA_BROKER_1=/'
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2792
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792'
+ loadBalancerIP outside-1
+ local name=outside-1
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=35.184.195.112
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 35.184.195.112 ]]
+ echo 35.184.195.112
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins5538738479726305326.sh
+ set -eo pipefail
+ eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2
++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2
+ sed 's/^/KAFKA_BROKER_2=/'
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2792
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792'
+ loadBalancerIP outside-2
+ local name=outside-2
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=34.136.245.193
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 34.136.245.193 ]]
+ echo 34.136.245.193
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins6673669561777902443.sh
+ eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> waitForJob job.batch/kafka-config-eff079ec 40m
++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> waitForJob job.batch/kafka-config-eff079ec 40m
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2792
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792'
+ waitForJob job.batch/kafka-config-eff079ec 40m
+ echo 'Waiting for job completion...'
Waiting for job completion...
+ jobName=job.batch/kafka-config-eff079ec
+ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 wait --for=condition=complete --timeout=40m job.batch/kafka-config-eff079ec'
++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2792> --namespace=beam-performancetests-kafka-io-2792 wait --for=condition=complete --timeout=40m job.batch/kafka-config-eff079ec
error: timed out waiting for the condition on jobs/kafka-config-eff079ec
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #2791

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2791/display/redirect>

Changes:


------------------------------------------
[...truncated 1.12 MB...]
Caching disabled for task ':sdks:java:container:java8:docker' because:
  Gradle would require more information to cache this task
Task ':sdks:java:container:java8:docker' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/container/java8/build/docker> Command: docker build --no-cache --build-arg pull_licenses=true --build-arg java_version=8 -t apache/beam_java8_sdk:2.41.0.dev .
Successfully started process 'command 'docker''
Sending build context to Docker daemon  222.3MB
Step 1/21 : ARG java_version
Step 2/21 : FROM openjdk:${java_version}-bullseye
 ---> 2a8331246713
Step 3/21 : MAINTAINER "Apache Beam <de...@beam.apache.org>"
 ---> Running in 4bc26501327a
Removing intermediate container 4bc26501327a
 ---> 8b05e70770d0
Step 4/21 : ARG pull_licenses
 ---> Running in e7916b42587c
Removing intermediate container e7916b42587c
 ---> 77f76e9a7b21
Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
 ---> 634b08f16cd1
Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
 ---> 11f7de1d773f
Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
 ---> 1eb11f4239a7
Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> 556b66e2745c
Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> 096c32081461
Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/
 ---> d946560538b8
Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 3d4fe20c409e
Step 12/21 : COPY target/LICENSE /opt/apache/beam/
 ---> 068a5867b3e7
Step 13/21 : COPY target/NOTICE /opt/apache/beam/
 ---> 41c557362e8a
Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
 ---> 87015de700ce
Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/
 ---> 007018a55398
Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE
 ---> Running in 94dc540f2b6c
Removing intermediate container 94dc540f2b6c
 ---> 3c64afc1e4cc
Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> c463cb4d4ecd
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in a2d04cb290d1
Removing intermediate container a2d04cb290d1
 ---> d9f7eadee9ba
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in da09c3b4588a
Removing intermediate container da09c3b4588a
 ---> 817dd4eec1b3
Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/
 ---> 44e7fab17350
Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 9b28c5ecb399
Removing intermediate container 9b28c5ecb399
 ---> fb1e68754801
Successfully built fb1e68754801
Successfully tagged apache/beam_java8_sdk:2.41.0.dev
:sdks:java:container:java8:docker (Thread[Execution **** for ':',5,main]) completed. Took 14.051 secs.
:runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':',5,main]) started.

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
Custom actions are attached to task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer'.
Caching disabled for task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' because:
  Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker tag apache/beam_java8_sdk:2.41.0.dev us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924
Successfully started process 'command 'docker''
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud docker -- push us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924
Successfully started process 'command 'gcloud''
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
cf6e6c589177: Preparing
b3728ed6f7bd: Preparing
491aa47a3e58: Preparing
67a538331751: Preparing
9c2de4a9fcae: Preparing
f3cc9eca9fc2: Preparing
abdbae15a503: Preparing
ec54c80c5064: Preparing
85386615e908: Preparing
272db8b29edf: Preparing
8ad85841093a: Preparing
ae9ff0ceef39: Preparing
335e97acfb96: Preparing
d2d8b76fde69: Preparing
6e15222c5ef1: Preparing
89f3c2569d89: Preparing
cc63c81d3b06: Preparing
369123a7ed65: Preparing
8ad85841093a: Waiting
abdbae15a503: Waiting
5afd661c6106: Preparing
66183893ba24: Preparing
85386615e908: Waiting
6840c8ff46bd: Preparing
97d5fec864d8: Preparing
89f3c2569d89: Waiting
ae9ff0ceef39: Waiting
335e97acfb96: Waiting
6e15222c5ef1: Waiting
d2d8b76fde69: Waiting
369123a7ed65: Waiting
97d5fec864d8: Waiting
cc63c81d3b06: Waiting
6840c8ff46bd: Waiting
66183893ba24: Waiting
272db8b29edf: Waiting
5afd661c6106: Waiting
ec54c80c5064: Waiting
9c2de4a9fcae: Pushed
b3728ed6f7bd: Pushed
491aa47a3e58: Pushed
67a538331751: Pushed
cf6e6c589177: Pushed
ec54c80c5064: Pushed
abdbae15a503: Pushed
272db8b29edf: Pushed
f3cc9eca9fc2: Pushed
8ad85841093a: Pushed
85386615e908: Pushed
89f3c2569d89: Layer already exists
ae9ff0ceef39: Pushed
cc63c81d3b06: Layer already exists
369123a7ed65: Layer already exists
5afd661c6106: Layer already exists
66183893ba24: Layer already exists
6840c8ff46bd: Layer already exists
97d5fec864d8: Layer already exists
d2d8b76fde69: Pushed
6e15222c5ef1: Pushed
335e97acfb96: Pushed
20220707070924: digest: sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330 size: 4935
:runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':',5,main]) completed. Took 12.004 secs.
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':',5,main]) started.
producer locations for task group 0 (Thread[Execution **** for ':' Thread 2,5,main]) started.
producer locations for task group 0 (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 2 started executing tests.

> Task :sdks:java:io:kafka:integrationTest
Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'.
Build cache key for task ':sdks:java:io:kafka:integrationTest' is e6165017453708c90acedc4195d1bcc0
Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because:
  Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=34.71.160.241:32401,35.188.60.81:32403,35.238.233.84:32404","--kafkaTopic=beam-runnerv2","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=use_runner_v2,shuffle_mode=appliance,use_unified_****","--sdkContainerImage=us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924","--region=us-central1"] -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.4/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2'
Successfully started process 'Gradle Test Executor 2'

org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.41.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]

Gradle Test Executor 2 finished executing tests.

> Task :sdks:java:io:kafka:integrationTest FAILED

org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
    java.lang.IllegalStateException: withTopic() is required
        at org.apache.beam.sdk.util.Preconditions.checkStateNotNull(Preconditions.java:471)
        at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2906)
        at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2699)
        at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548)
        at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499)
        at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:376)
        at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:173)

1 test completed, 1 failed
Finished generating test XML results (0.004 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.004 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':',5,main]) completed. Took 3.827 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':',5,main]) started.

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
  Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
  Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924
Successfully started process 'command 'gcloud''
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':',5,main]) completed. Took 8.118 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':',5,main]) started.

> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1m 16s
156 actionable tasks: 18 executed, 1 from cache, 137 up-to-date

Publishing build scan...
https://gradle.com/s/me5n3ydpf4qxi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org