You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/11/22 03:56:50 UTC
(beam) branch nightly-refs/heads/master updated (32b10670c37 -> 444e10d29e0)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 32b10670c37 Bugfix/override table ref if null (#29471)
add 2fac45517cd Improve File IO Logging (#29485)
add 392a4a13842 Revert the value of MAX_BATCH_OPERATION_SIZE in gcsio (#29503)
add e47054ebd04 Simplify passing custom requirement files. (#29502)
add bb4b633b019 Fix BigQueryStorageWriteApiSchemaTransformProvider null pointer on numStreams (#29434)
add a349e765ff9 Collect metric of message size distribution in KafkaIO read. (#29443)
add 0972bc0170b Propagate correct boundedness when using multiple outputs (#29506)
add 444e10d29e0 Kafka adaptive timeout implementation to handle empty topic cases (#29400)
No new revisions were added by this update.
Summary of changes:
...ueryStorageWriteApiSchemaTransformProvider.java | 9 ++--
.../beam/sdk/io/kafka/KafkaUnboundedReader.java | 27 ++++++++--
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 11 ++++
.../org/apache/beam/sdk/io/kafka/KafkaIOTest.java | 62 ++++++++++++++++++++++
.../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java | 31 +++++++++++
sdks/python/apache_beam/io/fileio.py | 4 +-
sdks/python/apache_beam/io/gcp/gcsio.py | 2 +-
sdks/python/apache_beam/pvalue.py | 7 ++-
sdks/python/apache_beam/transforms/core_test.py | 28 ++++++++++
sdks/python/scripts/run_integration_test.sh | 16 ++----
10 files changed, 176 insertions(+), 21 deletions(-)