You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/11/22 03:56:50 UTC

(beam) branch nightly-refs/heads/master updated (32b10670c37 -> 444e10d29e0)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 32b10670c37 Bugfix/override table ref if null (#29471)
     add 2fac45517cd Improve File IO Logging (#29485)
     add 392a4a13842 Revert the value of MAX_BATCH_OPERATION_SIZE in gcsio (#29503)
     add e47054ebd04 Simplify passing custom requirement files. (#29502)
     add bb4b633b019 Fix BigQueryStorageWriteApiSchemaTransformProvider null pointer on numStreams (#29434)
     add a349e765ff9 Collect metric of message size distribution in KafkaIO read. (#29443)
     add 0972bc0170b Propagate correct boundedness when using multiple outputs (#29506)
     add 444e10d29e0 Kafka adaptive timeout implementation to handle empty topic cases (#29400)

No new revisions were added by this update.

Summary of changes:
 ...ueryStorageWriteApiSchemaTransformProvider.java |  9 ++--
 .../beam/sdk/io/kafka/KafkaUnboundedReader.java    | 27 ++++++++--
 .../beam/sdk/io/kafka/ReadFromKafkaDoFn.java       | 11 ++++
 .../org/apache/beam/sdk/io/kafka/KafkaIOTest.java  | 62 ++++++++++++++++++++++
 .../beam/sdk/io/kafka/ReadFromKafkaDoFnTest.java   | 31 +++++++++++
 sdks/python/apache_beam/io/fileio.py               |  4 +-
 sdks/python/apache_beam/io/gcp/gcsio.py            |  2 +-
 sdks/python/apache_beam/pvalue.py                  |  7 ++-
 sdks/python/apache_beam/transforms/core_test.py    | 28 ++++++++++
 sdks/python/scripts/run_integration_test.sh        | 16 ++----
 10 files changed, 176 insertions(+), 21 deletions(-)