You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/12/26 03:05:10 UTC
[beam] tag nightly-master updated (b0e3d36 -> b6243e7)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from b0e3d36 (commit)
to b6243e7 (commit)
from b0e3d36 Merge pull request #13615 from [BEAM-11524] Remove usages of WriteStringsToPubSub in examples
add 75e167e [BEAM-11460] Implement reading unknown schema files for ParquetIO
add 0686879 Update ParquertIO capability in CHANGES.md
add de6d268 improve backward compatibility by creating separate `Parse<T>` and `ParseFiles<T>` implementation for supporting files with unknown schema.
add 431831b Fix review comments by @iemejia
add 6faeda3 Make GenericRecordPassthroughFn singleton
add afe11c6 fix spotless Apply
add 38eeec9 Merge pull request 2.27.0 from apache/master
add e4c3c94 Move ParquetIO Changes to 2.28.0
add 0d344ba Make passthroughfunction singleton by making the class with private constructor.
add 8149158 Merge pull request #13616: [BEAM-11460] Support reading Parquet files with unknown schema
add 98ee1f1 Cache UnboundedReader per CheckpointMark in SDF Wrapper DoFn.
add b6243e7 Merge pull request #13592 from [BEAM-11403] Cache UnboundedReader per UnboundedSourceRestriction in SDF Wrapper DoFn.
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 1 +
.../src/main/java/org/apache/beam/sdk/io/Read.java | 96 ++++++---
.../org/apache/beam/sdk/testing/TestPipeline.java | 45 ++++
.../test/java/org/apache/beam/sdk/io/ReadTest.java | 130 +++++++++++
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 238 ++++++++++++++++++++-
.../apache/beam/sdk/io/parquet/ParquetIOTest.java | 102 ++++++++-
6 files changed, 577 insertions(+), 35 deletions(-)