You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ie...@apache.org on 2020/12/31 14:01:06 UTC

[beam] branch master updated (48673e8 -> cf74313)

This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 48673e8  [BEAM-11533] Add logic to convert Beam schema to DataCatalog schema to SchemaUtils (#13588)
     add a7301b7  [BEAM-11527] Add builder parameter to allow user defined Hadoop ReadSupport flags in Hadoop Configuration.
     add ff5a094  Consistency improvements and other fixes
     new cf74313  Merge pull request #13619: [BEAM-11527] Allow user defined Hadoop ReadSupport flags for ParquetReader

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../sdk/io/hadoop/SerializableConfiguration.java   |  11 +++
 .../io/hadoop/SerializableConfigurationTest.java   |   9 ++
 .../org/apache/beam/sdk/io/parquet/ParquetIO.java  | 105 +++++++++++++++------
 .../apache/beam/sdk/io/parquet/ParquetIOTest.java  |   2 +-
 4 files changed, 99 insertions(+), 28 deletions(-)


[beam] 01/01: Merge pull request #13619: [BEAM-11527] Allow user defined Hadoop ReadSupport flags for ParquetReader

Posted by ie...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit cf7431368f932e496afcb3a3063b5cd60c152903
Merge: 48673e8 ff5a094
Author: Ismaël Mejía <ie...@gmail.com>
AuthorDate: Thu Dec 31 14:59:24 2020 +0100

    Merge pull request #13619: [BEAM-11527] Allow user defined Hadoop ReadSupport flags for ParquetReader

 .../sdk/io/hadoop/SerializableConfiguration.java   |  11 +++
 .../io/hadoop/SerializableConfigurationTest.java   |   9 ++
 .../org/apache/beam/sdk/io/parquet/ParquetIO.java  | 105 +++++++++++++++------
 .../apache/beam/sdk/io/parquet/ParquetIOTest.java  |   2 +-
 4 files changed, 99 insertions(+), 28 deletions(-)