You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by ar...@apache.org on 2021/12/19 19:37:43 UTC
[flink] branch master updated (68f2bc3 -> cdf3d48)

This is an automated email from the ASF dual-hosted git repository.

arvid pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.


    from 68f2bc3  [hotfix][hack] Make ChangelogStateBackend randomized tests work with forced full snapshots
     add b4ca350  [FLINK-21406][parquet] Rename ParquetAvroWriters to AvroParquetWriters
     add cdf3d48  [FLINK-21406][parquet] Add AvroParquetReaders to read parquet files into Avro types.

No new revisions were added by this update.

Summary of changes:
 .../file/src/impl/StreamFormatAdapter.java         |  10 +
 flink-formats/flink-parquet/pom.xml                |  18 +-
 .../formats/parquet/avro/AvroParquetReaders.java   | 105 +++++++
 .../parquet/avro/AvroParquetRecordFormat.java      | 234 +++++++++++++++
 ...uetAvroWriters.java => AvroParquetWriters.java} |   5 +-
 .../formats/parquet/avro/ParquetAvroWriters.java   |  37 +--
 .../parquet/avro/AvroParquetFileReadITCase.java    | 171 +++++++++++
 .../parquet/avro/AvroParquetRecordFormatTest.java  | 321 +++++++++++++++++++++
 .../apache/flink/formats/parquet/avro/Datum.java   |  38 ++-
 .../avro/ParquetAvroStreamingFileSinkITCase.java   |  33 ---
 flink-formats/flink-sql-parquet/pom.xml            |   1 -
 11 files changed, 877 insertions(+), 96 deletions(-)
 create mode 100644 flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/avro/AvroParquetReaders.java
 create mode 100644 flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/avro/AvroParquetRecordFormat.java
 copy flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/avro/{ParquetAvroWriters.java => AvroParquetWriters.java} (98%)
 create mode 100644 flink-formats/flink-parquet/src/test/java/org/apache/flink/formats/parquet/avro/AvroParquetFileReadITCase.java
 create mode 100644 flink-formats/flink-parquet/src/test/java/org/apache/flink/formats/parquet/avro/AvroParquetRecordFormatTest.java
 copy flink-walkthroughs/flink-walkthrough-common/src/main/java/org/apache/flink/walkthrough/common/entity/Alert.java => flink-formats/flink-parquet/src/test/java/org/apache/flink/formats/parquet/avro/Datum.java (64%)