You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by si...@apache.org on 2022/03/06 20:41:28 UTC

[hudi] branch master updated (4b47177 -> c9ffdc4)

This is an automated email from the ASF dual-hosted git repository.

sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.


    from 4b47177  [HUDI-3520] Introduce DeleteSupportSchemaPostProcessor to support adding _hoodie_is_deleted column to schema (#4921)
     add c9ffdc4  [HUDI-3525] Introduce JsonkafkaSourceProcessor to support data preprocess before it is transformed to DataSet (#4930)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/hudi/utilities/UtilHelpers.java     |  10 ++
 ....java => HoodieSourcePostProcessException.java} |  15 +--
 .../hudi/utilities/sources/JsonKafkaSource.java    |  27 ++++-
 .../utilities/sources/helpers/KafkaOffsetGen.java  |   6 ++
 .../JsonKafkaSourcePostProcessor.java}             |  23 +++--
 .../utilities/sources/TestJsonKafkaSource.java     |  10 +-
 .../sources/TestJsonKafkaSourcePostProcessor.java  | 115 +++++++++++++++++++++
 7 files changed, 183 insertions(+), 23 deletions(-)
 copy hudi-utilities/src/main/java/org/apache/hudi/utilities/exception/{HoodieIncrementalPullException.java => HoodieSourcePostProcessException.java} (76%)
 copy hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/{AvroSource.java => processor/JsonKafkaSourcePostProcessor.java} (60%)
 create mode 100644 hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/TestJsonKafkaSourcePostProcessor.java