You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by na...@apache.org on 2021/01/10 01:30:30 UTC

[hudi] branch master updated (65866c4 -> 368c1a8)

This is an automated email from the ASF dual-hosted git repository.

nagarwal pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.


    from 65866c4  [HUDI-1276] [HUDI-1459] Make Clustering/ReplaceCommit and Metadata table be compatible (#2422)
     add 368c1a8  [HUDI-1399] support a independent clustering spark job to asynchronously clustering (#2379)

No new revisions were added by this update.

Summary of changes:
 .../hudi/client/AbstractHoodieWriteClient.java     |  20 +++-
 .../hudi/common/table/TableSchemaResolver.java     |  13 ++-
 .../hudi/common/table/timeline/HoodieTimeline.java |   2 +-
 .../hudi/functional/TestStructuredStreaming.scala  |  27 ++---
 ...odieCompactor.java => HoodieClusteringJob.java} | 116 +++++++++++++--------
 .../org/apache/hudi/utilities/HoodieCompactor.java |  23 ++--
 .../org/apache/hudi/utilities/UtilHelpers.java     |  18 ++++
 .../hudi/utilities/deltastreamer/DeltaSync.java    |   4 +-
 .../functional/TestHoodieDeltaStreamer.java        |  81 ++++++++++++--
 .../delta-streamer-config/clusteringjob.properties |   2 +-
 10 files changed, 221 insertions(+), 85 deletions(-)
 copy hudi-utilities/src/main/java/org/apache/hudi/utilities/{HoodieCompactor.java => HoodieClusteringJob.java} (59%)
 copy hudi-integ-test/src/test/resources/hoodie-docker.properties => hudi-utilities/src/test/resources/delta-streamer-config/clusteringjob.properties (95%)