You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by si...@apache.org on 2022/03/07 20:38:56 UTC
[hudi] branch master updated (f0bcee3 -> a66fd40)

This is an automated email from the ASF dual-hosted git repository.

sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.


    from f0bcee3  [HUDI-3561] Avoid including whole `MultipleSparkJobExecutionStrategy` object into the closure for Spark to serialize (#4954)
     add a66fd40  [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS (#4739)

No new revisions were added by this update.

Summary of changes:
 .../apache/hudi/client/BaseHoodieWriteClient.java  | 161 ++++++++++++++++-----
 .../org/apache/hudi/io/HoodieAppendHandle.java     |   2 +
 .../org/apache/hudi/io/HoodieCreateHandle.java     |  25 ++--
 .../apache/hudi/client/HoodieFlinkWriteClient.java |  41 ++----
 .../apache/hudi/client/HoodieJavaWriteClient.java  |  41 ++----
 .../table/upgrade/JavaUpgradeDowngradeHelper.java} |  18 +--
 .../apache/hudi/client/SparkRDDWriteClient.java    |  85 +++--------
 .../java/org/apache/hudi/table/TestCleaner.java    |   4 +
 .../hudi/testutils/HoodieClientTestHarness.java    |  17 +--
 .../apache/hudi/common/util/CollectionUtils.java   |   4 +-
 .../hudi/metadata/HoodieMetadataPayload.java       |  88 ++++++++---
 .../hudi/metadata/HoodieTableMetadataUtil.java     |  79 ++++++----
 .../hudi/common/testutils/FileCreateUtils.java     |   2 +-
 .../hudi/common/testutils/HoodieTestTable.java     |   2 +
 .../sink/TestStreamWriteOperatorCoordinator.java   |  20 +--
 ...Suite.java => SparkRDDWriteClientOverride.java} |  24 ++-
 .../org/apache/hudi/functional/TestBootstrap.java  |   6 +-
 .../apache/hudi/functional/TestOrcBootstrap.java   |   6 +-
 18 files changed, 351 insertions(+), 274 deletions(-)
 copy hudi-client/{hudi-flink-client/src/main/java/org/apache/hudi/table/upgrade/FlinkUpgradeDowngradeHelper.java => hudi-java-client/src/main/java/org/apache/hudi/table/upgrade/JavaUpgradeDowngradeHelper.java} (72%)
 copy hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/functional/{HoodieSparkFunctionalTestSuite.java => SparkRDDWriteClientOverride.java} (52%)