You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by vi...@apache.org on 2021/08/10 16:15:51 UTC
[hudi] branch master updated (73d8983 -> 1196736)

This is an automated email from the ASF dual-hosted git repository.

vinoth pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.


    from 73d8983  [MINOR] Fix travis from errors (#3432)
     add 1196736  [HUDI-1129] Improving schema evolution support in hudi (#2927)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/hudi/AvroConversionHelper.scala     |   2 +-
 .../scala/org/apache/hudi/HoodieSparkUtils.scala   |  37 +++-
 .../java/org/apache/hudi/common/fs/FSUtils.java    |  10 +
 .../hudi/common/table/HoodieTableMetaClient.java   |   7 +
 .../hudi/common/table/TableSchemaResolver.java     |  47 +++-
 .../integ/testsuite/reader/SparkBasedReader.java   |  20 +-
 .../scala/org/apache/hudi/DataSourceOptions.scala  |   7 +
 .../SparkParquetBootstrapDataProvider.java         |   4 +-
 .../org/apache/hudi/HoodieSparkSqlWriter.scala     |  37 +++-
 .../scala/org/apache/hudi/HoodieWriterUtils.scala  |  16 +-
 .../apache/hudi/HoodieSparkSqlWriterSuite.scala    |  70 +++---
 .../org/apache/hudi/TestHoodieSparkUtils.scala     | 133 +++++++++++-
 .../apache/hudi/functional/TestCOWDataSource.scala |  62 ++----
 .../org/apache/hudi/utilities/UtilHelpers.java     |  50 ++++-
 .../hudi/utilities/deltastreamer/DeltaSync.java    |  37 ++--
 .../deltastreamer/HoodieDeltaStreamer.java         |  16 +-
 .../deltastreamer/SourceFormatAdapter.java         |   7 +-
 .../utilities/schema/SparkAvroPostProcessor.java   |   4 +-
 .../functional/TestHoodieDeltaStreamer.java        | 239 ++++++++++++++++-----
 .../functional/TestHoodieDeltaStreamerBase.java    |  41 ++--
 .../utilities/testutils/UtilitiesTestBase.java     |   6 +
 .../delta-streamer-config/source_evolved.avsc      |  14 +-
 22 files changed, 650 insertions(+), 216 deletions(-)
 copy hudi-client/hudi-java-client/src/test/resources/testDataGeneratorSchema.txt => hudi-utilities/src/test/resources/delta-streamer-config/source_evolved.avsc (93%)