You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by vb...@apache.org on 2020/08/09 21:06:23 UTC

[hudi] branch master updated (c24c528 -> e4a2d98)

This is an automated email from the ASF dual-hosted git repository.

vbalaji pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.


    from c24c528  [HUDI-1156] Remove unused dependencies from HoodieDeltaStreamerWrapper Class (#1927)
     add e4a2d98  [HUDI-426] Bootstrap datasource integration (#1702)

No new revisions were added by this update.

Summary of changes:
 hudi-cli/pom.xml                                   |   4 +
 hudi-client/pom.xml                                |   5 +
 .../client/bootstrap/BootstrapSchemaProvider.java  |  43 +-
 .../apache/hudi/config/HoodieBootstrapConfig.java  |   6 +
 .../bootstrap/BootstrapCommitActionExecutor.java   |   1 +
 .../java/org/apache/hudi/avro/HoodieAvroUtils.java |  22 +
 .../hudi/common/model/HoodieCommitMetadata.java    |  13 +
 .../SparkParquetBootstrapDataProvider.java         |   3 +-
 .../org/apache/hudi/AvroConversionUtils.scala      |   6 +
 .../scala/org/apache/hudi/DataSourceOptions.scala  |   3 +
 .../main/scala/org/apache/hudi/DefaultSource.scala |  95 +++-
 .../scala/org/apache/hudi/HoodieBootstrapRDD.scala | 131 +++++
 .../org/apache/hudi/HoodieBootstrapRelation.scala  | 185 ++++++
 .../org/apache/hudi/HoodieSparkSqlWriter.scala     | 144 +++--
 .../org/apache/hudi/IncrementalRelation.scala      |  94 ++-
 .../functional/TestDataSourceForBootstrap.scala    | 630 +++++++++++++++++++++
 .../functional/TestHoodieDeltaStreamer.java        |  17 +-
 17 files changed, 1288 insertions(+), 114 deletions(-)
 create mode 100644 hudi-spark/src/main/scala/org/apache/hudi/HoodieBootstrapRDD.scala
 create mode 100644 hudi-spark/src/main/scala/org/apache/hudi/HoodieBootstrapRelation.scala
 create mode 100644 hudi-spark/src/test/scala/org/apache/hudi/functional/TestDataSourceForBootstrap.scala