You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@iceberg.apache.org by ao...@apache.org on 2021/04/22 16:14:25 UTC

[iceberg] branch master updated (b0e33dc -> e87309c)

This is an automated email from the ASF dual-hosted git repository.

aokolnychyi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git.


    from b0e33dc  Core: Fix NPE caused by Unboxing a Null in ManifestFileUtil (#2492) (#2495)
     add e87309c  Spark: Add SparkRewriteBuilder for rewriting a set of files (#2500)

No new revisions were added by this update.

Summary of changes:
 .../apache/iceberg/spark/SparkWriteOptions.java    |   3 +
 .../iceberg/spark/FileRewriteCoordinator.java      | 149 +++++++++++++
 .../iceberg/spark/source/SparkRewriteBuilder.java  |  60 ++++++
 .../apache/iceberg/spark/source/SparkTable.java    |   8 +-
 .../apache/iceberg/spark/source/SparkWrite.java    |  28 +++
 .../iceberg/spark/TestFileRewriteCoordinator.java  | 234 +++++++++++++++++++++
 6 files changed, 481 insertions(+), 1 deletion(-)
 create mode 100644 spark3/src/main/java/org/apache/iceberg/spark/FileRewriteCoordinator.java
 create mode 100644 spark3/src/main/java/org/apache/iceberg/spark/source/SparkRewriteBuilder.java
 create mode 100644 spark3/src/test/java/org/apache/iceberg/spark/TestFileRewriteCoordinator.java