You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by bl...@apache.org on 2020/04/10 19:03:00 UTC
[incubator-iceberg] branch master updated (d8dfb27 -> bedc9c7)
This is an automated email from the ASF dual-hosted git repository.
blue pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-iceberg.git.
from d8dfb27 Use only guava Preconditions (#911)
add bedc9c7 Spark: Implement an action to remove orphan files (#894)
No new revisions were added by this update.
Summary of changes:
.../apache/iceberg/hadoop/HiddenPathFilter.java | 32 +-
.../src/main/java/org/apache/iceberg/Action.java | 13 +-
.../src/main/java/org/apache/iceberg/Actions.java | 28 +-
.../apache/iceberg/RemoveOrphanFilesAction.java | 279 ++++++++++++
.../iceberg/TestRemoveOrphanFilesAction.java | 489 +++++++++++++++++++++
.../spark/source/TestIcebergSourceHiveTables.java | 15 +-
.../spark/source/TestIcebergSourceTablesBase.java | 43 ++
7 files changed, 859 insertions(+), 40 deletions(-)
copy api/src/main/java/org/apache/iceberg/expressions/True.java => core/src/main/java/org/apache/iceberg/hadoop/HiddenPathFilter.java (58%)
copy core/src/main/java/org/apache/iceberg/HasTableOperations.java => spark/src/main/java/org/apache/iceberg/Action.java (78%)
copy core/src/main/java/org/apache/iceberg/RollbackToSnapshot.java => spark/src/main/java/org/apache/iceberg/Actions.java (61%)
create mode 100644 spark/src/main/java/org/apache/iceberg/RemoveOrphanFilesAction.java
create mode 100644 spark/src/test/java/org/apache/iceberg/TestRemoveOrphanFilesAction.java