You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by ao...@apache.org on 2020/02/03 22:53:58 UTC

[incubator-iceberg] branch master updated (905637d -> c3dc982)

This is an automated email from the ASF dual-hosted git repository.

aokolnychyi pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-iceberg.git.


    from 905637d  Spark: Convert In filter to in expression (#749)
     add c3dc982  Inherit snapshot ids for manifest entries (#675)

No new revisions were added by this update.

Summary of changes:
 .../main/java/org/apache/iceberg/AppendFiles.java  |  13 +-
 .../java/org/apache/iceberg/RewriteManifests.java  |  11 +
 .../org/apache/iceberg/BaseMetastoreCatalog.java   |   2 +-
 .../org/apache/iceberg/BaseRewriteManifests.java   |  52 +++--
 .../java/org/apache/iceberg/DataFilesTable.java    |  42 +---
 .../main/java/org/apache/iceberg/FastAppend.java   |  46 +++-
 .../org/apache/iceberg/GenericManifestFile.java    |  33 ++-
 .../iceberg/GenericPartitionFieldSummary.java      |  25 +-
 .../org/apache/iceberg/InheritableMetadata.java    |   7 +-
 .../apache/iceberg/InheritableMetadataFactory.java |  63 +++++
 .../java/org/apache/iceberg/ManifestEntry.java     |  17 +-
 .../java/org/apache/iceberg/ManifestGroup.java     |   4 +-
 .../java/org/apache/iceberg/ManifestReader.java    |  56 ++++-
 .../java/org/apache/iceberg/ManifestWriter.java    |  10 +-
 .../main/java/org/apache/iceberg/MergeAppend.java  |   6 +
 .../apache/iceberg/MergingSnapshotProducer.java    |  72 ++++--
 .../java/org/apache/iceberg/PartitionSummary.java  |   4 +-
 .../java/org/apache/iceberg/RemoveSnapshots.java   |  23 +-
 .../java/org/apache/iceberg/SnapshotProducer.java  |   3 +-
 .../java/org/apache/iceberg/SnapshotSummary.java   |  10 +
 .../java/org/apache/iceberg/TableProperties.java   |   3 +
 .../java/org/apache/iceberg/TableTestBase.java     |  33 +--
 .../java/org/apache/iceberg/TestFastAppend.java    |  92 ++++++++
 .../org/apache/iceberg/TestManifestReader.java     |  51 ++++
 .../java/org/apache/iceberg/TestMergeAppend.java   | 126 ++++++++++
 .../org/apache/iceberg/TestRewriteManifests.java   | 258 ++++++++++++++++++++-
 .../java/org/apache/iceberg/TestTransaction.java   | 117 ++++++++++
 site/docs/configuration.md                         |   5 +
 .../org/apache/iceberg/spark/SparkTableUtil.scala  |  59 ++---
 .../source/TestIcebergSourceHadoopTables.java      |  55 +++++
 .../spark/source/TestIcebergSourceHiveTables.java  |  61 +++++
 .../iceberg/spark/source/TestParquetWrite.java     |   7 +-
 .../TestSparkTableUtilWithInMemoryCatalog.java     |  45 ++++
 33 files changed, 1206 insertions(+), 205 deletions(-)
 copy api/src/main/java/org/apache/iceberg/Accessor.java => core/src/main/java/org/apache/iceberg/InheritableMetadata.java (86%)
 create mode 100644 core/src/main/java/org/apache/iceberg/InheritableMetadataFactory.java
 create mode 100644 core/src/test/java/org/apache/iceberg/TestManifestReader.java