You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by gi...@apache.org on 2022/09/30 15:17:44 UTC
[iceberg] branch dependabot/gradle/me.champeau.jmh-jmh-gradle-plugin-0.6.8 updated (938a388343 -> 0ad3e50375)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/gradle/me.champeau.jmh-jmh-gradle-plugin-0.6.8
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 938a388343 Build: Bump jmh-gradle-plugin from 0.6.7 to 0.6.8
add 9fcf53b765 Core: Add strict-mode property to JDBC Catalog (#5830)
add 6c7e8d1b84 core: Provide mechanism to cache manifest file content (#4518)
add b9bbcfb0e4 API: Support setting table statistics (#5794)
add ecf004bff8 Core: Ignore TestManifestCaching#testWeakFileIOReferenceCleanUp (#5865)
add 3bc2f97c41 Spark 3.2, 3.3: Fix nullability propagation for MergeRows node (#5679)
add d11d53ac50 Docs: Make it clear metadata tables support time travel in Spark (#4709)
add 29bf5cd4b6 Docs: Update output of expire_snapshots procedure (#5866)
add a8b67085e6 Ensure the default value of hive.in.test to avoid overwriting (#5844)
add e8b972e41f API: Extended some deprecation comments in API folder (#5726)
add c6d38e3575 Core: Deprecate functions in TableMetadata and DataWriter (#5772)
add 2e1ec5fde9 Core: Deprecate functions in DeleteWriters (#5771)
add 3cddc9f28c AWS: Add table level S3 tags (#4402)
add 1bdc699665 Core: Avoid extra getFileStatus call in HadoopInputFile (#5864)
add 75707d0c68 Orc: Obtain ORC stripe offsets from writer (#5778)
add f161a133d5 Flink: Add defensive check in IcebergFilesCommitter for restoring state (#5873)
add f98115a9d3 Spark 3.x: Backport snapshot references metadata table test (#5806)
add 9728ad5167 Build: Fix & run spark integration tests on CI (#5819)
add 4fdec90a85 API, Core: Add scan planning metrics for scanned/skipped delete manifests (#5792)
add b7372d3c39 Docs: Update default value for read.parquet.vectorization.enabled (#5776)
add ae246e6468 Nessie: Bump Nessie to 0.43.0 (#5807)
add 3af21ea62a Docs: Update lock catalog properties to correct units (#5708)
add d228992a44 Build: Bump hadoop-client from 3.1.0 to 3.3.4 (#5519)
add 61b131f04e Spark: Bump Spark version for vulnerability (#5292)
add ae8e6698ff API: Expose table statistics in Table API (#4741)
add c2bb77332f Python: Don't throw missing URI error when --uri was provided (#5885)
add 0188579bb8 Python: Update README test instructions (#5869)
add 41bfb9c1eb Docs: Fix formatting in Python CLI (#5868)
add 731e5f0aa2 Build: Cache gradle wrapper in workflows (#4165)
add 6d74364197 Python: Add code conventions for Python (#5879)
add 9eb5cbd342 API,Core: Add scan planning metrics for indexed/eq/pos delete files (#5809)
add 90d93aed46 Build: Bump gradle-baseline-java from 4.0.0 to 4.42.0 (#5530)
add 0ad3e50375 Build: Bump jmh-gradle-plugin from 0.6.7 to 0.6.8
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (938a388343)
\
N -- N -- N refs/heads/dependabot/gradle/me.champeau.jmh-jmh-gradle-plugin-0.6.8 (0ad3e50375)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/flink-ci.yml | 16 +-
.github/workflows/hive-ci.yml | 16 +-
.github/workflows/java-ci.yml | 8 +-
.github/workflows/jmh-bechmarks.yml | 8 +-
.github/workflows/spark-ci.yml | 24 +-
.palantir/revapi.yml | 3 +
api/src/main/java/org/apache/iceberg/Table.java | 7 +
.../java/org/apache/iceberg/UpdateStatistics.java | 4 +-
.../iceberg/metrics/DefaultMetricsContext.java | 3 +
.../org/apache/iceberg/metrics/MetricsContext.java | 6 +-
.../org/apache/iceberg/metrics/ScanReport.java | 50 ++++
.../org/apache/iceberg/transforms/Truncate.java | 1 +
.../iceberg/aws/glue/TestGlueCatalogTable.java | 39 +++
.../aws/lakeformation/LakeFormationTestBase.java | 6 +-
.../java/org/apache/iceberg/aws/AwsProperties.java | 69 +++++
.../iceberg/aws/dynamodb/DynamoDbLockManager.java | 2 +-
.../org/apache/iceberg/aws/glue/GlueCatalog.java | 34 ++-
.../iceberg/aws/glue/GlueTableOperations.java | 5 +
.../apache/iceberg/aws/glue/TestGlueCatalog.java | 38 +++
baseline.gradle | 3 +-
build.gradle | 3 +-
.../main/java/org/apache/iceberg/GuavaClasses.java | 1 +
.../java/org/apache/iceberg/BaseMetadataTable.java | 6 +
.../main/java/org/apache/iceberg/BaseTable.java | 10 +
.../java/org/apache/iceberg/BaseTransaction.java | 13 +
.../java/org/apache/iceberg/CatalogProperties.java | 54 ++++
.../main/java/org/apache/iceberg/CatalogUtil.java | 6 +-
.../java/org/apache/iceberg/DeleteFileIndex.java | 26 +-
.../java/org/apache/iceberg/ManifestFiles.java | 106 ++++++-
.../java/org/apache/iceberg/SerializableTable.java | 5 +
.../java/org/apache/iceberg/SetStatistics.java | 72 +++++
.../java/org/apache/iceberg/SystemProperties.java | 8 +
.../java/org/apache/iceberg/TableMetadata.java | 21 --
.../iceberg/deletes/EqualityDeleteWriter.java | 20 --
.../iceberg/deletes/PositionDeleteWriter.java | 23 --
.../org/apache/iceberg/hadoop/HadoopCatalog.java | 4 +-
.../org/apache/iceberg/hadoop/HadoopFileIO.java | 9 +-
.../org/apache/iceberg/hadoop/HadoopInputFile.java | 8 +-
.../java/org/apache/iceberg/io/BaseTaskWriter.java | 2 +-
.../java/org/apache/iceberg/io/ContentCache.java | 311 +++++++++++++++++++++
.../java/org/apache/iceberg/io/DataWriter.java | 10 -
.../apache/iceberg/io/SortedPosDeleteWriter.java | 4 +-
.../java/org/apache/iceberg/jdbc/JdbcCatalog.java | 47 +---
.../apache/iceberg/jdbc/JdbcTableOperations.java | 18 +-
.../java/org/apache/iceberg/jdbc/JdbcUtil.java | 54 ++++
.../iceberg/metrics/ScanMetricsResultParser.java | 34 +++
.../org/apache/iceberg/TestManifestCaching.java | 294 +++++++++++++++++++
.../iceberg/TestScanPlanningAndReporting.java | 51 +++-
.../java/org/apache/iceberg/TestSetStatistics.java | 131 +++++++++
.../apache/iceberg/avro/TestAvroDeleteWriters.java | 9 +-
.../apache/iceberg/hadoop/HadoopFileIOTest.java | 14 +
.../org/apache/iceberg/jdbc/TestJdbcCatalog.java | 52 +++-
.../metrics/TestScanMetricsResultParser.java | 35 +++
.../iceberg/metrics/TestScanReportParser.java | 35 +++
.../java/org/apache/iceberg/data/FileHelpers.java | 9 +-
.../org/apache/iceberg/io/TestAppenderFactory.java | 8 +-
.../apache/iceberg/io/TestFileWriterFactory.java | 5 +-
.../org/apache/iceberg/io/TestWriterMetrics.java | 8 +-
docs/configuration.md | 12 +-
docs/spark-procedures.md | 2 +
docs/spark-queries.md | 53 ++--
.../iceberg/flink/sink/IcebergFilesCommitter.java | 13 +-
.../org/apache/iceberg/flink/SimpleDataUtil.java | 6 +-
.../iceberg/flink/sink/IcebergFilesCommitter.java | 13 +-
.../org/apache/iceberg/flink/SimpleDataUtil.java | 6 +-
.../iceberg/flink/sink/IcebergFilesCommitter.java | 13 +-
.../org/apache/iceberg/flink/SimpleDataUtil.java | 6 +-
format/spec.md | 4 +-
gradle.properties | 2 +-
.../org/apache/iceberg/hive/TestHiveMetastore.java | 3 +
hive3/build.gradle | 2 +-
.../org/apache/iceberg/orc/OrcFileAppender.java | 8 +-
.../org/apache/iceberg}/orc/TestOrcDataWriter.java | 23 +-
.../apache/iceberg/orc/TestOrcDeleteWriters.java | 2 +-
.../iceberg/parquet/TestParquetDeleteWriters.java | 9 +-
python/CONTRIBUTING.md | 33 +++
python/README.md | 4 +-
python/mkdocs/docs/index.md | 4 +-
python/pyiceberg/cli/console.py | 8 +-
python/pyiceberg/utils/deprecated.py | 45 +++
spark/v3.0/build.gradle | 1 +
.../spark/actions/TestRewriteDataFilesAction.java | 4 +-
spark/v3.1/build.gradle | 3 +-
.../spark/actions/TestRewriteDataFilesAction.java | 4 +-
spark/v3.2/build.gradle | 4 +-
.../catalyst/analysis/RewriteMergeIntoTable.scala | 2 +-
.../spark/extensions/TestCopyOnWriteMerge.java | 35 +++
.../spark/actions/TestRewriteDataFilesAction.java | 4 +-
spark/v3.3/build.gradle | 2 +
.../catalyst/analysis/RewriteMergeIntoTable.scala | 2 +-
.../spark/extensions/TestCopyOnWriteMerge.java | 35 +++
.../spark/extensions/TestMetadataTables.java | 123 ++++++++
.../spark/actions/TestRewriteDataFilesAction.java | 4 +-
versions.props | 2 +-
94 files changed, 2098 insertions(+), 266 deletions(-)
create mode 100644 core/src/main/java/org/apache/iceberg/SetStatistics.java
create mode 100644 core/src/main/java/org/apache/iceberg/io/ContentCache.java
create mode 100644 core/src/test/java/org/apache/iceberg/TestManifestCaching.java
create mode 100644 core/src/test/java/org/apache/iceberg/TestSetStatistics.java
copy {data/src/test/java/org/apache/iceberg/data => orc/src/test/java/org/apache/iceberg}/orc/TestOrcDataWriter.java (83%)
create mode 100644 python/pyiceberg/utils/deprecated.py