You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by gi...@apache.org on 2023/07/20 13:50:56 UTC
[iceberg] branch dependabot/pip/python/pyparsing-3.1.0 updated (57c3a9e2fa -> 96f03e8afa)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/pip/python/pyparsing-3.1.0
in repository https://gitbox.apache.org/repos/asf/iceberg.git
discard 57c3a9e2fa Build: Bump pyparsing from 3.0.9 to 3.1.0 in /python
add b679d0ce71 Python: Improve Avro read performance (#8075)
add fc89f0b4bb Python: Concurrency using `ThreadPoolExecutor` (#8061)
add 97412b9ae9 Build: Bump Nessie to 0.65.0 (#8093)
add a8eb65c936 Docs: Fix conflicting description on primary key support in Flink (#7382)
add 0be5140b41 Spark 3.1: Relocate all Netty classes (#6732)
add 6103199832 Spark 3.4: Force Jackson version to 2.14.2 (#8052)
add 760853812b Spark 3.1: Add prefix mismatch mode for deleting orphan files (#7653)
add 7d3859306d Spark 3.2: Skip duplicate check on deleted file path when import files (#8092)
add cf3e50bad9 Spark 3.3, 3.4: Migrate TestRewritePositionDeleteFiles to AssertJ (#8070)
add d3d9155d91 Core, AWS, Delta, Snowflake: Switch tests to JUnit5 (#7996)
add 1bb853191f Docs: Update wording around nullability (#8094)
add a1335218c3 Parquet: Upgrade to JUnit5 (#8056)
add c0ad67129d Python: Improve Avro Parse speed (#8082)
add 0b95a2ca6a Spark, Flink: Fix running integration tests with JDK17 (#8114)
add 7da759bd9e Python: SqlCatalog (#7921)
add 96f03e8afa Build: Bump pyparsing from 3.0.9 to 3.1.0 in /python
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (57c3a9e2fa)
\
N -- N -- N refs/heads/dependabot/pip/python/pyparsing-3.1.0 (96f03e8afa)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../org/apache/iceberg/aws/s3/TestS3FileIO.java | 76 ++--
.../apache/iceberg/aws/s3/TestS3InputStream.java | 41 +-
.../apache/iceberg/aws/s3/TestS3OutputStream.java | 45 +-
.../java/org/apache/iceberg/aws/s3/TestS3URI.java | 36 +-
.../iceberg/aws/s3/signer/TestS3RestSigner.java | 33 +-
build.gradle | 9 +-
.../java/org/apache/iceberg/TestCatalogUtil.java | 19 +-
.../org/apache/iceberg/TestEnvironmentContext.java | 2 +-
.../TestFixedSizeSplitScanTaskIterator.java | 8 +-
.../org/apache/iceberg/TestMetricsTruncation.java | 333 +++++++-------
.../TestOffsetsBasedSplitScanTaskIterator.java | 10 +-
.../apache/iceberg/TestSchemaUnionByFieldName.java | 46 +-
.../org/apache/iceberg/avro/AvroTestHelpers.java | 9 +-
.../delta/SparkDeltaLakeSnapshotTestBase.java | 8 +-
.../iceberg/delta/TestSnapshotDeltaLakeTable.java | 113 ++---
.../TestBaseSnapshotDeltaLakeTableAction.java | 15 +-
.../iceberg/delta/TestDeltaLakeTypeToType.java | 6 +-
docs/flink-ddl.md | 29 +-
docs/flink-writes.md | 6 +-
docs/spark-ddl.md | 7 +-
flink/v1.15/build.gradle | 1 +
flink/v1.16/build.gradle | 1 +
flink/v1.17/build.gradle | 1 +
.../test/java/org/apache/iceberg/TestHelpers.java | 7 +-
.../iceberg/avro/TestParquetReadProjection.java | 2 +-
.../apache/iceberg/avro/TestReadProjection.java | 210 +++++----
.../iceberg/parquet/ParquetWritingTestUtils.java | 15 +-
.../iceberg/parquet/TestBloomRowGroupFilter.java | 253 +++++------
.../iceberg/parquet/TestCDHParquetStatistics.java | 6 +-
.../parquet/TestDictionaryRowGroupFilter.java | 377 ++++++++--------
.../org/apache/iceberg/parquet/TestParquet.java | 27 +-
.../iceberg/parquet/TestParquetDataWriter.java | 89 ++--
.../iceberg/parquet/TestParquetDeleteWriters.java | 83 ++--
.../iceberg/parquet/TestParquetEncryption.java | 16 +-
.../iceberg/parquet/TestParquetSchemaUtil.java | 34 +-
.../apache/iceberg/parquet/TestPruneColumns.java | 11 +-
python/Makefile | 2 +-
python/mkdocs/docs/configuration.md | 14 +-
python/poetry.lock | 225 +++++++++-
python/pyiceberg/avro/decoder.py | 1 +
python/pyiceberg/avro/file.py | 16 +-
python/pyiceberg/avro/reader.py | 11 +-
python/pyiceberg/avro/resolver.py | 3 +
python/pyiceberg/catalog/__init__.py | 13 +
python/pyiceberg/catalog/sql.py | 480 +++++++++++++++++++++
python/pyiceberg/io/pyarrow.py | 27 +-
python/pyiceberg/manifest.py | 38 ++
python/pyiceberg/table/__init__.py | 10 +-
python/pyiceberg/typedef.py | 18 +-
python/pyiceberg/types.py | 6 +
python/pyiceberg/utils/concurrent.py | 67 +++
python/pyproject.toml | 7 +
python/tests/avro/test_file.py | 3 +-
python/tests/catalog/test_sql.py | 355 +++++++++++++++
.../iceberg/snowflake/JdbcSnowflakeClientTest.java | 16 +-
.../iceberg/snowflake/NamespaceHelpersTest.java | 2 +-
.../iceberg/snowflake/SnowflakeCatalogTest.java | 6 +-
spark/v3.1/build.gradle | 13 +-
.../extensions/TestRemoveOrphanFilesProcedure.java | 106 +++++
.../actions/BaseDeleteOrphanFilesSparkAction.java | 206 ++++++++-
.../iceberg/spark/actions/SetAccumulator.java | 0
.../procedures/RemoveOrphanFilesProcedure.java | 44 +-
.../spark/actions/TestRemoveOrphanFilesAction.java | 120 ++++++
spark/v3.2/build.gradle | 2 +
.../spark/extensions/TestAddFilesProcedure.java | 56 +++
.../org/apache/iceberg/spark/SparkTableUtil.java | 5 +-
spark/v3.3/build.gradle | 1 +
.../extensions/TestRewritePositionDeleteFiles.java | 104 ++---
spark/v3.4/build.gradle | 7 +-
.../extensions/TestRewritePositionDeleteFiles.java | 104 ++---
versions.props | 4 +-
71 files changed, 2984 insertions(+), 1092 deletions(-)
create mode 100644 python/pyiceberg/catalog/sql.py
create mode 100644 python/pyiceberg/utils/concurrent.py
create mode 100644 python/tests/catalog/test_sql.py
copy spark/{v3.2 => v3.1}/spark/src/main/java/org/apache/iceberg/spark/actions/SetAccumulator.java (100%)