You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@polaris.apache.org by pi...@apache.org on 2025/11/21 17:30:24 UTC

(polaris) branch yzou-remove-generic-table-beta updated (8e36fda97 -> 379516902)

This is an automated email from the ASF dual-hosted git repository.

pingtimeout pushed a change to branch yzou-remove-generic-table-beta
in repository https://gitbox.apache.org/repos/asf/polaris.git


    from 8e36fda97 address comments for change log
     add 77edf11b9 Update registry.access.redhat.com/ubi9/openjdk-21-runtime Docker tag to v1.23-6.1763034977 (#3092)
     add 912abb8a0 Update docker.io/jaegertracing/all-in-one Docker tag to v1.75.0 (#3093)
     add b41876244 feat: Make generate_clients.py windows compatible (#3084)
     add c9d27dcec PRs: Remove markdown-links-check from required checks (#3102)
     add 56edfa1db Update dependency com.diffplug.spotless:spotless-plugin-gradle to v8.1.0 (#3083)
     add 49a77b345 chore(deps): update gradle to v9.2.1 (#3069)
     add e155cd72b chore(deps): update mongo docker tag to v8.2.2 (#3100)
     add 6ed0e88e0 chore(deps): update docker.io/mongo docker tag to v8.2.2 (#3099)
     add c40d31c0c Source-tarball - eliminate git-gzip risk (#3075)
     add a3611b762 NoSQL: Allow `null` IndexKey (de)serialization (#3076)
     add 132146df2 PRs: Re-add markdown-links-check step (#3103)
     add df8442296 NoSQL: Add maintenance implementation (#3077)
     add df6eeaab1 Inject DefaultFileIOFactory in tests (#3043)
     add bd0466e01 Update Quarkus Platform and Group to v3.29.4 (#3094)
     add bbad205ad Site: Replace feather logo (#3101)
     add e35649e1c Update actions/checkout action to v6 (#3106)
     add 415c9c0d9 Core: resolveAll() must be called before reading resolution results (#3064)
     add c1c922793 Site: Added GCS related Bucket Properties for vending credentials. (#3066)
     add e5356ad51 Publish/pom: don't include test-fixtures dependencies as runtime (#3085)
     add 6f879097a Increase javadoc visibility in `persistence/nosql/persistence/cdi/weld` (#3110)
     new 379516902 Merge branch 'main' into yzou-remove-generic-table-beta

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .asf.yaml                                          |   1 -
 .github/workflows/gradle.yml                       |  12 +-
 .github/workflows/helm.yml                         |   2 +-
 .github/workflows/nightly.yml                      |   2 +-
 .github/workflows/python-client.yml                |   2 +-
 .github/workflows/regtest.yml                      |   2 +-
 .../workflows/release-1-create-release-branch.yml  |   2 +-
 .../release-2-update-release-candidate.yml         |   2 +-
 .../release-3-build-and-publish-artifacts.yml      |   8 +-
 .github/workflows/release-4-publish-release.yml    |   2 +-
 .github/workflows/site.yml                         |   4 +-
 .github/workflows/spark_client_regtests.yml        |   2 +-
 CHANGELOG.md                                       |   1 +
 bom/build.gradle.kts                               |   1 +
 .../kotlin/copiedcode/CopiedCodeCheckerPlugin.kt   |   2 +-
 .../kotlin/publishing/PublishingHelperPlugin.kt    |  13 +-
 .../src/main/kotlin/publishing/rootProject.kt      |  30 +-
 client/python/generate_clients.py                  | 130 ++---
 getting-started/telemetry/docker-compose.yml       |   2 +-
 gradle/baselibs.versions.toml                      |   2 +-
 gradle/libs.versions.toml                          |   2 +-
 gradle/projects.main.properties                    |   1 +
 gradle/wrapper/gradle-wrapper.properties           |   4 +-
 .../persistence/nosql/api/index/IndexKey.java      |  23 +-
 .../persistence/nosql/api/index/TestIndexKey.java  |  18 +-
 .../nosql/persistence/cdi/weld/build.gradle.kts    |   5 +-
 .../nosql/mongodb/Dockerfile-mongodb-version       |   2 +-
 .../docker/mongodb-3-nodes/docker-compose.yml      |   6 +-
 .../{ => maintenance}/impl/build.gradle.kts        |  71 ++-
 .../impl/AbstractScanItemStatsCollector.java       | 113 ++++
 .../nosql/maintenance/impl/AllRetained.java        | 105 ++++
 .../nosql/maintenance/impl/MaintenanceRunObj.java} |  39 +-
 .../maintenance/impl/MaintenanceRunsObj.java}      |  46 +-
 .../maintenance/impl/MaintenanceServiceImpl.java   | 617 +++++++++++++++++++++
 ...MaintenanceServiceRealmRetainedIdentifier.java} |  33 +-
 .../nosql/maintenance/impl/RateLimit.java}         |  44 +-
 .../maintenance/impl/RetainedCollectorImpl.java    | 363 ++++++++++++
 .../nosql/maintenance/impl/ScanHandler.java        | 201 +++++++
 .../nosql/maintenance/impl/ScanItemCallback.java}  |  12 +-
 .../nosql/maintenance/impl/ScanItemOutcome.java}   |  18 +-
 .../nosql/maintenance/impl/package-info.java       |  19 +-
 .../impl}/src/main/resources/META-INF/beans.xml    |   0
 ...pache.polaris.persistence.nosql.api.obj.ObjType |   4 +-
 .../nosql/maintenance/impl/TestMaintenance.java    | 393 +++++++++++++
 .../impl}/src/test/resources/weld.properties       |   0
 .../impl/MaintenanceConfigurationProducer.java}    |  11 +-
 .../maintenance/impl/MutableMaintenanceConfig.java | 102 ++++
 .../nosql/maintenance/impl/ObjOne.java}            |  28 +-
 .../nosql/maintenance/impl/ObjTwo.java}            |  28 +-
 .../nosql/maintenance/impl/ObjTypeIdentOne.java    |  40 +-
 .../nosql/maintenance/impl/ObjTypeIdentTwo.java    |  39 +-
 .../nosql/maintenance/impl/RealmIdentOne.java      |  19 +-
 .../nosql/maintenance/impl/RealmIdentTwo.java      |  19 +-
 .../nosql/maintenance/impl/package-info.java       |   2 +
 .../src/testFixtures}/resources/META-INF/beans.xml |   0
 ...pache.polaris.persistence.nosql.api.obj.ObjType |   3 +-
 .../resolver/PolarisResolutionManifest.java        |  14 +-
 runtime/admin/src/main/docker/Dockerfile.jvm       |   2 +-
 runtime/server/src/main/docker/Dockerfile.jvm      |   2 +-
 .../AbstractPolarisGenericTableCatalogTest.java    |   4 +-
 .../iceberg/AbstractIcebergCatalogTest.java        |  12 +-
 .../iceberg/AbstractIcebergCatalogViewTest.java    |   3 +-
 .../iceberg/IcebergCatalogHandlerAuthzTest.java    |   3 +-
 .../catalog/policy/AbstractPolicyCatalogTest.java  |   4 +-
 .../task/BatchFileCleanupTaskHandlerTest.java      |  50 +-
 .../task/ManifestFileCleanupTaskHandlerTest.java   |  54 +-
 .../service/task/TableCleanupTaskHandlerTest.java  |   8 +-
 .../apache/polaris/service/TestFileIOFactory.java  |  44 --
 .../_index.md}                                     |   6 +-
 .../configuring-gcs-cloud-storage-specific.md      |  32 ++
 site/hugo.yaml                                     |   3 +-
 71 files changed, 2432 insertions(+), 461 deletions(-)
 copy persistence/nosql/persistence/{ => maintenance}/impl/build.gradle.kts (54%)
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/AbstractScanItemStatsCollector.java
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/AllRetained.java
 copy persistence/nosql/persistence/{impl/src/test/java/org/apache/polaris/persistence/nosql/impl/cache/DynamicCachingObj.java => maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/MaintenanceRunObj.java} (55%)
 copy persistence/nosql/{realms/store-nosql/src/main/java/org/apache/polaris/persistence/nosql/realms/store/RealmsStateObj.java => persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/MaintenanceRunsObj.java} (52%)
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/MaintenanceServiceImpl.java
 copy persistence/nosql/{nodes/store-nosql/src/main/java/org/apache/polaris/persistence/nosql/nodeids/store/NodeManagementRetainedIdentifier.java => persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/MaintenanceServiceRealmRetainedIdentifier.java} (55%)
 copy persistence/nosql/{idgen/api/src/main/java/org/apache/polaris/ids/api/IdGenerator.java => persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/RateLimit.java} (54%)
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/RetainedCollectorImpl.java
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/ScanHandler.java
 copy persistence/nosql/persistence/{varint/build.gradle.kts => maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/ScanItemCallback.java} (76%)
 copy persistence/nosql/persistence/{api/src/main/java/org/apache/polaris/persistence/nosql/api/commit/CommitException.java => maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/ScanItemOutcome.java} (71%)
 copy polaris-core/src/main/java/org/apache/polaris/core/exceptions/PolarisException.java => persistence/nosql/persistence/maintenance/impl/src/main/java/org/apache/polaris/persistence/nosql/maintenance/impl/package-info.java (63%)
 copy persistence/nosql/{async/api => persistence/maintenance/impl}/src/main/resources/META-INF/beans.xml (100%)
 copy persistence/nosql/{nodes/store-nosql => persistence/maintenance/impl}/src/main/resources/META-INF/services/org.apache.polaris.persistence.nosql.api.obj.ObjType (80%)
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/test/java/org/apache/polaris/persistence/nosql/maintenance/impl/TestMaintenance.java
 copy persistence/nosql/{async/java => persistence/maintenance/impl}/src/test/resources/weld.properties (100%)
 copy persistence/nosql/{async/api/src/testFixtures/java/org/apache/polaris/nosql/async/AsyncTestConfigProvider.java => persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/MaintenanceConfigurationProducer.java} (73%)
 create mode 100644 persistence/nosql/persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/MutableMaintenanceConfig.java
 copy persistence/nosql/{nodes/store-nosql/src/main/java/org/apache/polaris/persistence/nosql/nodeids/store/NodeObj.java => persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/ObjOne.java} (71%)
 copy persistence/nosql/{nodes/store-nosql/src/main/java/org/apache/polaris/persistence/nosql/nodeids/store/NodeObj.java => persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/ObjTwo.java} (71%)
 copy runtime/service/src/main/java/org/apache/polaris/service/catalog/io/WasbTranslatingFileIOFactory.java => persistence/nosql/persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/ObjTypeIdentOne.java (51%)
 copy runtime/service/src/main/java/org/apache/polaris/service/catalog/io/WasbTranslatingFileIOFactory.java => persistence/nosql/persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/ObjTypeIdentTwo.java (51%)
 copy runtime/service/src/main/java/org/apache/polaris/service/catalog/DefaultCatalogPrefixParser.java => persistence/nosql/persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/RealmIdentOne.java (58%)
 copy runtime/service/src/main/java/org/apache/polaris/service/catalog/DefaultCatalogPrefixParser.java => persistence/nosql/persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/RealmIdentTwo.java (58%)
 copy codestyle/copyright-header-java.txt => persistence/nosql/persistence/maintenance/impl/src/testFixtures/java/org/apache/polaris/persistence/nosql/maintenance/impl/package-info.java (92%)
 copy persistence/nosql/{async/api/src/main => persistence/maintenance/impl/src/testFixtures}/resources/META-INF/beans.xml (100%)
 copy persistence/nosql/persistence/{correctness => maintenance/impl}/src/testFixtures/resources/META-INF/services/org.apache.polaris.persistence.nosql.api.obj.ObjType (84%)
 delete mode 100644 runtime/service/src/testFixtures/java/org/apache/polaris/service/TestFileIOFactory.java
 rename site/content/in-dev/unreleased/{configuring-polaris-for-production.md => configuring-polaris-for-production/_index.md} (97%)
 create mode 100644 site/content/in-dev/unreleased/configuring-polaris-for-production/configuring-gcs-cloud-storage-specific.md


(polaris) 01/01: Merge branch 'main' into yzou-remove-generic-table-beta

Posted by pi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

pingtimeout pushed a commit to branch yzou-remove-generic-table-beta
in repository https://gitbox.apache.org/repos/asf/polaris.git

commit 3795169022b1f275c92ed0af99e77b3a6ea4e9f5
Merge: 8e36fda97 6f879097a
Author: Pierre Laporte <pi...@pingtimeout.fr>
AuthorDate: Fri Nov 21 18:30:21 2025 +0100

    Merge branch 'main' into yzou-remove-generic-table-beta

 .asf.yaml                                          |   1 -
 .github/workflows/gradle.yml                       |  12 +-
 .github/workflows/helm.yml                         |   2 +-
 .github/workflows/nightly.yml                      |   2 +-
 .github/workflows/python-client.yml                |   2 +-
 .github/workflows/regtest.yml                      |   2 +-
 .../workflows/release-1-create-release-branch.yml  |   2 +-
 .../release-2-update-release-candidate.yml         |   2 +-
 .../release-3-build-and-publish-artifacts.yml      |   8 +-
 .github/workflows/release-4-publish-release.yml    |   2 +-
 .github/workflows/site.yml                         |   4 +-
 .github/workflows/spark_client_regtests.yml        |   2 +-
 CHANGELOG.md                                       |   1 +
 bom/build.gradle.kts                               |   1 +
 .../kotlin/copiedcode/CopiedCodeCheckerPlugin.kt   |   2 +-
 .../kotlin/publishing/PublishingHelperPlugin.kt    |  13 +-
 .../src/main/kotlin/publishing/rootProject.kt      |  30 +-
 client/python/generate_clients.py                  | 130 ++---
 getting-started/telemetry/docker-compose.yml       |   2 +-
 gradle/baselibs.versions.toml                      |   2 +-
 gradle/libs.versions.toml                          |   2 +-
 gradle/projects.main.properties                    |   1 +
 gradle/wrapper/gradle-wrapper.properties           |   4 +-
 .../persistence/nosql/api/index/IndexKey.java      |  23 +-
 .../persistence/nosql/api/index/TestIndexKey.java  |  18 +-
 .../nosql/persistence/cdi/weld/build.gradle.kts    |   5 +-
 .../nosql/mongodb/Dockerfile-mongodb-version       |   2 +-
 .../docker/mongodb-3-nodes/docker-compose.yml      |   6 +-
 .../weld => maintenance/impl}/build.gradle.kts     |  61 +-
 .../impl/AbstractScanItemStatsCollector.java       | 113 ++++
 .../nosql/maintenance/impl/AllRetained.java        | 105 ++++
 .../nosql/maintenance/impl/MaintenanceRunObj.java  |  67 +++
 .../nosql/maintenance/impl/MaintenanceRunsObj.java |  65 +++
 .../maintenance/impl/MaintenanceServiceImpl.java   | 617 +++++++++++++++++++++
 .../MaintenanceServiceRealmRetainedIdentifier.java |  57 ++
 .../nosql/maintenance/impl/RateLimit.java          |  45 +-
 .../maintenance/impl/RetainedCollectorImpl.java    | 363 ++++++++++++
 .../nosql/maintenance/impl/ScanHandler.java        | 201 +++++++
 .../nosql/maintenance/impl/ScanItemCallback.java   |  26 +-
 .../nosql/maintenance/impl/ScanItemOutcome.java    |  32 +-
 .../nosql/maintenance/impl/package-info.java       |  34 +-
 .../impl/src/main/resources/META-INF/beans.xml     |  24 +
 ...ache.polaris.persistence.nosql.api.obj.ObjType} |   5 +-
 .../nosql/maintenance/impl/TestMaintenance.java    | 393 +++++++++++++
 .../impl/src/test/resources/weld.properties}       |   5 +-
 .../impl/MaintenanceConfigurationProducer.java     |  31 +-
 .../maintenance/impl/MutableMaintenanceConfig.java | 102 ++++
 .../persistence/nosql/maintenance/impl/ObjOne.java |  53 ++
 .../persistence/nosql/maintenance/impl/ObjTwo.java |  53 ++
 .../nosql/maintenance/impl/ObjTypeIdentOne.java    |  51 ++
 .../nosql/maintenance/impl/ObjTypeIdentTwo.java    |  50 ++
 .../nosql/maintenance/impl/RealmIdentOne.java      |  30 +-
 .../nosql/maintenance/impl/RealmIdentTwo.java      |  30 +-
 .../nosql/maintenance/impl/package-info.java       |  26 +-
 .../src/testFixtures/resources/META-INF/beans.xml  |  24 +
 ...ache.polaris.persistence.nosql.api.obj.ObjType} |   5 +-
 .../resolver/PolarisResolutionManifest.java        |  14 +-
 runtime/admin/src/main/docker/Dockerfile.jvm       |   2 +-
 runtime/server/src/main/docker/Dockerfile.jvm      |   2 +-
 .../AbstractPolarisGenericTableCatalogTest.java    |   4 +-
 .../iceberg/AbstractIcebergCatalogTest.java        |  12 +-
 .../iceberg/AbstractIcebergCatalogViewTest.java    |   3 +-
 .../iceberg/IcebergCatalogHandlerAuthzTest.java    |   3 +-
 .../catalog/policy/AbstractPolicyCatalogTest.java  |   4 +-
 .../task/BatchFileCleanupTaskHandlerTest.java      |  50 +-
 .../task/ManifestFileCleanupTaskHandlerTest.java   |  54 +-
 .../service/task/TableCleanupTaskHandlerTest.java  |   8 +-
 .../_index.md}                                     |   6 +-
 .../configuring-gcs-cloud-storage-specific.md      |  32 ++
 site/hugo.yaml                                     |   3 +-
 70 files changed, 2748 insertions(+), 400 deletions(-)

diff --cc CHANGELOG.md
index 68ba8e5c3,3ad9d759b..c544dcb03
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@@ -63,7 -63,7 +63,8 @@@ request adding CHANGELOG notes for brea
  - `client.region` is no longer considered a "credential" property (related to Iceberg REST Catalog API).
  - Relaxed the requirements for S3 storage's ARN to allow Polaris to connect to more non-AWS S3 storage appliances. 
  - Added checksum to helm deployment so that it will restart when the configmap has changed.
 +- Generic Table is no longer in beta and is generally-available.
+ - Added Windows support for Python client
  
  ### Deprecations