You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "n-dlms (via GitHub)" <gi...@apache.org> on 2026/08/05 12:39:27 UTC
[PR] AWS: Add iceberg-aws-s3-bundle with S3-only AWS clients [iceberg]
n-dlms opened a new pull request, #17531:
URL: https://github.com/apache/iceberg/pull/17531
## Motivation
Issue #7516 asks that users who only need `S3FileIO` not be forced to ship the full set of AWS SDK clients (Glue, DynamoDB, KMS, etc.). The factory-level split already exists (`S3FileIOAwsClientFactory` + `s3.client-factory-impl`, #7590), but the artifact users actually deploy — `iceberg-aws-bundle` — still shades every client, which is the ~450MB "just dump the bundle jar" problem the issue calls out.
## What this PR does
Adds a new shadow bundle module `iceberg-aws-s3-bundle` that contains only the S3-path AWS dependencies:
- `s3`, `auth`, `apache-client`, `url-connection-client`
- `crt-core`, `http-auth-aws-crt` (async/CRT path)
- `s3accessgrants`, `analyticsaccelerator` (S3FileIO features)
and **excludes** the catalog/lock/KMS clients: `glue`, `dynamodb`, `kms`, `lakeformation`, `sso`.
The existing `iceberg-aws-bundle` is left unchanged for Glue catalog, DynamoDB lock, and KMS users.
Measured locally: `iceberg-aws-s3-bundle` shadow jar is **48MB vs 65MB** for the full bundle (~26% smaller), while `:iceberg-aws:test` (S3FileIO, S3InputStream, access grants, etc.) passes unchanged.
## Changes
- `aws-s3-bundle/` — new module (build.gradle mirroring `aws-bundle` with the slim dep set, plus LICENSE/NOTICE and the generated `runtime-deps.txt` baseline)
- `settings.gradle` — register the module
- `.github/workflows/cve-scan.yml` — scan the new distribution
- `.github/labeler.yml` — AWS label covers the new module
- `docs/docs/aws.md` — document the S3-only option for Spark with a REST-catalog example
## Compatibility
Fully additive — no existing artifact or API changes. Users who need Glue/DynamoDB/KMS continue using `iceberg-aws-bundle`.
Closes #7516
---
**AI Disclosure**
- Model: Claude Opus 4.7
- Platform/Tool: Claude Code
- Human Oversight: fully reviewed
- Prompt Summary: Implement a slim S3-only AWS bundle artifact to close issue #7516; verify build, tests, and jar size locally
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] AWS: Add iceberg-aws-s3-bundle with S3-only AWS clients [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17531:
URL: https://github.com/apache/iceberg/pull/17531#issuecomment-5649682012
This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] AWS: Add iceberg-aws-s3-bundle with S3-only AWS clients [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #17531:
URL: https://github.com/apache/iceberg/pull/17531#issuecomment-5548041525
This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] AWS: Add iceberg-aws-s3-bundle with S3-only AWS clients [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #17531: AWS: Add iceberg-aws-s3-bundle with S3-only AWS clients
URL: https://github.com/apache/iceberg/pull/17531
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org