You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "bryanck (via GitHub)" <gi...@apache.org> on 2023/08/08 20:28:40 UTC
[GitHub] [iceberg] bryanck opened a new pull request, #8261: AWS: Add bundle jar for AWS-related dependencies
bryanck opened a new pull request, #8261:
URL: https://github.com/apache/iceberg/pull/8261
This PR adds a new `iceberg-aws-bundle` project that packages the necessary AWS libraries and shades any packages that might conflict with engine libraries or Iceberg. AWS already provides a bundle library for convenience, however it is very large (460+MB) which can cause issues with systems that limit jar size, like AWS KDA. If someone does want to include only the AWS libraries required, they need to inspect build.gradle for the compileOnly dependencies in the `iceberg-aws` project and also determine what needs to be shaded.
This `iceberg-aws-bundle` jar is much smaller, ~28MB, and also aligns the correct AWS SDK version with the Iceberg release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] AWS: Add bundle jar for AWS-related dependencies [iceberg]
Posted by "ronkorving (via GitHub)" <gi...@apache.org>.
ronkorving commented on PR #8261:
URL: https://github.com/apache/iceberg/pull/8261#issuecomment-1814194491
Just wanted to say thank you for this, @bryanck. This really helped me out today.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] nastra commented on pull request #8261: AWS: Add bundle jar for AWS-related dependencies
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on PR #8261:
URL: https://github.com/apache/iceberg/pull/8261#issuecomment-1672789274
I've updated the docs to use the `iceberg-aws-bundle` in https://github.com/apache/iceberg/pull/8283
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] danielcweeks merged pull request #8261: AWS: Add bundle jar for AWS-related dependencies
Posted by "danielcweeks (via GitHub)" <gi...@apache.org>.
danielcweeks merged PR #8261:
URL: https://github.com/apache/iceberg/pull/8261
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] bryanck commented on pull request #8261: AWS: Add bundle jar for AWS-related dependencies
Posted by "bryanck (via GitHub)" <gi...@apache.org>.
bryanck commented on PR #8261:
URL: https://github.com/apache/iceberg/pull/8261#issuecomment-1670266465
FYI the dependency license list in the license file was generated using the [Gradle License Report](https://github.com/jk1/Gradle-License-Report) plugin, with some manual tweaking afterwards. (The same plugin was used for the `iceberg-gcp-bundle` project.)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org