[GitHub] [iceberg] jackye1995 opened a new issue, #7516: Avoid loading all AWS client dependencies for AwsClientFactory

["jackye1995 (via GitHub)" <gi...@apache.org>]

jackye1995 opened a new issue, #7516:
URL: https://github.com/apache/iceberg/issues/7516

   ### Feature Request / Improvement
   
   As we briefly discussed in a previous community sync, the `AwsClientFactory` class currently forces all AWS client dependencies to be required at runtime. If I just want to use `S3FileIO`, I also need to include `glue`, `dynamodb`, etc. for the whole runtime jar to work.
   
   Many users just dump the `bundle` jar for all AWS clients, which is a huge 450MB jar and definitely not a good practice.
   
   I was having the idea of just using separated small client factories. For example add `S3FileIOAwsClientFactory` with `s3-file-io.client-factory-impl` catalog property for `S3FileIO`. And if that config is not set, we load `AwsClientFactory` and use the clients offered there for backwards compatibility purpose.
   
   Any thoughts? @amogh-jahagirdar @nastra @danielcweeks @singhpk234 @rajarshisarkar @akshayakp97
   
   ### Query engine
   
   None


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

Re: [I] Avoid loading all AWS client dependencies for AwsClientFactory [iceberg]

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

github-actions[bot] commented on issue #7516:
URL: https://github.com/apache/iceberg/issues/7516#issuecomment-1786237165

   This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org