You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "Neuw84 (via GitHub)" <gi...@apache.org> on 2024/10/24 10:04:14 UTC

Re: [I] List all AWS S3 properties in the docs [iceberg]

Neuw84 commented on issue #10674:
URL: https://github.com/apache/iceberg/issues/10674#issuecomment-2434843285

   As @hsiang-c made another pull request building a table 
   
   https://github.com/apache/iceberg/pull/11321 I didn't want to collide.
   
   Therefore, I focused on: 
   
   - Added Amazon MSK Connect as option.
   - Added HTTP client advice when high throughput scenarios (not just tune the retries but also number of connections).
   - Added specific configs for data prefetching on EMR 7.1.0
   
   As personal opinion, if using AWS SDKs most of the properties shouldn't be there ( there is a standard way of configure them, prioritize them, etc). However, is clear that using 3rd party libraries in different languages would require info like the tables @hsiang-c has built.
   
   The problem with this is that different libraries will have different configs ( on the same language).
   
   In my personal opinion instead of dividing by language, maybe by library (but here maybe just adding a link to the corresponding doc page should be enough)? And having a separate section/table for AWS SDKs supported ones (anything using official libraries will have the same config, no matter the language)?
   
   Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org