You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/01/28 07:56:11 UTC

[GitHub] [iceberg] jackye1995 commented on issue #2168: Flink: [doc] Is there a full example for Iceberg+Flink+S3 ?

jackye1995 commented on issue #2168:
URL: https://github.com/apache/iceberg/issues/2168#issuecomment-768870857


   In general, each compute engine has its own page to explain loading custom catalog, that's why only spark example is given in AWS page. Probably good to add this note in the AWS page. I am gathering the small fixes for the 0.11 website right now, I will update them all at once, thanks for the suggestion.
   
   To answer your question around Flink, use the guide here: https://iceberg.apache.org/flink/#custom-catalog, the minimum you need is:
   
   ```
   CREATE CATALOG my_catalog WITH (
     'type'='iceberg',
     'catalog-impl'='org.apache.iceberg.aws.glue.GlueCatalog',
     'warehouse'='s3://my-bucket/my/key/prefix'
   );
   ```
   
   AWS credentials are accessed through the default credential chain that tries to retrieve credentials in a series of approaches: https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/credentials.html
   
   If you need more customization such as endpoint, you can load your own AwsClientFactory through the guide https://iceberg.apache.org/aws/#aws-client-customization


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org