You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "xiaowujee (via GitHub)" <gi...@apache.org> on 2023/08/21 09:56:39 UTC

[GitHub] [iceberg] xiaowujee commented on issue #8347: How can I use iceberg and Minio in the Flink engine?

xiaowujee commented on issue #8347:
URL: https://github.com/apache/iceberg/issues/8347#issuecomment-1686020265

   I also want to use it this way. Can you provide a complete example.    
   My example:
   ```
   CREATE CATALOG hadoop_catalog WITH (
       'type'='iceberg',
       'warehouse'='s3://flink194/hive/data',
       'catalog-impl'='org.apache.iceberg.aws.glue.GlueCatalog',
       'io-impl'='org.apache.iceberg.aws.s3.S3FileIO',
       's3.client-factory-impl'='org.apache.iceberg.aws.s3.DefaultS3FileIOAwsClientFactory',
       's3.access-key-id'='minio',
       's3.secret-access-key'='minio123',
       's3.endpoint'='http://minio:9000',
       's3.path-style-access'='true',
       'client.region'='us-east-1'
   );
   CREATE TABLE `hadoop_catalog`.`default`.`test`
   (
       id   BIGINT COMMENT 'unique id',
       data STRING
   );
   ```
   However, error prompts
   ```
   [ERROR] Could not execute SQL statement. Reason:
   software.amazon.awssdk.core.exception.SdkClientException: Unable to load credentials from any of the providers in the chain AwsCredentialsProviderChain(credentialsProviders=[SystemPropertyCredentialsProvider(), EnvironmentVariableCredentialsProvider(), WebIdentityTokenCredentialsProvider(), ProfileCredentialsProvider(profileName=default, profileFile=ProfileFile(profilesAndSectionsMap=[])), ContainerCredentialsProvider(), InstanceProfileCredentialsProvider()]) : [SystemPropertyCredentialsProvider(): Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId)., EnvironmentVariableCredentialsProvider(): Unable to load credentials from system settings. Access key must be specified either via environment variable (AWS_ACCESS_KEY_ID) or system property (aws.accessKeyId)., WebIdentityTokenCredentialsProvider(): Either the environment variable AWS_WEB_IDENTITY_TOKEN_FILE or the javap
 roperty aws.webIdentityTokenFile must be set., ProfileCredentialsProvider(profileName=default, profileFile=ProfileFile(profilesAndSectionsMap=[])): Profile file contained no credentials for profile 'default': ProfileFile(profilesAndSectionsMap=[]), ContainerCredentialsProvider(): Cannot fetch credentials from container - neither AWS_CONTAINER_CREDENTIALS_FULL_URI or AWS_CONTAINER_CREDENTIALS_RELATIVE_URI environment variables are set., InstanceProfileCredentialsProvider(): Failed to load credentials from IMDS.]
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org