You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "cw-pradyumna (via GitHub)" <gi...@apache.org> on 2023/02/01 09:37:55 UTC
[GitHub] [iceberg] cw-pradyumna opened a new issue, #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
cw-pradyumna opened a new issue, #6718:
URL: https://github.com/apache/iceberg/issues/6718
### Apache Iceberg version
1.1.0 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
I am running spark on EKS. When I use a service account in spark on kubernetes and attach a role to it in AWS, that service account is able to access AWS resources through the AWS WebIdentityTokenCredentialsProvider. But in case of Iceberg, it doesn't seem to be doing so.
When I passed tokens to it though the following properties, I was able to write to s3, without any issue.
```
spark.sql.catalog.my_catalog.s3.secret-access-key
spark.sql.catalog.my_catalog.s3.access-key-id
spark.sql.catalog.my_catalog.s3.session-token
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] stevenzwu commented on issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
Posted by "stevenzwu (via GitHub)" <gi...@apache.org>.
stevenzwu commented on issue #6718:
URL: https://github.com/apache/iceberg/issues/6718#issuecomment-1412198557
@cw-pradyumna I think this is the same issue as issue #6715. I am closing this one as duplicate. feel free to repopen it if you think otherwise.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] cw-pradyumna commented on issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
Posted by "cw-pradyumna (via GitHub)" <gi...@apache.org>.
cw-pradyumna commented on issue #6718:
URL: https://github.com/apache/iceberg/issues/6718#issuecomment-1412223645
> @cw-pradyumna I think this is the same issue as issue #6715. I am closing this one as duplicate. feel free to repopen it if you think otherwise.
@stevenzwu , ok Steven, if it's the same then no problem. I had read through #6715 but I thought it was something else, so I made this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] stevenzwu commented on issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
Posted by "stevenzwu (via GitHub)" <gi...@apache.org>.
stevenzwu commented on issue #6718:
URL: https://github.com/apache/iceberg/issues/6718#issuecomment-1412230746
@cw-pradyumna can you try the system property that I mentioned in the other issue?
```
-Dsoftware.amazon.awssdk.http.service.impl=software.amazon.awssdk.http.apache.ApacheSdkHttpService
```
also can you verify if the runtime classpath loaded both url-connection-client and apache-httpclient jars?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] stevenzwu closed issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
Posted by "stevenzwu (via GitHub)" <gi...@apache.org>.
stevenzwu closed issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
URL: https://github.com/apache/iceberg/issues/6718
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] stevenzwu closed issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
Posted by "stevenzwu (via GitHub)" <gi...@apache.org>.
stevenzwu closed issue #6718: Iceberg doesn't read credentials from WebIdentityTokenCredentialsProvider when using with AWS
URL: https://github.com/apache/iceberg/issues/6718
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org