You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "paulmech (via GitHub)" <gi...@apache.org> on 2024/12/06 04:52:24 UTC
[I] Add new poetry extras for rest sigv4 [iceberg-python]
paulmech opened a new issue, #1405:
URL: https://github.com/apache/iceberg-python/issues/1405
### Feature Request / Improvement
Currently, rest catalog support appears built in to the main `pyiceberg` package
However, rest catalog also supports SIGv4 signing, without an explicit dependency on boto3, which is required to fetch existing credentials and create the SIGv4 Authorization header.
With AWS Glue now adding support for [Iceberg REST endpoints](https://github.com/apache/iceberg-python/blob/main/pyiceberg/catalog/rest.py) (seemingly unrelated to s3tables), it is possible to access a glue catalog using the rest catalog interface, but it requires boto3 for the SIGv4 signing. E.g. in my `~./.pyiceberg.yaml` I have
```yaml
catalog:
default:
uri: https://glue.us-west-2.amazonaws.com/iceberg
rest.sigv4-enabled: true
rest.signing-region: us-west-2
rest.signing-name: glue
```
It works, but I have to add `boto3` package first.
Suggestion is to add a poetry extra `rest-sigv4` that adds boto3 dependency.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Add new poetry extras for rest sigv4 [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on issue #1405:
URL: https://github.com/apache/iceberg-python/issues/1405#issuecomment-2522246713
thanks for raising this issue! It does look like REST Catalog's SIGv4 feature requires boto3
https://github.com/apache/iceberg-python/blob/bfc0d9a62176803094da0867ee793808f105d352/pyiceberg/catalog/rest.py#L474-L477
Is this something you would like to contribute? I think we need to add the poetry extra [here](https://github.com/apache/iceberg-python/blob/bfc0d9a62176803094da0867ee793808f105d352/pyproject.toml#L873-L874)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Add new poetry extras for rest sigv4 [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #1405:
URL: https://github.com/apache/iceberg-python/issues/1405#issuecomment-2525276017
Ah, this is a great catch! Boto comes with S3FS, and if you don't use that, you have to install it separately.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Add new poetry extras for rest sigv4 [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on issue #1405:
URL: https://github.com/apache/iceberg-python/issues/1405#issuecomment-2541793678
Closed by #1415
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Add new poetry extras for rest sigv4 [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu closed issue #1405: Add new poetry extras for rest sigv4
URL: https://github.com/apache/iceberg-python/issues/1405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org