You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "nqvuong1998 (via GitHub)" <gi...@apache.org> on 2024/08/09 10:40:00 UTC
[I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
nqvuong1998 opened a new issue, #3089:
URL: https://github.com/apache/amoro/issues/3089
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/amoro/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
- Support connect to Nessie/Polaris REST Catalog as an option on Catalogs UI
- Add documentation to integrate with Nessie/Polaris REST Catalog
### How should we improve?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Subtasks
_No response_
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3089:
URL: https://github.com/apache/amoro/issues/3089#issuecomment-2664254872
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "nqvuong1998 (via GitHub)" <gi...@apache.org>.
nqvuong1998 commented on issue #3089:
URL: https://github.com/apache/amoro/issues/3089#issuecomment-2277663010
cc @zhoujinsong
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "zhoujinsong (via GitHub)" <gi...@apache.org>.
zhoujinsong commented on issue #3089:
URL: https://github.com/apache/amoro/issues/3089#issuecomment-2285819325
Amoro already supported the custom catalog implementation for Iceberg Format.
So you can choose Iceberg Format and custom metastore type for both Nessie and Polaris.
Here is an example of using RESTCatalog for Polaris:
<img width="858" alt="image" src="https://github.com/user-attachments/assets/05f86e14-512c-4012-88d2-a972062557f6">
And you can also set the `catalog-impl` to [org.apache.iceberg.nessie.NessieCatalog](https://github.com/apache/iceberg/blob/main/nessie/src/main/java/org/apache/iceberg/nessie/NessieCatalog.java)
Of course, if this requirement is generic enough, we can also add separate "type" options for Nessie and Paloris (Rest).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "czy006 (via GitHub)" <gi...@apache.org>.
czy006 commented on issue #3089:
URL: https://github.com/apache/amoro/issues/3089#issuecomment-2285784638
We may wait for Nessie/Polaris to enter the first version of the apache Incubator and have a stable api
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "nqvuong1998 (via GitHub)" <gi...@apache.org>.
nqvuong1998 commented on issue #3089:
URL: https://github.com/apache/amoro/issues/3089#issuecomment-2301303941
Hi @zhoujinsong
1. Does Amoro support advanced authentication properties for the Nessie/Polaris REST catalog, such as Bearer authentication settings and OAuth2 settings?
- Example (Spark with Nessie REST Catalog):
- spark.sql.catalog.nessie.oauth2-server-uri
- spark.sql.catalog.nessie.oauth2-server-uri
- spark.sql.catalog.nessie.credential
2. Does Amoro require a custom jar to run with Nessie, such as org.projectnessie.nessie-integrations:nessie-spark-extensions-3.5_2.12?
- Example (Spark with Nessie REST Catalog): spark.sql.extensions=org.projectnessie.spark.extensions.NessieSparkSessionExtensions,org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3089:
URL: https://github.com/apache/amoro/issues/3089#issuecomment-2699308471
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: Integrate with Nessie/Polaris REST catalog [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #3089: [Improvement]: Integrate with Nessie/Polaris REST catalog
URL: https://github.com/apache/amoro/issues/3089
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org