You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/02/25 21:32:10 UTC
[GitHub] [iceberg] aokolnychyi opened a new issue #2274: Hive: Support identifiers with catalog
aokolnychyi opened a new issue #2274:
URL: https://github.com/apache/iceberg/issues/2274
Hive 3 offers support for identifiers like `catalog_name.db_name.tbl_name`. I wanted to discuss whether we want this as it is not currently supported by our `HiveCatalog`.
One problem we will face is that v1 and v2 client APIs don't have a way to pass a catalog. It is purely a v3 feature. We could use reflection, as we do in other places, to call it, though. We can also default it in the same way Hive does for older clients.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on issue #2274: Hive: Support identifiers with catalog
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on issue #2274:
URL: https://github.com/apache/iceberg/issues/2274#issuecomment-786781250
Thanks for checking the Hive side, @pvary @marton-bod. Yeah, I was primarily looking for adding an extra level of namespacing.
We have an internal metastore that implements the v3 protocol. That's why I was wondering if we ever plan to support catalogs in our `HiveCatalog` or we need to look for an alternative.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on issue #2274: Hive: Support identifiers with catalog
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on issue #2274:
URL: https://github.com/apache/iceberg/issues/2274#issuecomment-786781441
FYI @raptond @karuppayya
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on issue #2274: Hive: Support identifiers with catalog
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on issue #2274:
URL: https://github.com/apache/iceberg/issues/2274#issuecomment-786242036
@rdblue @RussellSpitzer @pvary @marton-bod, what do you think?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] marton-bod commented on issue #2274: Hive: Support identifiers with catalog
Posted by GitBox <gi...@apache.org>.
marton-bod commented on issue #2274:
URL: https://github.com/apache/iceberg/issues/2274#issuecomment-786693696
Hi Anton,
I just checked the Hive master code and found no query language support for catalogs, only HMS API support. I tried from our iceberg-mr unit tests and got compilation errors when using `catalog_name.db_name.tbl_name` in create table or select statements. This might limit the utility of including this into the `HiveCatalog`, at least from the Hive side - not sure if it'd add more benefit to Spark or Flink. To echo Peter, is it an extra level of namespacing that you're primarily looking for?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] pvary commented on issue #2274: Hive: Support identifiers with catalog
Posted by GitBox <gi...@apache.org>.
pvary commented on issue #2274:
URL: https://github.com/apache/iceberg/issues/2274#issuecomment-786442910
AFAIK Hive queries does not support HMS catalogs so I have only seen unit tests for them.
Shall I check the current status? What are the features we are looking for? Just one more level in the namespace hierarchy, or we are looking for sonething more?
Thanks, Peter
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org