You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "RussellSpitzer (via GitHub)" <gi...@apache.org> on 2023/02/16 19:58:37 UTC
[GitHub] [iceberg] RussellSpitzer opened a new issue, #6863: Consider allows catalog.warehouse for Spark Hive Catalogs
RussellSpitzer opened a new issue, #6863:
URL: https://github.com/apache/iceberg/issues/6863
### Feature Request / Improvement
Currently we only allow setting warehouse dir for Hadoop Catalogs but it would probably be useful to allow this for Hive Catalogs as well. We now make a new Hadoop configuration for every Hive Catalog so we could always just add in hive.metastore.warhouse.dir property.
This would allow folks to not specify locations for tables for a configured Catalog.
### Query engine
Spark
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] youngxinler commented on issue #6863: Consider allows catalog.warehouse for Spark Hive Catalogs
Posted by "youngxinler (via GitHub)" <gi...@apache.org>.
youngxinler commented on issue #6863:
URL: https://github.com/apache/iceberg/issues/6863#issuecomment-1436846022
thanks for @RussellSpitzer , good hint, i supports `spark.sql.warehouse.dir` and assumes that `spark.sql.catalog.$catalogName.warehouse` is preferred.
PR has been associated, if there is any problem with the code, you can directly raise it, looking forward to your guidance and review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Consider allows catalog.warehouse for Spark Hive Catalogs [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #6863: Consider allows catalog.warehouse for Spark Hive Catalogs
URL: https://github.com/apache/iceberg/issues/6863
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] youngxinler commented on issue #6863: Consider allows catalog.warehouse for Spark Hive Catalogs
Posted by "youngxinler (via GitHub)" <gi...@apache.org>.
youngxinler commented on issue #6863:
URL: https://github.com/apache/iceberg/issues/6863#issuecomment-1434146591
I will be happy to do this. @RussellSpitzer
But I have a question, you mean if `spark.sql.catalog.catalog-name.type=hive`, use `spark.sql.catalog.catalog-name.warehouse` as `hive.metastore.warhouse.dir` default configuration of hive catalog value passed into `HiveCatalog`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on issue #6863: Consider allows catalog.warehouse for Spark Hive Catalogs
Posted by "RussellSpitzer (via GitHub)" <gi...@apache.org>.
RussellSpitzer commented on issue #6863:
URL: https://github.com/apache/iceberg/issues/6863#issuecomment-1434753229
I think that is one way to do it. We also may want to consider if we should respect the Spark.sql.warehouse did property if it exists
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] github-actions[bot] commented on issue #6863: Consider allows catalog.warehouse for Spark Hive Catalogs
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #6863:
URL: https://github.com/apache/iceberg/issues/6863#issuecomment-1685136574
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Consider allows catalog.warehouse for Spark Hive Catalogs [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #6863:
URL: https://github.com/apache/iceberg/issues/6863#issuecomment-1879443678
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org