You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/08/11 00:54:22 UTC
[GitHub] [iceberg] aokolnychyi opened a new issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
aokolnychyi opened a new issue #1319:
URL: https://github.com/apache/iceberg/issues/1319
I find it a bit confusing that Iceberg tables show up in non-Iceberg catalogs and vice versa. For example, if a user does SHOW TABLES in the default session catalog, we will see both Iceberg and non-Iceberg tables. If we decide to query one of the Iceberg tables, we will end up with a runtime exception. The same is true for non-Iceberg tables that show up in the Iceberg catalogs.
I know users can configure `spark_catalog` to load both but is there anything we can do better to support use cases when users configure a separate Iceberg catalog? Can we filter tables based on `provider`?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rdblue commented on issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
Posted by GitBox <gi...@apache.org>.
rdblue commented on issue #1319:
URL: https://github.com/apache/iceberg/issues/1319#issuecomment-738464803
I think it is the same. I'll close this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on issue #1319:
URL: https://github.com/apache/iceberg/issues/1319#issuecomment-737769727
@rdblue @zhangjun0x01 @rdsr is this same as #1830? Can we resolve it? PR #1835 added extra calls like @jerryshao mentioned. I am ok with that.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] jerryshao commented on issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
Posted by GitBox <gi...@apache.org>.
jerryshao commented on issue #1319:
URL: https://github.com/apache/iceberg/issues/1319#issuecomment-678063320
From my understanding, the current implementation of `HiveCatalog` will list all tables under specific db, that's why we will see non-iceberg table in iceberg catalog. I think it is doable to filter out non-iceberg table, but it requires to get the properties of each table, which may bring in extra cost for just table listing.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] aokolnychyi commented on issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
Posted by GitBox <gi...@apache.org>.
aokolnychyi commented on issue #1319:
URL: https://github.com/apache/iceberg/issues/1319#issuecomment-739851600
Thanks for working on this, @zhangjun0x01!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rdblue closed issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
Posted by GitBox <gi...@apache.org>.
rdblue closed issue #1319:
URL: https://github.com/apache/iceberg/issues/1319
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] zhangjun0x01 commented on issue #1319: Spark3: Iceberg catalog lits non-Iceberg tables
Posted by GitBox <gi...@apache.org>.
zhangjun0x01 commented on issue #1319:
URL: https://github.com/apache/iceberg/issues/1319#issuecomment-738493545
I think it is same,I closed #1830
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org