You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/08/19 08:26:47 UTC
[GitHub] [iceberg] gaborkaszab opened a new issue, #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
gaborkaszab opened a new issue, #5584:
URL: https://github.com/apache/iceberg/issues/5584
### Apache Iceberg version
0.13.1
### Query engine
Impala
### Please describe the bug 🐞
When you delete the files of a table from HDFS and then call HiveCatalog.dropTable() then TableOperations.current() throws an uncaught NotFoundException and as a result the table won't be erased from HMS as HiveCatalog.dropTable() will exit before running the code to erase the table from HMS.
https://github.com/apache/iceberg/blob/dd5bb497175bcc75cf63bba16038b7a5d93ffdb2/hive-metastore/src/main/java/org/apache/iceberg/hive/HiveCatalog.java#L172
Further investigation and repro steps are in this Impala ticket: https://issues.apache.org/jira/browse/IMPALA-11503
We had a repro using Iceberg 0.13.1 but after checking the code I believe this is still an issue on latest master.
I have an ongoing implementation for this fix. Let me know if there are any comments on this issue!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rdblue commented on issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
rdblue commented on issue #5584:
URL: https://github.com/apache/iceberg/issues/5584#issuecomment-1234711782
Merged #5510, so I'll close this. Thanks, @yabola!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] vamen commented on issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
vamen commented on issue #5584:
URL: https://github.com/apache/iceberg/issues/5584#issuecomment-1221958658
We also face this issue
A lot of our team mates delete data file in hdfs or s3 because they got used to hadoop catalog based iceberg tables.
when we switched to glue catalog based iceberg table. we used to face this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] gaborkaszab commented on issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
gaborkaszab commented on issue #5584:
URL: https://github.com/apache/iceberg/issues/5584#issuecomment-1220533883
Thanks for the pointer, @nastra! Indeed this is a duplicate of #5510
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] nastra commented on issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
nastra commented on issue #5584:
URL: https://github.com/apache/iceberg/issues/5584#issuecomment-1220434183
@gaborkaszab is this potentially related to https://github.com/apache/iceberg/pull/5510?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] gaborkaszab closed issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
gaborkaszab closed issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
URL: https://github.com/apache/iceberg/issues/5584
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] nastra commented on issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
nastra commented on issue #5584:
URL: https://github.com/apache/iceberg/issues/5584#issuecomment-1220544447
let's leave this issue open until #5510 fixes this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] rdblue closed issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
Posted by GitBox <gi...@apache.org>.
rdblue closed issue #5584: Table remains in HMS when using HiveCatalog.dropTable() after dropping the files of the table from HDFS
URL: https://github.com/apache/iceberg/issues/5584
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org