You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "mithilgirish (via GitHub)" <gi...@apache.org> on 2026/05/19 13:12:48 UTC
[I] Support purge in DropTable for physical file deletion [iceberg-go]
mithilgirish opened a new issue, #1092:
URL: https://github.com/apache/iceberg-go/issues/1092
### Feature Request / Improvement
I find that there is no `purge` capability built into `iceberg-go`'s drop operation. is that intentional?
### Questions
1. What is the recommended approach for physical file cleanup after `DropTable` today?
2. Is there a plan to add a `purge bool` parameter to `DropTable` (like Java) or a dedicated `PurgeTable()` method?
### Context
It would be great to have a robust physical cleanup mechanism for `DropTable`, similar to how `ExpireSnapshots` in v0.6.0 now handles cleanup via `PostCommit`.
Please let me know whether creating a pr for this would be helpful
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support purge in DropTable for physical file deletion [iceberg-go]
Posted by "fallintoplace (via GitHub)" <gi...@apache.org>.
fallintoplace commented on issue #1092:
URL: https://github.com/apache/iceberg-go/issues/1092#issuecomment-4491255996
One smaller related gap I noticed is that the common path still cannot request purge: `catalog.Catalog` exposes `DropTable`, and the CLI `drop table` path calls that, so users cannot request purge through the generic API/CLI even when the underlying catalog has a purge implementation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support purge in DropTable for physical file deletion [iceberg-go]
Posted by "laskoviymishka (via GitHub)" <gi...@apache.org>.
laskoviymishka closed issue #1092: Support purge in DropTable for physical file deletion
URL: https://github.com/apache/iceberg-go/issues/1092
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support purge in DropTable for physical file deletion [iceberg-go]
Posted by "tanmayrauth (via GitHub)" <gi...@apache.org>.
tanmayrauth commented on issue #1092:
URL: https://github.com/apache/iceberg-go/issues/1092#issuecomment-4488640111
Thanks for the question! A couple of notes on where we stand:
- For the REST catalog (by far the most common production path), purge is already supported, the server handles physical deletion when purgeRequested=true is sent. This is implemented today.
- For client-side catalogs (Glue, Hive, Hadoop), a client-side purge is inherently best-effort, even Java's implementation can leave orphan files on partial failure. Production deployments rely on expire-snapshots + remove-orphan-files for reliable cleanup regardless.
We'd accept a PR that wires up client-side purge for non-REST catalogs (as an optional interface), but it's not high priority since the reliable cleanup path is through the maintenance operations. If you'd like to contribute it, happy to review, just keep in mind it should be clearly documented as best-effort.
@zeroshade @laskoviymishka what are your thoughts one this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support purge in DropTable for physical file deletion [iceberg-go]
Posted by "mithilgirish (via GitHub)" <gi...@apache.org>.
mithilgirish commented on issue #1092:
URL: https://github.com/apache/iceberg-go/issues/1092#issuecomment-4498389138
Planning to add `PurgeTable` as an optional interface, implement it for the client-side using `WalkDir` + `BulkRemovableIO`, REST catalog satisfies it automatically. Will open a PR shortly!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support purge in DropTable for physical file deletion [iceberg-go]
Posted by "laskoviymishka (via GitHub)" <gi...@apache.org>.
laskoviymishka commented on issue #1092:
URL: https://github.com/apache/iceberg-go/issues/1092#issuecomment-4489100366
Agree here, it's a clear gap, simply due to lack of priority.
@mithilgirish - will you up to create a PR to add this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support purge in DropTable for physical file deletion [iceberg-go]
Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade commented on issue #1092:
URL: https://github.com/apache/iceberg-go/issues/1092#issuecomment-4500323586
Agreed, it's a good gap to fix!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org