You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/04/22 07:56:48 UTC
[GitHub] [incubator-iceberg] yiguolei opened a new issue #949: Garbage collection after writer collapsed
yiguolei opened a new issue #949:
URL: https://github.com/apache/incubator-iceberg/issues/949
If the writer thread writes many files and crashed before commit. How does iceberg deal with the left files?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [incubator-iceberg] yiguolei commented on issue #949: Garbage collection after writer collapsed and is there any logic to deal with small files?
Posted by GitBox <gi...@apache.org>.
yiguolei commented on issue #949:
URL: https://github.com/apache/incubator-iceberg/issues/949#issuecomment-619487428
got it
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [incubator-iceberg] openinx commented on issue #949: Garbage collection after writer collapsed and is there any logic to deal with small files?
Posted by GitBox <gi...@apache.org>.
openinx commented on issue #949:
URL: https://github.com/apache/incubator-iceberg/issues/949#issuecomment-617772018
@yiguolei we've provided a spark tool to remove the orphan files, please take a look :-) https://github.com/apache/incubator-iceberg/pull/894
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org