You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/05/30 09:17:32 UTC
[GitHub] [iceberg] flashJd opened a new issue, #4901: how can we clean the history metadata.json
flashJd opened a new issue, #4901:
URL: https://github.com/apache/iceberg/issues/4901
Spark ExpireSnapshotsAction never expire metadata.json, neither the Remove OrphanFilesAction, so I wonder if we could add the metadata.json expire logic in ExpireSnapshotsAction, otherwise there will be a lot of boring history metadata.json exists in file system.
I'm willing to offer a PR if it is worthy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] flashJd commented on issue #4901: how can we clean the history metadata.json
Posted by GitBox <gi...@apache.org>.
flashJd commented on issue #4901:
URL: https://github.com/apache/iceberg/issues/4901#issuecomment-1141587839
thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] samredai commented on issue #4901: how can we clean the history metadata.json
Posted by GitBox <gi...@apache.org>.
samredai commented on issue #4901:
URL: https://github.com/apache/iceberg/issues/4901#issuecomment-1141509600
Hey @flashJd, there are some table properties that can be used for this, as described [here](https://iceberg.apache.org/docs/latest/maintenance/#remove-old-metadata-files) in the docs.
- `write.metadata.delete-after-commit.enabled`
- `write.metadata.previous-versions-max`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] samredai closed issue #4901: how can we clean the history metadata.json
Posted by GitBox <gi...@apache.org>.
samredai closed issue #4901: how can we clean the history metadata.json
URL: https://github.com/apache/iceberg/issues/4901
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org