[GitHub] [iceberg] rdblue commented on issue #1178: Parallelize metadata and data file removal on snapshot expiration?

[GitBox <gi...@apache.org>]

rdblue commented on issue #1178:
URL: https://github.com/apache/iceberg/issues/1178#issuecomment-655140373


   It's probably safe to parallelize this, but I think we didn't do it originally because we don't want to get "slow down" responses from services like S3. Seems like adding an option to the API here would be a good idea. Maybe allow passing in a thread pool for deletes?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org