[GitHub] [arrow-datafusion] thinkharderdev commented on issue #6476: Configurable error handling in `FileStream`

["thinkharderdev (via GitHub)" <gi...@apache.org>]

thinkharderdev commented on issue #6476:
URL: https://github.com/apache/arrow-datafusion/issues/6476#issuecomment-1567371339

   > FWIW the way IOx handles this particular issue is to make use of soft-deletes, i.e. the file is marked deleted within the catalog, but only actually deleted at a later date by a garbage collector.  
   
   Indeed. In our case we have no way of preventing objects being deleted outside of the normal process so we have to deal with it this way. 
   
   > Permitting missing files would of course result in a loss of transaction isolation
   
   Yeah, the default should remain the way it is now and this should only be an escape hatch that can be used in specialized circumstances


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org