[GitHub] [iceberg] aokolnychyi commented on pull request #6432: Consider moving to ParallelIterable in Deletes::toPositionIndex

["aokolnychyi (via GitHub)" <gi...@apache.org>]

aokolnychyi commented on PR #6432:
URL: https://github.com/apache/iceberg/pull/6432#issuecomment-1425211289

   @rbalamohan, do you have the same position files that are read over and over again for different data files in a combined scan task? Or is it mostly unique delete files per each data file?
   
   I am a bit concerned about using a thread pool on executors. Let me take a look with fresh eyes tomorrow. I wonder whether we can cache the result of reading a particular delete file (like bitmap or whatever is constructed) and reuse that instead of parallelizing reading deletes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org