You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "jordepic (via GitHub)" <gi...@apache.org> on 2026/06/04 14:34:33 UTC

[I] [Feature] Download remote index files when already built [paimon]

jordepic opened a new issue, #8123:
URL: https://github.com/apache/paimon/issues/8123

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   Now that Paimon enables remote index files for data, we should also be able to use them where possible on the read path.
   
   Some jobs have a capped local disk, and so being able to quickly fetch these back rather than rebuild them is very useful for making lookup joins lower latency.  For now, we'll keep things simple - this should only run when lookup files are being persisted to object store, deletion vectors are off (i.e. MOR tables), and we can actually use the SSTable files persisted by compaction jobs (the join consumer wants the full row schema as opposed to a projection of the data).
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org