You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "zuston (via GitHub)" <gi...@apache.org> on 2026/07/15 09:57:53 UTC
[PR] [core] add data file table query support w/o local cache [paimon]
zuston opened a new pull request, #8658:
URL: https://github.com/apache/paimon/pull/8658
### Purpose
We plan to use Apache Paimon as the cold storage layer for Fluss primary-key tables. The Fluss Flink connector will provide hybrid lookup: active partitions are queried from Fluss, while expired partitions fall back to Paimon.
Since fallback lookups are infrequent and sparse, building a local SST from the entire data file on the first LocalTableQuery access introduces significant and difficult-to-amortize overhead. For this workload, directly pushing primary-key lookups down to the underlying Parquet files should provide better latency and efficiency.
### Tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] add data file table query support w/o local cache [paimon]
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on PR #8658:
URL: https://github.com/apache/paimon/pull/8658#issuecomment-4979308031
Could you help evaluate whether this feature would be reasonable for Paimon? @JingsongLi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] add data file table query support w/o local cache [paimon]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #8658:
URL: https://github.com/apache/paimon/pull/8658#issuecomment-6181412420
This pull request has had no activity for 90 days and is being marked stale. If you'd like to keep it open, please leave a comment or push a new commit. Thank you for your contribution to Apache Paimon!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org