You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "XiaoHongbo-Hope (via GitHub)" <gi...@apache.org> on 2026/10/10 04:00:08 UTC
[PR] [python] Fix local cache being disabled in spawned workers [paimon]
XiaoHongbo-Hope opened a new pull request, #10479:
URL: https://github.com/apache/paimon/pull/10479
### Purpose
Fix local cache being silently disabled when `CachingFileIO` is serialized for spawned workers, causing repeated remote reads of metadata and index blocks.
Reconstruct memory/disk cache managers from their configuration on deserialization. Preserve capacity, block size and shared-manager references; recreate locks without serializing in-memory cached data.
### Tests
41 cache tests passed, including real spawn-worker tests verifying repeated reads reuse cached blocks for both memory and disk caches. Flake8 and `git diff --check` passed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] Fix local cache being disabled in spawned workers [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #10479:
URL: https://github.com/apache/paimon/pull/10479#issuecomment-6110322332
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] Fix local cache being disabled in spawned workers [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #10479:
URL: https://github.com/apache/paimon/pull/10479
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org