You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:24:31 UTC
[I] Replace ThreadLocal with Resource pool when caching resource type classes [hudi]
hudi-bot opened a new issue, #14481:
URL: https://github.com/apache/hudi/issues/14481
This is another comment that stemmed from Timeline Server code-review.
Notes from PR comments:
'''RandomAccessFile is not threadsafe. Hence, we would have to create separate RandomAccessFileObjects for concurrent access. Agree, the current approach of opening a new file per get() call is slow. I have made changes to use ThreadLocal objects. This should reduce the open() calls greatly but for a long running timeline service, there could be open handles getting accumulated per thread. A better approach would be to use Resource Pool but needs to be config tuned and tested. There is another place (ThreadLocal where we might require similar treatment. Will open a ticket to address it. If current perf testing points to the direction of Resource pool, will address it as part of this PR. Otherwise, we can take this in subsequent PR'''
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-104
- Type: Improvement
---
## Comments
06/Sep/19 13:50;taherk77;Hi [~vbalaji] I am not very much aware of what really the issue is in-depth. However from what I saw from the above comments. How about using at BalancedPool of PersistentActor? That will give a lot of isolation and will get your rid of all the synchronisation.;;;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Replace ThreadLocal with Resource pool when caching resource type classes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #14481:
URL: https://github.com/apache/hudi/issues/14481#issuecomment-4795168801
Closing for inactivity. JIRA: [HUDI-104](https://issues.apache.org/jira/browse/HUDI-104). This issue has had no activity for over two years and the GitHub thread has no replies. If this is still relevant, please open a fresh issue with reproduction details on a recent release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Replace ThreadLocal with Resource pool when caching resource type classes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #14481: Replace ThreadLocal with Resource pool when caching resource type classes
URL: https://github.com/apache/hudi/issues/14481
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org