[GitHub] [arrow] lidavidm commented on pull request #33744: GH-33743: [Java] Release outstanding buffers when BaseAllocator is being closed

[GitBox <gi...@apache.org>]

lidavidm commented on PR #33744:
URL: https://github.com/apache/arrow/pull/33744#issuecomment-1387331312

   This patch forces everyone to take the opposite tradeoff, however. 
   
   Some sort of nursery that auto-closes buffers may be useful, but I think it should be separate from the base allocator. (The allocator also has a 'listener' to be notified of allocation/deallocation events; possibly you could build this mechanism on top of that.) And nondeterministic collection of buffers is liable to bite you; the GC does not see into native allocations and you can run out of memory despite having 'free' memory because the GC has not collected the small Java-side objects that hold the large native buffers. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org