[GitHub] [systemds] phaniarnab opened a new pull request, #1580: [SYSTEMDS-3346] Multi-threaded buffer pool evictions

[GitBox <gi...@apache.org>]

phaniarnab opened a new pull request, #1580:
URL: https://github.com/apache/systemds/pull/1580

   This patch implements a simple technique to exploit multithreading
   while evicting multiple buffer pool entries. Here we distribute
   the files to be evicted among threads. More sophisticated strategies
   include using our parallel reader/writes, multithreaded write to an
   output stream, however, they have more implementation overhead and
   left as future work. This simple strategy is already beneficial for
   unified memory as UMM tends to evict multiple objects in each
   eviction call while making space for worst-case output sizes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [systemds] phaniarnab commented on pull request #1580: [SYSTEMDS-3346] Multi-threaded buffer pool evictions

["phaniarnab (via GitHub)" <gi...@apache.org>]

phaniarnab commented on PR #1580:
URL: https://github.com/apache/systemds/pull/1580#issuecomment-1425771031

   This work needs more testing. I will keep it open for the next release.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org