[GitHub] [systemds] mboehm7 opened a new pull request #1028: [SYSTEMDS-2600,2626] Fix federated backend request interference

[GitBox <gi...@apache.org>]

mboehm7 opened a new pull request #1028:
URL: https://github.com/apache/systemds/pull/1028


   This patch fixes two major issues of request interference from multiple
   coordinator threads.
   
   First, we now properly maintain separate execution context at the
   federated site for different request streams from parfor workers which
   otherwise could interfer (e.g., on rmvar instructions for shared input
   variables)
   
   Second, even within a stream federated requests (e.g., execute and
   cleanup) could out output each other if there are no data dependencies
   or synchronization between them. We now added barriers for federated
   requests wherever this was necessary.
   
   Last, this patch also fixes unnecessary warning messages of the parfor
   optimizer, specifically in a setting with forced singlenode execution.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [systemds] asfgit closed pull request #1028: [SYSTEMDS-2600,2626] Fix federated backend request interference

[GitBox <gi...@apache.org>]

asfgit closed pull request #1028:
URL: https://github.com/apache/systemds/pull/1028


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org