You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@nemo.apache.org by GitBox <gi...@apache.org> on 2019/01/22 11:27:11 UTC

[GitHub] sanha opened a new pull request #189: [NEMO-327] Fix skew handling for multi shuffle edge receiver

sanha opened a new pull request #189: [NEMO-327] Fix skew handling for multi shuffle edge receiver
URL: https://github.com/apache/incubator-nemo/pull/189
 
 
   JIRA: [NEMO-327: Fix skew handling for multi shuffle edge receive](https://issues.apache.org/jira/projects/NEMO/issues/NEMO-327)
   
   **Major changes:**
   - For the case that a vertex receives multiple shuffle edges, makes `DataSkewPolicy` collect metric data for the shuffle edges in a single metric aggregation vertex and optimize the edges at once.
   
   **Minor changes to note:**
   - Makes runtime pass receive multiple target edges.
   
   **Tests for the changes:**
   - Adds an integration test with the data skew policy for `NetworkTraceAnalysis` that has a join.
   
   **Other comments:**
   - N/A.
   
   Closes #189
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services