You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tajo.apache.org by "Hyunsik Choi (JIRA)" <ji...@apache.org> on 2013/10/01 15:08:23 UTC

[jira] [Created] (TAJO-222) Eliminate local data transmission during repartition phases

Hyunsik Choi created TAJO-222:
---------------------------------

             Summary: Eliminate local data transmission during repartition phases
                 Key: TAJO-222
                 URL: https://issues.apache.org/jira/browse/TAJO-222
             Project: Tajo
          Issue Type: Improvement
          Components: repartitioning
            Reporter: Hyunsik Choi


During a repartition phase, each worker pulls intermediate of completed tasks of one or more child execution blocks. However, a worker pulls the intermediate data completed at the same worker via HTTP. This causes unnecessary read/write overheads on disk. We should eliminate this overhead.



--
This message was sent by Atlassian JIRA
(v6.1#6144)