You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Bikas Saha (JIRA)" <ji...@apache.org> on 2015/11/25 19:35:10 UTC

[jira] [Created] (TEZ-2962) Use per partition stats in shuffle vertex manager auto parallelism

Bikas Saha created TEZ-2962:
-------------------------------

             Summary: Use per partition stats in shuffle vertex manager auto parallelism
                 Key: TEZ-2962
                 URL: https://issues.apache.org/jira/browse/TEZ-2962
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Bikas Saha


The original code used output size sent by completed tasks. Recently per partition stats have been added that provide granular information. Using partition stats may be more accurate and also remove the duplicate counting of data size in partition stats and per task overall.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)