You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2014/03/07 22:38:44 UTC

[jira] [Created] (TEZ-921) Pending counter improvements

Siddharth Seth created TEZ-921:
----------------------------------

             Summary: Pending counter improvements
                 Key: TEZ-921
                 URL: https://issues.apache.org/jira/browse/TEZ-921
             Project: Apache Tez
          Issue Type: Task
            Reporter: Siddharth Seth


General ticket to track improvements to Counters

- Separate counters used by MapReduce (Map/ReduceProcessor) from counters used by runtime-library components
- Some counters have different meanings in different Inputs / Outputs. That can be confusing (example NUM_SPILLED_RECORDS for OnFIleSortedOutput vs ShuffledMergedInput)
- Counters need to be available at a per Input / Output level without renaming them (separate instances per I/O/P - and accessible separately via the APIs)
- Inputs / Outputs should be able to specify which counters they provide - and add documentation on the exact semantics



--
This message was sent by Atlassian JIRA
(v6.2#6252)