You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2014/06/02 23:05:03 UTC

[jira] [Created] (PIG-3981) Use Tez counter to collect per output stats

Daniel Dai created PIG-3981:
-------------------------------

             Summary: Use Tez counter to collect per output stats
                 Key: PIG-3981
                 URL: https://issues.apache.org/jira/browse/PIG-3981
             Project: Pig
          Issue Type: Improvement
          Components: tez
            Reporter: Daniel Dai
            Assignee: Daniel Dai
             Fix For: 0.14.0


Pig currently goes to hdfs to collect those information. That will take from several hundred milliseconds to several seconds, which adds overhead for namenode and hurt performance especially for iterative queries.



--
This message was sent by Atlassian JIRA
(v6.2#6252)