You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2015/04/29 01:04:05 UTC

[jira] [Updated] (PIG-3981) Use Tez counter to collect per output stats

     [ https://issues.apache.org/jira/browse/PIG-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-3981:
----------------------------
    Fix Version/s:     (was: 0.15.0)
                   0.16.0

> Use Tez counter to collect per output stats
> -------------------------------------------
>
>                 Key: PIG-3981
>                 URL: https://issues.apache.org/jira/browse/PIG-3981
>             Project: Pig
>          Issue Type: Improvement
>          Components: tez
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.16.0
>
>
> Pig currently goes to hdfs to collect those information. That will take from several hundred milliseconds to several seconds, which adds overhead for namenode and hurt performance especially for iterative queries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)