You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Santhosh Srinivasan (JIRA)" <ji...@apache.org> on 2011/04/05 02:07:05 UTC

[jira] [Commented] (PIG-1940) Pig should support counters via stderr in streaming

    [ https://issues.apache.org/jira/browse/PIG-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015691#comment-13015691 ] 

Santhosh Srinivasan commented on PIG-1940:
------------------------------------------

Based on my preliminary analysis, the ExecutableManager.processError() method in o.a.p.impl.streaming needs to parse the reporter related output to access and subsequently increment counters (and possibly the status in the future). Access to the counters can be obtained through the PigStatusReporter.getInstance()

> Pig should support counters via stderr in streaming
> ---------------------------------------------------
>
>                 Key: PIG-1940
>                 URL: https://issues.apache.org/jira/browse/PIG-1940
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: Alex Kozlov
>
> As of Pig version 0.7 streaming http://wiki.apache.org/pig/PigStreamingFunctionalSpec does not support status/counters as described in http://hadoop.apache.org/common/docs/r0.20.2/streaming.html#How+do+I+update+counters+in+streaming+applications%3F.  Would be very nice to have this functionality.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira