You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Alex Kozlov (JIRA)" <ji...@apache.org> on 2011/03/29 01:17:05 UTC
[jira] [Created] (PIG-1940) Pig should support counters via stderr
in streaming
Pig should support counters via stderr in streaming
---------------------------------------------------
Key: PIG-1940
URL: https://issues.apache.org/jira/browse/PIG-1940
Project: Pig
Issue Type: Improvement
Components: impl
Reporter: Alex Kozlov
As of Pig version 0.7 streaming http://wiki.apache.org/pig/PigStreamingFunctionalSpec does not support status/counters as described in http://hadoop.apache.org/common/docs/r0.20.2/streaming.html#How+do+I+update+counters+in+streaming+applications%3F. Would be very nice to have this functionality.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-1940) Pig should support counters via
stderr in streaming
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015691#comment-13015691 ]
Santhosh Srinivasan commented on PIG-1940:
------------------------------------------
Based on my preliminary analysis, the ExecutableManager.processError() method in o.a.p.impl.streaming needs to parse the reporter related output to access and subsequently increment counters (and possibly the status in the future). Access to the counters can be obtained through the PigStatusReporter.getInstance()
> Pig should support counters via stderr in streaming
> ---------------------------------------------------
>
> Key: PIG-1940
> URL: https://issues.apache.org/jira/browse/PIG-1940
> Project: Pig
> Issue Type: Improvement
> Components: impl
> Reporter: Alex Kozlov
>
> As of Pig version 0.7 streaming http://wiki.apache.org/pig/PigStreamingFunctionalSpec does not support status/counters as described in http://hadoop.apache.org/common/docs/r0.20.2/streaming.html#How+do+I+update+counters+in+streaming+applications%3F. Would be very nice to have this functionality.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira