You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (Commented) (JIRA)" <ji...@apache.org> on 2011/11/14 20:44:52 UTC
[jira] [Commented] (PIG-2363) Provide configuration to disable
persistence of _logs for streaming commands
[ https://issues.apache.org/jira/browse/PIG-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149848#comment-13149848 ]
Daniel Dai commented on PIG-2363:
---------------------------------
That should be good enough. Do you have idea why 0.8 does not have such issue?
> Provide configuration to disable persistence of _logs for streaming commands
> ----------------------------------------------------------------------------
>
> Key: PIG-2363
> URL: https://issues.apache.org/jira/browse/PIG-2363
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: Vivek Padmanabhan
> Attachments: PIG-2363_1.patch
>
>
> For Pig scripts which has streaming commands , the stderr is saved into hdfs under _logs folder in the output directory.
> This behavior was not seen with Pig 0.8 by default, but from 0.9 onwards, we are seeing _logs folder.
> Hence it would be nice to have a configuration to disable this feature.
> Sample script
> {code}
> DEFINE mycmd `t.pl` ship ('t.pl');
> a = load 'i1' as (f1:chararray,f2:chararray);
> b = stream a through mycmd;
> store b into 'output';
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira