You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Ido Hadanny (JIRA)" <ji...@apache.org> on 2013/01/07 14:44:13 UTC

[jira] [Created] (PIG-3117) A debug mode in which pig does not delete temporary files

Ido Hadanny created PIG-3117:
--------------------------------

             Summary: A debug mode in which pig does not delete temporary files
                 Key: PIG-3117
                 URL: https://issues.apache.org/jira/browse/PIG-3117
             Project: Pig
          Issue Type: Wish
    Affects Versions: 0.10.0
            Reporter: Ido Hadanny


when we debug our pig jobs on pre-production data, we usually find bugs we couldn't detect in our UT, as env and data are not quite the same.

when the final output of a script is not quite what we expect, we start divide-and-conquer, running it line by line and inspecting the intermediate output of each stage. 

It would be great if we could simply configure pig not to delete the intermediate MR outputs, and store them as plaintext instead of snappy format.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira