You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Prashant Kommireddi (JIRA)" <ji...@apache.org> on 2013/02/08 09:33:13 UTC

[jira] [Updated] (PIG-2553) Pig shouldn't allow attempts to write multiple relations into same directory

     [ https://issues.apache.org/jira/browse/PIG-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prashant Kommireddi updated PIG-2553:
-------------------------------------

    Attachment: PIG-2553_2.patch

Hey [~cheolsoo] attaching a patch. Please note I have made changes to UriUtil.java in removing unused imports. Rest is as we discussed, except that I did not find broken indentation (other than docs, not sure if that needs to be indented too?). Let me know if the indentation needs to be adjusted.
                
> Pig shouldn't allow attempts to write multiple relations into same directory
> ----------------------------------------------------------------------------
>
>                 Key: PIG-2553
>                 URL: https://issues.apache.org/jira/browse/PIG-2553
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Prashant Kommireddi
>         Attachments: PIG-2553_1.patch, PIG-2553_2.patch, PIG-2553.patch
>
>
> We've seen multiple occasions where users accidentally try to store 2 or more different relations to the same destination directory. Currently, this passes the Pig planner and fails on MR side due to concurrent attempts to create the same part file on the reducer. This is extremely confusing to the user, and hard to debug.
> We should instead fail their scripts before they are even submitted, since we can identify the erroneous condition from the beginning.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira