You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2008/05/10 00:59:55 UTC

[jira] Created: (PIG-237) Pig allows to overwrite existing files

Pig allows to overwrite existing files
--------------------------------------

                 Key: PIG-237
                 URL: https://issues.apache.org/jira/browse/PIG-237
             Project: Pig
          Issue Type: Bug
            Reporter: Olga Natkovich


You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.

A = load 'data';
store A into 'foo';

The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-237) Pig allows to overwrite existing files

Posted by "Pi Song (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12595906#action_12595906 ] 

Pi Song commented on PIG-237:
-----------------------------

If this is not an urgent need, I would say it has already been addressed in the type branch.

> Pig allows to overwrite existing files
> --------------------------------------
>
>                 Key: PIG-237
>                 URL: https://issues.apache.org/jira/browse/PIG-237
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Pradeep Kamath
>
> You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.
> A = load 'data';
> store A into 'foo';
> The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-237) Pig allows to overwrite existing files

Posted by "Pi Song (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12596060#action_12596060 ] 

Pi Song commented on PIG-237:
-----------------------------

Sorry for Pradeep. In this case I will create a patch which is a piece of code copied from type branch.
It will be available in 20 if there is no problem (I'm running unit tests).

> Pig allows to overwrite existing files
> --------------------------------------
>
>                 Key: PIG-237
>                 URL: https://issues.apache.org/jira/browse/PIG-237
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Pradeep Kamath
>
> You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.
> A = load 'data';
> store A into 'foo';
> The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-237) Pig allows to overwrite existing files

Posted by "Pi Song (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pi Song updated PIG-237:
------------------------

    Attachment: PIG_237_no_override.patch

The patch.
No test failed.

> Pig allows to overwrite existing files
> --------------------------------------
>
>                 Key: PIG-237
>                 URL: https://issues.apache.org/jira/browse/PIG-237
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Pradeep Kamath
>         Attachments: PIG_237_no_override.patch
>
>
> You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.
> A = load 'data';
> store A into 'foo';
> The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (PIG-237) Pig allows to overwrite existing files

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich reassigned PIG-237:
----------------------------------

    Assignee: Pradeep Kamath

> Pig allows to overwrite existing files
> --------------------------------------
>
>                 Key: PIG-237
>                 URL: https://issues.apache.org/jira/browse/PIG-237
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Pradeep Kamath
>
> You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.
> A = load 'data';
> store A into 'foo';
> The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-237) Pig allows to overwrite existing files

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12596049#action_12596049 ] 

Olga Natkovich commented on PIG-237:
------------------------------------

I think we need a temp fix. This can cause data loss.

> Pig allows to overwrite existing files
> --------------------------------------
>
>                 Key: PIG-237
>                 URL: https://issues.apache.org/jira/browse/PIG-237
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Pradeep Kamath
>
> You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.
> A = load 'data';
> store A into 'foo';
> The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (PIG-237) Pig allows to overwrite existing files

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich resolved PIG-237.
--------------------------------

    Resolution: Fixed

Patch committed. Thanks, Pi.

> Pig allows to overwrite existing files
> --------------------------------------
>
>                 Key: PIG-237
>                 URL: https://issues.apache.org/jira/browse/PIG-237
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Pradeep Kamath
>         Attachments: PIG_237_no_override.patch
>
>
> You can run the following script multiple times and it will not produce the error second time saying that the directory already exists. If the existing file is a single file and not a directory, hadoop eventually produces an error but with directory it runs to completion.
> A = load 'data';
> store A into 'foo';
> The validation code is missing from org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt in  StoreClause() function.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.