You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Yiping Han (JIRA)" <ji...@apache.org> on 2009/01/07 21:10:44 UTC
[jira] Created: (PIG-608) Compile or validate the whole script
before execution
Compile or validate the whole script before execution
-----------------------------------------------------
Key: PIG-608
URL: https://issues.apache.org/jira/browse/PIG-608
Project: Pig
Issue Type: Improvement
Components: grunt
Reporter: Yiping Han
This is a very usual scenario:
We are running a big pig job that contains several hadoop jobs. It has been running for long times and the first hadoop job sucess, then suddenly pig report it found a syntax error in the script after the first hadoop job...we have to repeat from the beginning.
It would be nice if pig can compile to the end of the script, find all the syntax error, type mismatch, etc., before it really starts execution.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-608) Compile or validate the whole script
before execution
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich resolved PIG-608.
--------------------------------
Resolution: Fixed
> Compile or validate the whole script before execution
> -----------------------------------------------------
>
> Key: PIG-608
> URL: https://issues.apache.org/jira/browse/PIG-608
> Project: Pig
> Issue Type: Improvement
> Components: grunt
> Reporter: Yiping Han
>
> This is a very usual scenario:
> We are running a big pig job that contains several hadoop jobs. It has been running for long times and the first hadoop job sucess, then suddenly pig report it found a syntax error in the script after the first hadoop job...we have to repeat from the beginning.
> It would be nice if pig can compile to the end of the script, find all the syntax error, type mismatch, etc., before it really starts execution.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-608) Compile or validate the whole script
before execution
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12681941#action_12681941 ]
Richard Ding commented on PIG-608:
----------------------------------
This issue will be addressed by https://issues.apache.org/jira/browse/PIG-627
> Compile or validate the whole script before execution
> -----------------------------------------------------
>
> Key: PIG-608
> URL: https://issues.apache.org/jira/browse/PIG-608
> Project: Pig
> Issue Type: Improvement
> Components: grunt
> Reporter: Yiping Han
>
> This is a very usual scenario:
> We are running a big pig job that contains several hadoop jobs. It has been running for long times and the first hadoop job sucess, then suddenly pig report it found a syntax error in the script after the first hadoop job...we have to repeat from the beginning.
> It would be nice if pig can compile to the end of the script, find all the syntax error, type mismatch, etc., before it really starts execution.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-608) Compile or validate the whole script
before execution
Posted by "Alan Gates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661710#action_12661710 ]
Alan Gates commented on PIG-608:
--------------------------------
Pig does parse, type check, and plan an entire query up to a store or dump. Are you seeing this in any case other than after an intermediate store or dump? If not, then this is a duplicate of PIG-607.
> Compile or validate the whole script before execution
> -----------------------------------------------------
>
> Key: PIG-608
> URL: https://issues.apache.org/jira/browse/PIG-608
> Project: Pig
> Issue Type: Improvement
> Components: grunt
> Reporter: Yiping Han
>
> This is a very usual scenario:
> We are running a big pig job that contains several hadoop jobs. It has been running for long times and the first hadoop job sucess, then suddenly pig report it found a syntax error in the script after the first hadoop job...we have to repeat from the beginning.
> It would be nice if pig can compile to the end of the script, find all the syntax error, type mismatch, etc., before it really starts execution.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (PIG-608) Compile or validate the whole script
before execution
Posted by "Yiping Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661714#action_12661714 ]
Yiping Han commented on PIG-608:
--------------------------------
Alan, I think that's the problem. Everything up to a store or dump is checked but if there is an error after that, it will be reported until the previous store or dump finished. I don't think this is a duplicate of PIG-607, but I agree the fix to PIG-607 might be able to fix this problem (depends on the actual solution).
> Compile or validate the whole script before execution
> -----------------------------------------------------
>
> Key: PIG-608
> URL: https://issues.apache.org/jira/browse/PIG-608
> Project: Pig
> Issue Type: Improvement
> Components: grunt
> Reporter: Yiping Han
>
> This is a very usual scenario:
> We are running a big pig job that contains several hadoop jobs. It has been running for long times and the first hadoop job sucess, then suddenly pig report it found a syntax error in the script after the first hadoop job...we have to repeat from the beginning.
> It would be nice if pig can compile to the end of the script, find all the syntax error, type mismatch, etc., before it really starts execution.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.