You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2013/03/20 02:02:05 UTC

[jira] [Created] (PIG-3254) Fail a failed Pig script quicker

Daniel Dai created PIG-3254:
-------------------------------

             Summary: Fail a failed Pig script quicker
                 Key: PIG-3254
                 URL: https://issues.apache.org/jira/browse/PIG-3254
             Project: Pig
          Issue Type: Improvement
            Reporter: Daniel Dai
             Fix For: 0.12


Credit to [~asitecn]. Currently Pig could launch several mapreduce job simultaneously. When one mapreduce job fail, we need to wait for simultaneous mapreduce job finish. In addition, we could potentially launch additional jobs which is doomed to fail. However, this is unnecessary in some cases:
* If "stop.on.failure==true", we can kill parallel jobs, and fail the whole script
* If "stop.on.failure==false", and no "store" could success, we can also kill parallel jobs, and fail the whole script

Consider simultaneous jobs may take a long time to finish, this could significantly improve the turn around in some cases.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira