You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2016/05/17 19:59:13 UTC

[jira] [Updated] (PIG-3254) Fail a failed Pig script quicker

     [ https://issues.apache.org/jira/browse/PIG-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-3254:
----------------------------
    Fix Version/s:     (was: 0.16.0)
                   0.17.0

> Fail a failed Pig script quicker
> --------------------------------
>
>                 Key: PIG-3254
>                 URL: https://issues.apache.org/jira/browse/PIG-3254
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Daniel Dai
>             Fix For: 0.17.0
>
>
> Credit to [~asitecn]. Currently Pig could launch several mapreduce job simultaneously. When one mapreduce job fail, we need to wait for simultaneous mapreduce job finish. In addition, we could potentially launch additional jobs which is doomed to fail. However, this is unnecessary in some cases:
> * If "stop.on.failure==true", we can kill parallel jobs, and fail the whole script
> * If "stop.on.failure==false", and no "store" could success, we can also kill parallel jobs, and fail the whole script
> Consider simultaneous jobs may take a long time to finish, this could significantly improve the turn around in some cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)