[jira] [Commented] (TEZ-1117) Option to make YARN application failed on dag failure

["Nick Dimiduk (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098736#comment-14098736 ] 

Nick Dimiduk commented on TEZ-1117:
-----------------------------------

I'm seeing a similar thing with Tez-based Hive jobs. Launch a job as {{hive -e ...}} that fails for some reason. Hive tells me it failed, but the job is reported on the cluster as SUCCESS.

I'm struggling to imagine when I'd want a partial DAG failure to be anything but FAIL. Maybe if I coded the DAG directly, I'd want to mark some portions optional? When the DAG is generated by a planner (Pig, Hive, Cascading), the entries are there because the planner says they're necessary; they should all complete or it's failure. This equivalent to my query MR step 3 out of 5 failing and marking as SUCCESS.

> Option to make YARN application failed on dag failure
> -----------------------------------------------------
>
>                 Key: TEZ-1117
>                 URL: https://issues.apache.org/jira/browse/TEZ-1117
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>
> Can we have an configuration to make the Application status FAILED on termination if one of the DAGs fail? It is very confusing  for users to see the application SUCCEEDED.



--
This message was sent by Atlassian JIRA
(v6.2#6252)