You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Wang Yan (Jira)" <ji...@apache.org> on 2020/04/20 05:41:00 UTC

[jira] [Created] (MAPREDUCE-7276) fast fail is not working when a task finishes with failure

Wang Yan created MAPREDUCE-7276:
-----------------------------------

             Summary: fast fail is not working when a task finishes with failure
                 Key: MAPREDUCE-7276
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7276
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: applicationmaster
    Affects Versions: 2.9.2, 3.2.0
         Environment: hadoop 2.9.2, hive 2.3.2 and hive 0.13
            Reporter: Wang Yan


When running a hive job with HFDS disk quota specified, and enable the fast fail feature to fast fail a job when hdfs disk quota limitation is exceeded (mapreduce.job.dfs.storage.capacity.kill-limit-exceed=true), the job is expected to fail fast when one task attempt fails due to the quota limitation.

But I confirmed that the fast fail feature is not working. This seems to be a bug of application master not handling events properly during finishing failure a task.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org