You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Junping Du (JIRA)" <ji...@apache.org> on 2015/11/11 19:50:10 UTC
[jira] [Created] (YARN-4346) Test committer.commitJob() behavior
during committing when MR AM get failed.
Junping Du created YARN-4346:
--------------------------------
Summary: Test committer.commitJob() behavior during committing when MR AM get failed.
Key: YARN-4346
URL: https://issues.apache.org/jira/browse/YARN-4346
Project: Hadoop YARN
Issue Type: Improvement
Reporter: Junping Du
In MAPREDUCE-5485, we are adding additional API (isCommitJobRepeatable) to allow job commit can tolerate AM failure in some cases (like FileOutputCommitter in v2 algorithm). Although we have unit test to cover most of flows, we may want a completed end to end test to verify the whole work flow.
The scenario include:
1. For FileOutputCommitter (or some sub class), emulate a MR AM failure or restart during commitJob() in progress
2. Check different behavior for v1 and v2 (support isCommitJobRepeatable() or not)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)