You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Hongyuan Li (JIRA)" <ji...@apache.org> on 2019/02/21 09:12:00 UTC
[jira] [Created] (MAPREDUCE-7186) JobSubmitter#checkSpecs doesn not
judge whether reduceNums is less than zero.
Hongyuan Li created MAPREDUCE-7186:
--------------------------------------
Summary: JobSubmitter#checkSpecs doesn not judge whether reduceNums is less than zero.
Key: MAPREDUCE-7186
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7186
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: client
Reporter: Hongyuan Li
JobSubmitter#checkSpecs doesn not judge whether reduceNums is less than zero.
{code:java}
private void checkSpecs(Job job) throws ClassNotFoundException,
InterruptedException, IOException {
JobConf jConf = (JobConf)job.getConfiguration();
// Check the output specification
if (jConf.getNumReduceTasks() == 0 ?
jConf.getUseNewMapper() : jConf.getUseNewReducer()) {
org.apache.hadoop.mapreduce.OutputFormat<?, ?> output =
ReflectionUtils.newInstance(job.getOutputFormatClass(),
job.getConfiguration());
output.checkOutputSpecs(job);
} else {
jConf.getOutputFormat().checkOutputSpecs(jtFs, jConf);
}
}
{code}
The code does handle the situation when reduceTaskNums is set to -1 or any other value less than zero.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org