You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Ahmed Radwan (JIRA)" <ji...@apache.org> on 2011/07/07 22:53:16 UTC
[jira] [Created] (MAPREDUCE-2658) Problem running full map & reduce
jobs on mrv2
Problem running full map & reduce jobs on mrv2
----------------------------------------------
Key: MAPREDUCE-2658
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2658
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Reporter: Ahmed Radwan
Following the installation instructions at: https://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL
the randomwriter example runs successfully. However, other full map & reduce jobs (e.g. wordcount) fail with the error:
java.lang.UnsupportedOperationException: Incompatible with LocalRunner
at org.apache.hadoop.mapred.YarnOutputFiles.getInputFile(YarnOutputFiles.java:200)
at org.apache.hadoop.mapred.ReduceTask.getMapFiles(ReduceTask.java:223)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:412)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1094)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)
The ReduceTask evaluates the isLocal flag based on the property "mapreduce.jobtracker.address", the default value for this property in mapred-default.xml is 'local' and this is the cause of the problem.
Setting "mapreduce.jobtracker.address" in the mapred-site.xml to something other than "local" seems to solve the problem.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-2658) Problem running full map &
reduce jobs on mrv2
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy resolved MAPREDUCE-2658.
--------------------------------------
Resolution: Duplicate
Sorry, I missed this. It was fixed via MAPREDUCE-3004.
> Problem running full map & reduce jobs on mrv2
> ----------------------------------------------
>
> Key: MAPREDUCE-2658
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2658
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-2658.patch
>
>
> Following the installation instructions at: https://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL
> the randomwriter example runs successfully. However, other full map & reduce jobs (e.g. wordcount) fail with the error:
> java.lang.UnsupportedOperationException: Incompatible with LocalRunner
> at org.apache.hadoop.mapred.YarnOutputFiles.getInputFile(YarnOutputFiles.java:200)
> at org.apache.hadoop.mapred.ReduceTask.getMapFiles(ReduceTask.java:223)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:412)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1094)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)
> The ReduceTask evaluates the isLocal flag based on the property "mapreduce.jobtracker.address", the default value for this property in mapred-default.xml is 'local' and this is the cause of the problem.
> Setting "mapreduce.jobtracker.address" in the mapred-site.xml to something other than "local" seems to solve the problem.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira