You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Patil Yogesh <pa...@gmail.com> on 2010/11/23 14:00:08 UTC

MapReduce program unable to find custom Mapper.

I am trying to run a sample application. But I am getting follwoing error.

10/11/23 07:37:17 INFO security.Groups: Group mapping
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
cacheTimeout=300000
10/11/23 07:37:17 WARN conf.Configuration: mapred.task.id is deprecated.
Instead, use mapreduce.task.attempt.id
Created Directory!!!
File added in HDFS!!!
10/11/23 07:37:20 WARN mapreduce.JobSubmitter: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
10/11/23 07:37:20 WARN mapreduce.JobSubmitter: No job jar file set.  User
classes may not be found. See Job or Job#setJar(String).
10/11/23 07:37:20 INFO input.FileInputFormat: Total input paths to process :
1
10/11/23 07:37:21 WARN conf.Configuration: mapred.map.tasks is deprecated.
Instead, use mapreduce.job.maps
10/11/23 07:37:21 INFO mapreduce.JobSubmitter: number of splits:3
10/11/23 07:37:21 INFO mapreduce.JobSubmitter: adding the following
namenodes' delegation tokens:null
10/11/23 07:37:21 INFO mapreduce.Job: Running job: job_201011230702_0006
10/11/23 07:37:22 INFO mapreduce.Job:  map 0% reduce 0%
10/11/23 07:37:38 INFO mapreduce.Job: Task Id :
attempt_201011230702_0006_m_000001_0, Status : FAILED
java.lang.RuntimeException: java.lang.ClassNotFoundException:
HDFSClientTest$TokenizerMapper
        at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1128)
        at
org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:167)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:612)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:328)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:217)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:742)
        at org.apache.hadoop.mapred.Child.main(Child.java:211)
Caused by: java.lang.ClassNotFoundException: HDFSClientTest$TokenizerMapper
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:307)


I have created a jar file which includes
HDFSClientTest$TokenizerMapper.class file. But still i am getting this
error.

I am using hadoop-0.21.0

-----
--
Regards,
Yogesh Patil.
-- 
View this message in context: http://old.nabble.com/MapReduce-program-unable-to-find-custom-Mapper.-tp30283799p30283799.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Re: MapReduce program unable to find custom Mapper.

Posted by Harsh J <qw...@gmail.com>.
The warning log (WARN) at the top of the outputs explains the answer pretty
much :)