You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Sujit Dhamale <su...@gmail.com> on 2012/04/09 05:26:10 UTC
Mapping is not happening.
hi all ,
i did all Hadoop installation and Configuration , but while Executing Word
count program , Mapping is not happening
not getting result
getting Below Result while executing program
sujit@sujit:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.1.jar
wordcount /input /output
****hdfs://localhost:54310/
input
12/04/08 20:58:04 INFO input.FileInputFormat: Total input paths to process
: 1
12/04/08 20:58:04 INFO mapred.JobClient: Running job: job_201204082039_0002
12/04/08 20:58:05 INFO mapred.JobClient: map 0% reduce 0%
12/04/08 20:58:05 INFO mapred.JobClient: Job complete: job_201204082039_0002
12/04/08 20:58:05 INFO mapred.JobClient: Counters: 0
Hadoop Version: hadoop-1.0.1.tar.gz
java version "1.6.0_30"
Operating System : Ubuntu 11.10
Below are *steps to reproduce** *
sujit@sujit:~$ cd /usr/local/hadoop
*sujit@sujit:/usr/local/hadoop$ bin/start-all.sh *
Warning: $HADOOP_HOME is deprecated.
starting namenode, logging to
/usr/local/hadoop/libexec/../logs/hadoop-sujit-namenode-sujit.out
localhost: starting datanode, logging to
/usr/local/hadoop/libexec/../logs/hadoop-sujit-datanode-sujit.out
localhost: starting secondarynamenode, logging to
/usr/local/hadoop/libexec/../logs/hadoop-sujit-secondarynamenode-sujit.out
starting jobtracker, logging to
/usr/local/hadoop/libexec/../logs/hadoop-sujit-jobtracker-sujit.out
localhost: starting tasktracker, logging to
/usr/local/hadoop/libexec/../logs/hadoop-sujit-tasktracker-sujit.out
*sujit@sujit:/usr/local/hadoop$ jps*
7297 TaskTracker
6720 DataNode
6485 NameNode
7411 Jps
7061 JobTracker
6969 SecondaryNameNode
7061 JobTracker
6969 SecondaryNameNode
*sujit@sujit:/usr/local/hadoop$ bin/hadoop fs -cat /input/input.txt*
Warning: $HADOOP_HOME is deprecated.
Hello World
This is Sujit
Sujit Dhamale
Hello
*sujit@sujit:/usr/local/hadoop$ bin/hadoop dfs -lsr /*
Warning: $HADOOP_HOME is deprecated.
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app/hadoop
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app/hadoop/tmp
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:40
/app/hadoop/tmp/mapred
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging/sujit
drwx------ - sujit supergroup 0 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging
drwx------ - sujit supergroup 0 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001
-rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.jar
-rw-r--r-- 10 sujit supergroup 110 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.split
-rw-r--r-- 1 sujit supergroup 26 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.splitmetainfo
-rw-r--r-- 1 sujit supergroup 20238 2012-04-08 20:31
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.xml
drwx------ - sujit supergroup 0 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0002
-rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0002/job.jar
drwx------ - sujit supergroup 0 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003
-rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.jar
-rw-r--r-- 10 sujit supergroup 110 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.split
-rw-r--r-- 1 sujit supergroup 26 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.splitmetainfo
-rw-r--r-- 1 sujit supergroup 20242 2012-04-08 20:34
/app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.xml
drwx------ - sujit supergroup 0 2012-04-08 20:40
/app/hadoop/tmp/mapred/system
-rw------- 1 sujit supergroup 4 2012-04-08 20:40
/app/hadoop/tmp/mapred/system/jobtracker.info
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:29 /input
-rw-r--r-- 1 sujit supergroup 47 2012-04-08 20:29 /input/input.txt
sujit@sujit:/usr/local/hadoop$
*sujit@sujit:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.1.jar
wordcount /input /output*
Warning: $HADOOP_HOME is deprecated.
****hdfs://localhost:54310/input
12/04/08 20:55:21 INFO input.FileInputFormat: Total input paths to process
: 1
12/04/08 20:55:22 INFO mapred.JobClient: Running job: job_201204082039_0001
12/04/08 20:55:23 INFO mapred.JobClient: map 0% reduce 0%
12/04/08 20:55:23 INFO mapred.JobClient: Job complete: job_201204082039_0001
12/04/08 20:55:23 INFO mapred.JobClient: Counters: 0
*sujit@sujit:/usr/local/hadoop$ bin/hadoop dfs -lsr /output*
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:55 /output/_logs
drwxr-xr-x - sujit supergroup 0 2012-04-08 20:55
/output/_logs/history
-rw-r--r-- 1 sujit supergroup 1156 2012-04-08 20:55
/output/_logs/history/job_201204082039_0001_1333898722111_sujit_word+count
-rw-r--r-- 1 sujit supergroup 20302 2012-04-08 20:55
/output/_logs/history/job_201204082039_0001_conf.xml
RE: Mapping is not happening.
Posted by Devaraj k <de...@huawei.com>.
Hi Sujit,
Can you check the Job tracker logs for job_201204082039_0002 related info, you can find out what is the status/error.
If you give the job_201204082039_0002 related info from Job tracker/task tracker, can help better.
Thanks
Devaraj
________________________________________
From: Sujit Dhamale [sujitdhamale89@gmail.com]
Sent: Tuesday, April 10, 2012 11:57 AM
To: common-user@hadoop.apache.org
Subject: Re: Mapping is not happening.
Hi Friends ,
i am not able to run word count problem ,
Please look in the below issue.
i am not able to Find what exactly issue is , not able to troubleshoot.
please help me out :)
Thanks in Advance.
Kind Regards
Sujit
On Mon, Apr 9, 2012 at 8:56 AM, Sujit Dhamale <su...@gmail.com>wrote:
> hi all ,
> i did all Hadoop installation and Configuration , but while Executing
> Word count program , Mapping is not happening
> not getting result
> getting Below Result while executing program
>
> sujit@sujit:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.1.jar
> wordcount /input /output
> ****hdfs://localhost:54310/
> input
> 12/04/08 20:58:04 INFO input.FileInputFormat: Total input paths to process
> : 1
> 12/04/08 20:58:04 INFO mapred.JobClient: Running job: job_201204082039_0002
> 12/04/08 20:58:05 INFO mapred.JobClient: map 0% reduce 0%
> 12/04/08 20:58:05 INFO mapred.JobClient: Job complete:
> job_201204082039_0002
> 12/04/08 20:58:05 INFO mapred.JobClient: Counters: 0
>
>
>
>
> Hadoop Version: hadoop-1.0.1.tar.gz
> java version "1.6.0_30"
> Operating System : Ubuntu 11.10
>
> Below are *steps to reproduce** *
>
> sujit@sujit:~$ cd /usr/local/hadoop
>
> *sujit@sujit:/usr/local/hadoop$ bin/start-all.sh *
> Warning: $HADOOP_HOME is deprecated.
> starting namenode, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-namenode-sujit.out
> localhost: starting datanode, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-datanode-sujit.out
> localhost: starting secondarynamenode, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-secondarynamenode-sujit.out
> starting jobtracker, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-jobtracker-sujit.out
> localhost: starting tasktracker, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-tasktracker-sujit.out
>
> *sujit@sujit:/usr/local/hadoop$ jps*
> 7297 TaskTracker
> 6720 DataNode
> 6485 NameNode
> 7411 Jps
> 7061 JobTracker
> 6969 SecondaryNameNode
> 7061 JobTracker
> 6969 SecondaryNameNode
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop fs -cat /input/input.txt*
> Warning: $HADOOP_HOME is deprecated.
>
> Hello World
> This is Sujit
> Sujit Dhamale
> Hello
>
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop dfs -lsr /*
> Warning: $HADOOP_HOME is deprecated.
>
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app/hadoop
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app/hadoop/tmp
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:40
> /app/hadoop/tmp/mapred
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit
> drwx------ - sujit supergroup 0 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging
> drwx------ - sujit supergroup 0 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001
> -rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.jar
> -rw-r--r-- 10 sujit supergroup 110 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.split
> -rw-r--r-- 1 sujit supergroup 26 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.splitmetainfo
> -rw-r--r-- 1 sujit supergroup 20238 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.xml
> drwx------ - sujit supergroup 0 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0002
> -rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0002/job.jar
> drwx------ - sujit supergroup 0 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003
> -rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.jar
> -rw-r--r-- 10 sujit supergroup 110 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.split
> -rw-r--r-- 1 sujit supergroup 26 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.splitmetainfo
> -rw-r--r-- 1 sujit supergroup 20242 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.xml
> drwx------ - sujit supergroup 0 2012-04-08 20:40
> /app/hadoop/tmp/mapred/system
> -rw------- 1 sujit supergroup 4 2012-04-08 20:40
> /app/hadoop/tmp/mapred/system/jobtracker.info
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:29 /input
> -rw-r--r-- 1 sujit supergroup 47 2012-04-08 20:29
> /input/input.txt
> sujit@sujit:/usr/local/hadoop$
>
>
>
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.1.jar
> wordcount /input /output*
> Warning: $HADOOP_HOME is deprecated.
>
> ****hdfs://localhost:54310/input
> 12/04/08 20:55:21 INFO input.FileInputFormat: Total input paths to process
> : 1
> 12/04/08 20:55:22 INFO mapred.JobClient: Running job: job_201204082039_0001
> 12/04/08 20:55:23 INFO mapred.JobClient: map 0% reduce 0%
> 12/04/08 20:55:23 INFO mapred.JobClient: Job complete:
> job_201204082039_0001
> 12/04/08 20:55:23 INFO mapred.JobClient: Counters: 0
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop dfs -lsr /output*
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:55 /output/_logs
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:55
> /output/_logs/history
> -rw-r--r-- 1 sujit supergroup 1156 2012-04-08 20:55
> /output/_logs/history/job_201204082039_0001_1333898722111_sujit_word+count
> -rw-r--r-- 1 sujit supergroup 20302 2012-04-08 20:55
> /output/_logs/history/job_201204082039_0001_conf.xml
>
Re: Mapping is not happening.
Posted by Sujit Dhamale <su...@gmail.com>.
Hi Friends ,
i am not able to run word count problem ,
Please look in the below issue.
i am not able to Find what exactly issue is , not able to troubleshoot.
please help me out :)
Thanks in Advance.
Kind Regards
Sujit
On Mon, Apr 9, 2012 at 8:56 AM, Sujit Dhamale <su...@gmail.com>wrote:
> hi all ,
> i did all Hadoop installation and Configuration , but while Executing
> Word count program , Mapping is not happening
> not getting result
> getting Below Result while executing program
>
> sujit@sujit:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.1.jar
> wordcount /input /output
> ****hdfs://localhost:54310/
> input
> 12/04/08 20:58:04 INFO input.FileInputFormat: Total input paths to process
> : 1
> 12/04/08 20:58:04 INFO mapred.JobClient: Running job: job_201204082039_0002
> 12/04/08 20:58:05 INFO mapred.JobClient: map 0% reduce 0%
> 12/04/08 20:58:05 INFO mapred.JobClient: Job complete:
> job_201204082039_0002
> 12/04/08 20:58:05 INFO mapred.JobClient: Counters: 0
>
>
>
>
> Hadoop Version: hadoop-1.0.1.tar.gz
> java version "1.6.0_30"
> Operating System : Ubuntu 11.10
>
> Below are *steps to reproduce** *
>
> sujit@sujit:~$ cd /usr/local/hadoop
>
> *sujit@sujit:/usr/local/hadoop$ bin/start-all.sh *
> Warning: $HADOOP_HOME is deprecated.
> starting namenode, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-namenode-sujit.out
> localhost: starting datanode, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-datanode-sujit.out
> localhost: starting secondarynamenode, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-secondarynamenode-sujit.out
> starting jobtracker, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-jobtracker-sujit.out
> localhost: starting tasktracker, logging to
> /usr/local/hadoop/libexec/../logs/hadoop-sujit-tasktracker-sujit.out
>
> *sujit@sujit:/usr/local/hadoop$ jps*
> 7297 TaskTracker
> 6720 DataNode
> 6485 NameNode
> 7411 Jps
> 7061 JobTracker
> 6969 SecondaryNameNode
> 7061 JobTracker
> 6969 SecondaryNameNode
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop fs -cat /input/input.txt*
> Warning: $HADOOP_HOME is deprecated.
>
> Hello World
> This is Sujit
> Sujit Dhamale
> Hello
>
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop dfs -lsr /*
> Warning: $HADOOP_HOME is deprecated.
>
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app/hadoop
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:20 /app/hadoop/tmp
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:40
> /app/hadoop/tmp/mapred
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit
> drwx------ - sujit supergroup 0 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging
> drwx------ - sujit supergroup 0 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001
> -rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.jar
> -rw-r--r-- 10 sujit supergroup 110 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.split
> -rw-r--r-- 1 sujit supergroup 26 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.splitmetainfo
> -rw-r--r-- 1 sujit supergroup 20238 2012-04-08 20:31
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0001/job.xml
> drwx------ - sujit supergroup 0 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0002
> -rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0002/job.jar
> drwx------ - sujit supergroup 0 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003
> -rw-r--r-- 10 sujit supergroup 142465 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.jar
> -rw-r--r-- 10 sujit supergroup 110 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.split
> -rw-r--r-- 1 sujit supergroup 26 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.splitmetainfo
> -rw-r--r-- 1 sujit supergroup 20242 2012-04-08 20:34
> /app/hadoop/tmp/mapred/staging/sujit/.staging/job_201204082020_0003/job.xml
> drwx------ - sujit supergroup 0 2012-04-08 20:40
> /app/hadoop/tmp/mapred/system
> -rw------- 1 sujit supergroup 4 2012-04-08 20:40
> /app/hadoop/tmp/mapred/system/jobtracker.info
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:29 /input
> -rw-r--r-- 1 sujit supergroup 47 2012-04-08 20:29
> /input/input.txt
> sujit@sujit:/usr/local/hadoop$
>
>
>
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop jar hadoop-examples-1.0.1.jar
> wordcount /input /output*
> Warning: $HADOOP_HOME is deprecated.
>
> ****hdfs://localhost:54310/input
> 12/04/08 20:55:21 INFO input.FileInputFormat: Total input paths to process
> : 1
> 12/04/08 20:55:22 INFO mapred.JobClient: Running job: job_201204082039_0001
> 12/04/08 20:55:23 INFO mapred.JobClient: map 0% reduce 0%
> 12/04/08 20:55:23 INFO mapred.JobClient: Job complete:
> job_201204082039_0001
> 12/04/08 20:55:23 INFO mapred.JobClient: Counters: 0
>
> *sujit@sujit:/usr/local/hadoop$ bin/hadoop dfs -lsr /output*
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:55 /output/_logs
> drwxr-xr-x - sujit supergroup 0 2012-04-08 20:55
> /output/_logs/history
> -rw-r--r-- 1 sujit supergroup 1156 2012-04-08 20:55
> /output/_logs/history/job_201204082039_0001_1333898722111_sujit_word+count
> -rw-r--r-- 1 sujit supergroup 20302 2012-04-08 20:55
> /output/_logs/history/job_201204082039_0001_conf.xml
>