You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by santhosh kumar <sa...@gmail.com> on 2015/09/24 22:13:52 UTC

mapreduce.Job hang/struck

Hi,

I am new to Hadoop, I installed hadoop on single node and running HDFS and YARN. I have written map reducer program in python but when I execute this, the command hangs or struck.

/opt/hadoop/hadoop-2.6.0>./bin/hadoop jar /opt/hadoop/hadoop-2.6.0/share/hadoop/tools/lib/hadoop-streaming-2.6.0.jar -mapper /Users/Hadoop/Documents/Python_MR/wcMapper.py -reducer /Users/Hadoop/Documents/Python_MR/wcReducer.py -input /var/bigdata/input/movies.csv -output /var/bigdata/output -file /Users/Hadoop/Documents/Python_MR/wcMapper.py -file /Users/Hadoop/Documents/Python_MR/wcReducer.py
15/09/25 01:30:02 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead.
15/09/25 01:30:03 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
packageJobJar: [/Users/Hadoop/Documents/Python_MR/wcMapper.py, /Users/Hadoop/Documents/Python_MR/wcReducer.py, /var/folders/24/pw5x8fqs6zn5pz4xfd9g80m80000gp/T/hadoop-unjar4491124020000582375/] [] /var/folders/24/pw5x8fqs6zn5pz4xfd9g80m80000gp/T/streamjob6794242123082786949.jar tmpDir=null
15/09/25 01:30:03 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
15/09/25 01:30:04 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032
15/09/25 01:30:05 INFO mapred.FileInputFormat: Total input paths to process : 1
15/09/25 01:30:05 INFO mapreduce.JobSubmitter: number of splits:2
15/09/25 01:30:05 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1443124681722_0001
15/09/25 01:30:05 INFO impl.YarnClientImpl: Submitted application application_1443124681722_0001
15/09/25 01:30:05 INFO mapreduce.Job: The url to track the job: http://santhoshs-MacBook-Pro.local:8088/proxy/application_1443124681722_0001/
15/09/25 01:30:05 INFO mapreduce.Job: Running job: job_1443124681722_0001
.
.
.

In the GUI, the Tracking UI  is set to ‘UNASSIGNED’.

Please let me know your expert comments !!!!

Regards,
santhosh