You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by "Ratner, Alan S (IS)" <Al...@ngc.com> on 2010/06/11 15:35:24 UTC
Irreproducible Streaming Jobs
Our Hadoop streaming jobs are unpredictable. The following illustrates
this problem. I reset the system first to start with a clean slate
(deleting tmp files on master and all slaves, reformatting name node,
etc.). I then ran a streaming job which gave the expected results. I
then ran the exact same job again (using a different output file name)
and it bombed. Curiously although the second run generated "no such
file or directory" errors in the log file but so did the first run. I
suspect that our streaming job is doing something wrong (despite the
correct results) and corrupting the tmp files. (These jobs were run on
40 servers configured as 1 master and 39 slaves.) Any suggestions?
FIRST RUN
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input
ImageList -output StegOut1
packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
/tmp/hadoop-ngc/hadoop-unjar1378560104000865091/] []
/tmp/streamjob1574130777925793571.jar tmpDir=null
10/06/11 08:15:09 INFO mapred.FileInputFormat: Total input paths to
process : 1
10/06/11 08:15:09 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/11 08:15:09 INFO streaming.StreamJob: Running job:
job_201006110802_0013
10/06/11 08:15:09 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:15:09 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0013
10/06/11 08:15:09 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0013
10/06/11 08:15:10 INFO streaming.StreamJob: map 0% reduce 0%
10/06/11 08:15:22 INFO streaming.StreamJob: map 50% reduce 0%
10/06/11 08:15:28 INFO streaming.StreamJob: map 100% reduce 0%
10/06/11 08:15:31 INFO streaming.StreamJob: map 100% reduce 17%
10/06/11 08:15:40 INFO streaming.StreamJob: map 100% reduce 100%
10/06/11 08:15:43 INFO streaming.StreamJob: Job complete:
job_201006110802_0013
10/06/11 08:15:43 INFO streaming.StreamJob: Output: StegOut1
SECOND RUN
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input
ImageList -output StegOut2
packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
/tmp/hadoop-ngc/hadoop-unjar7292727069710530665/] []
/tmp/streamjob8749080748645718359.jar tmpDir=null
10/06/11 08:16:00 INFO mapred.FileInputFormat: Total input paths to
process : 1
10/06/11 08:16:00 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/11 08:16:00 INFO streaming.StreamJob: Running job:
job_201006110802_0016
10/06/11 08:16:00 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:16:00 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016
10/06/11 08:16:00 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0016
10/06/11 08:16:01 INFO streaming.StreamJob: map 0% reduce 0%
10/06/11 08:16:19 INFO streaming.StreamJob: map 50% reduce 0%
10/06/11 08:16:28 INFO streaming.StreamJob: map 50% reduce 17%
10/06/11 08:16:32 INFO streaming.StreamJob: map 100% reduce 100%
10/06/11 08:16:32 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:16:32 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016
10/06/11 08:16:32 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0016
10/06/11 08:16:32 ERROR streaming.StreamJob: Job not Successful!
10/06/11 08:16:32 INFO streaming.StreamJob: killJob...
Streaming Job Failed!
MAP LOG FILE OF SECOND RUN
Meta VERSION="1" .
Job JOBID="job_201006110802_0016"
JOBNAME="streamjob8749080748645718359\.jar" USER="ngc"
SUBMIT_TIME="1276258560297"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006110802_0016/job\.xml" .
Job JOBID="job_201006110802_0016" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006110802_0016" LAUNCH_TIME="1276258560564"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
START_TIME="1276258560932" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
START_TIME="1276229924181"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229924886"
HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258563937"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0016" JOB_STATUS="RUNNING" .
Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
START_TIME="1276258563937"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
START_TIME="1276258564747"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
START_TIME="1276229927063"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229931379"
HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000000_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
START_TIME="1276229819233"
TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:35631" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229823283"
HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
START_TIME="1276230008685"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276230012735"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000000_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
START_TIME="1276229520733"
TRACKER_NAME="tracker_hadoop23\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:58025" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
TASK_STATUS="FAILED" FINISH_TIME="1276229524784"
HOSTNAME="hadoop23\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000001_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
START_TIME="1276229773743"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229774851"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258579350"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0016_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276258579351" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
START_TIME="1276316358506"
TRACKER_NAME="tracker_hadoop24\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:38111" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
TASK_STATUS="FAILED" FINISH_TIME="1276316362553"
HOSTNAME="hadoop24\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000001_2/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
START_TIME="1276229596341"
TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:56345" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
HOSTNAME="hadoop19\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_3/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_3/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" TASK_ATTEMPT_ID="" .
Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276258589119" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
START_TIME="1276229602209"
TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:56345" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229602877"
HOSTNAME="/default-rack/hadoop19\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258592124"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0016" FINISH_TIME="1276258592124"
JOB_STATUS="FAILED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .
MAP LOG FILE OF FIRST RUN
eta VERSION="1" .
Job JOBID="job_201006110802_0013"
JOBNAME="streamjob1574130777925793571\.jar" USER="ngc"
SUBMIT_TIME="1276258509559"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006110802_0013/job\.xml" .
Job JOBID="job_201006110802_0013" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006110802_0013" LAUNCH_TIME="1276258509729"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
START_TIME="1276258509836" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
START_TIME="1276229873134"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229873917"
HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258512842"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0013" JOB_STATUS="RUNNING" .
Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
START_TIME="1276258512842"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
START_TIME="1276258512946"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
START_TIME="1276229875959"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229880125"
HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
3/attempt_201006110802_0013_m_000000_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
START_TIME="1276229951632"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229955681"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006110802_0013/att
empt_201006110802_0013_m_000001_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
START_TIME="1276229716711"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229717868"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/user/ngc/Im
ageList/imagelist:9+9"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(0)][(SPILLED_RECORDS)(Spilled
Records)(0)][(MAP_OUTPUT_BYTES)(Map output
bytes)(0)][(MAP_INPUT_BYTES)(Map input
bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258522269"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(0)][(SPILLED_RECORDS)(Spilled
Records)(0)][(MAP_OUTPUT_BYTES)(Map output
bytes)(0)][(MAP_INPUT_BYTES)(Map input
bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276258522270" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
START_TIME="1276229957552"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276229961598"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0013/att
empt_201006110802_0013_m_000000_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
START_TIME="1276229722583"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229723735"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258528279"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006110802_0013_r_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
START_TIME="1276229719549"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006110802_0013_r_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1276229731481"
SORT_FINISHED="1276229731538" FINISH_TIME="1276229734818"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1 > reduce"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_
BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.T
ask$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258540288"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_
BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.T
ask$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276258540289" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
START_TIME="1276229737575"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229738283"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258543294"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0013" FINISH_TIME="1276258543294"
JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1"
FAILED_MAPS="3" FAILED_REDUCES="0"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job
Counters )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
tasks)(5)][(TOTAL_LAUNCHED_MAPS)(Launched map
tasks)(5)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(F
ILE_BYTES_READ)(62)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28)][(FILE_BYTES
_WRITTEN)(FILE_BYTES_WRITTEN)(194)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRIT
TEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(2)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(MAP_OUTPUT_RECORDS)(Map output
records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Re: Irreproducible Streaming Jobs
Posted by Aaron Kimball <aa...@cloudera.com>.
Looking through your logs, I see this error on machine hadoop12:
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
.. an error on machine hadoop31:
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
... and on hadoop31 again:
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_1/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
and there are a bunch more errors of the same kind.
is /tmp/hadoop-ngc/ writable by the hadoop user? what about /media/hd2/ and
/media/hd4? Are your disks possibly full on some nodes? Somehow it's
incapable of running the CliquerMap program. Either it couldn't copy the
file over, or couldn't write it to disk on the target machine.
Are the failing nodes all of one OS type? It makes me a bit nervous that
you're running multiple Linux distributions.
What exact Hadoop version are you running? Apache 0.20.2? Or CDH2?
- Aaron
On Tue, Jun 15, 2010 at 4:54 AM, Ratner, Alan S (IS) <Al...@ngc.com>wrote:
> Here is more background on the problem of irreproducible streaming jobs:
>
> 1) We are taking C code programs and converting them to run in
> Hadoop’s streaming mode.
>
> 2) First we debug these programs by streaming them on a Windows
> laptop running a virtual machine with Ubuntu 9.10 and Hadoop 0.20.1. We
> have done this with two C programs so far and both run correctly and
> consistently in this environment (reproducing the output of the original C
> programs). BTW: I tried the modified command line suggested by Amareshwari
> and the program runs the same either way.
>
> 3) Problems crop us when we move these programs to our Hadoop cluster
> which runs native Ubuntu (some servers running 9.10 and some 10.4) and
> Hadoop 0.20.2. Sometimes these programs run and sometimes they don’t and we
> have no idea as to what is causing this inconsistency (unless it is due to
> the change from Hadoop 0.20.1 to 0.20.2). The logs of failed jobs include
> file or directory not found errors but these aren’t especially helpful since
> they don’t specify which file or directory is missing. I’ve included the
> log files of a successful run and a failed run in the hopes someone can tell
> me what is going wrong.
>
>
>
> *For example, here is successful Run 1:*
>
> * *
>
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper CliquerMap
> -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1 -reducer ARGH1
> -input CliqueIn -output CliqueOut1
>
> packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
> /tmp/hadoop-ngc/hadoop-unjar5693480053986200084/] []
> /tmp/streamjob2257941530123552427.jar tmpDir=null
>
> 10/06/14 15:49:54 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: Running job:
> job_201006141152_0163
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/14 15:49:55 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006141152_0163
>
> 10/06/14 15:49:55 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006141152_0163
>
> 10/06/14 15:49:56 INFO streaming.StreamJob: map 0% reduce 0%
>
> 10/06/14 15:50:02 INFO streaming.StreamJob: map 100% reduce 0%
>
> 10/06/14 15:50:11 INFO streaming.StreamJob: map 100% reduce 33%
>
> 10/06/14 15:50:17 INFO streaming.StreamJob: map 100% reduce 100%
>
> 10/06/14 15:50:20 INFO streaming.StreamJob: Job complete:
> job_201006141152_0163
>
> 10/06/14 15:50:20 INFO streaming.StreamJob: Output: CliqueOut1
>
>
>
> *Here is failed Run 2 – only the name of the output directory has been
> changed:*
>
>
>
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper CliquerMap
> -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1 -reducer ARGH1
> -input CliqueIn -output CliqueOut3
>
> packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
> /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
> /tmp/hadoop-ngc/hadoop-unjar3582440643290869791/] []
> /tmp/streamjob6334481689253156407.jar tmpDir=null
>
> 10/06/14 15:52:30 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: Running job:
> job_201006141152_0165
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/14 15:52:30 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006141152_0165
>
> 10/06/14 15:52:30 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006141152_0165
>
> 10/06/14 15:52:31 INFO streaming.StreamJob: map 0% reduce 0%
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: map 100% reduce 100%
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/14 15:53:01 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006141152_0165
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006141152_0165
>
> 10/06/14 15:53:01 ERROR streaming.StreamJob: Job not Successful!
>
> 10/06/14 15:53:01 INFO streaming.StreamJob: killJob...
>
> Streaming Job Failed!
>
>
>
> *Output log with successful Run 1:*
>
>
>
> Meta VERSION="1" .
>
> Job JOBID="job_201006141152_0163"
> JOBNAME="streamjob2257941530123552427\.jar" USER="ngc"
> SUBMIT_TIME="1276544995086"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006141152_0163/job\.xml"
> .
>
> Job JOBID="job_201006141152_0163" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006141152_0163" LAUNCH_TIME="1276544995298"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276544995355" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0"
> START_TIME="1276544870715"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276544871484"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276544998360"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0163" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
> START_TIME="1276544998360"
> SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
> START_TIME="1276544998367"
> SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0"
> START_TIME="1276544873560"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276544875195"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=10581/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(74122)][(SPILLED_RECORDS)(Spilled
> Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(993185)][(MAP_INPUT_BYTES)(Map input
> bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .
>
> Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545001367"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(74122)][(SPILLED_RECORDS)(Spilled
> Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(993185)][(MAP_INPUT_BYTES)(Map input
> bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .
>
> Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
> START_TIME="1276545001367" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0"
> START_TIME="1276516505443"
> TRACKER_NAME="tracker_hadoop4\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:59097"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276516507087"
> HOSTNAME="/default-rack/hadoop4\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=10490/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1140848)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(73914)][(SPILLED_RECORDS)(Spilled
> Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(992982)][(MAP_INPUT_BYTES)(Map input
> bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .
>
> Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545001372"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1140848)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(73914)][(SPILLED_RECORDS)(Spilled
> Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(992982)][(MAP_INPUT_BYTES)(Map input
> bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006141152_0163_r_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0"
> START_TIME="1276544876558"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006141152_0163_r_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0" TASK_STATUS="SUCCESS"
> SHUFFLE_FINISHED="1276544883268" SORT_FINISHED="1276544883562"
> FINISH_TIME="1276544889011"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=148036/1 > reduce"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(2282245)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(46)][(SPILLED_RECORDS)(Spilled
> Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
>
> Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545016389"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(2282245)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(46)][(SPILLED_RECORDS)(Spilled
> Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
>
> Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276545016389" SPLITS="" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0"
> START_TIME="1276544891567"
> TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:42144"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276544892421"
> HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545019393"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0163" FINISH_TIME="1276545019394"
> JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1" FAILED_MAPS="0"
> FAILED_REDUCES="0"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters
> )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
> tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
> tasks)(2)][(TOTAL_LAUNCHED_MAPS)(Launched map
> tasks)(2)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(2282245)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1967643)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(4564560)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(148036)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(46)][(SPILLED_RECORDS)(Spilled
> Records)(296072)][(MAP_OUTPUT_BYTES)(Map output
> bytes)(1986167)][(MAP_INPUT_BYTES)(Map input
> bytes)(1838131)][(MAP_OUTPUT_RECORDS)(Map output
> records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
>
>
>
> *Output log with failed Run 2:*
>
>
>
> Meta VERSION="1" .
>
> Job JOBID="job_201006141152_0165"
> JOBNAME="streamjob6334481689253156407\.jar" USER="ngc"
> SUBMIT_TIME="1276545150464"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006141152_0165/job\.xml"
> .
>
> Job JOBID="job_201006141152_0165" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006141152_0165" LAUNCH_TIME="1276545150594"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276545150786" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0"
> START_TIME="1276516268757"
> TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:47520"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276516269394"
> HOSTNAME="/default-rack/hadoop11\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545153792"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0165" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
> START_TIME="1276545153792"
> SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006141152_0165_m_000001" TASK_TYPE="MAP"
> START_TIME="1276545153886"
> SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0"
> START_TIME="1276516271602"
> TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:47520"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276516275655" HOSTNAME="hadoop11\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_0/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0"
> START_TIME="1276602962723"
> TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:40869"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276602966774" HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_0/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1"
> START_TIME="1276602968589"
> TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:40869"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276602972635" HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_1/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1"
> START_TIME="1276516428044"
> TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:54798"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276516432095" HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_1/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2"
> START_TIME="1276516433881"
> TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:54798"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2" TASK_STATUS="FAILED"
> FINISH_TIME="1276516437931" HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_2/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2"
> START_TIME="1276574021030"
> TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:45065"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2" TASK_STATUS="FAILED"
> FINISH_TIME="1276574024976" HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_2/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3"
> START_TIME="1276574026882"
> TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:45065"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3" TASK_STATUS="FAILED"
> FINISH_TIME="1276574030934" HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="FAILED" FINISH_TIME="1276574030934"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " TASK_ATTEMPT_ID="" .
>
> Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276545178009" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3"
> START_TIME="1276516443646"
> TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:46295"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3" TASK_STATUS="FAILED"
> FINISH_TIME="1276516447699" HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at
> org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
> Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/attempt_201006141152_0165_m_000001_3/work/\./CliquerMap\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at
> java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0"
> START_TIME="1276574032921"
> TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:45065"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
> TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276574033570"
> HOSTNAME="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276545181014"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006141152_0165" FINISH_TIME="1276545181014"
> JOB_STATUS="FAILED" FINISHED_MAPS="0" FINISHED_REDUCES="0"
>
>
>
> *Alan *
>
>
>
> *From:* Amareshwari Sri Ramadasu [mailto:amarsri@yahoo-inc.com]
> *Sent:* Monday, June 14, 2010 12:44 AM
> *To:* mapreduce-user@hadoop.apache.org
> *Subject:* Re: Irreproducible Streaming Jobs
>
>
>
> I don’t know how your first run passed, but your streaming command should
> be :
> bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file
> streamingapps/Steg/SDMapper -mapper SDMapper -file streamingapps/Steg/Test2
> -reducer Test2 -input ImageList -output StegOut1
>
> Your mapper/reducer should be the command to run. The paths
> streamingapps/Steg/SDMapper and streamingapps/Steg/Test2 would be present on
> your local filesystem (on client machine), not on compute nodes.
>
> Thanks
> Amareshwari
> On 6/11/10 7:05 PM, "Ratner, Alan S (IS)" <Al...@ngc.com> wrote:
>
> Our Hadoop streaming jobs are unpredictable. The following illustrates
> this problem. I reset the system first to start with a clean slate
> (deleting tmp files on master and all slaves, reformatting name node, etc.).
> I then ran a streaming job which gave the expected results. I then ran the
> exact same job again (using a different output file name) and it bombed.
> Curiously although the second run generated “no such file or directory”
> errors in the log file but so did the first run. I suspect that our
> streaming job is doing something wrong (despite the correct results) and
> corrupting the tmp files. (These jobs were run on 40 servers configured as
> 1 master and 39 slaves.) Any suggestions?
>
> *FIRST RUN
> *
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
> streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input ImageList
> -output StegOut1
>
> packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
> /tmp/hadoop-ngc/hadoop-unjar1378560104000865091/] []
> /tmp/streamjob1574130777925793571.jar tmpDir=null
>
> 10/06/11 08:15:09 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: Running job:
> job_201006110802_0013
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/11 08:15:09 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006110802_0013
>
> 10/06/11 08:15:09 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0013
>
> 10/06/11 08:15:10 INFO streaming.StreamJob: map 0% reduce 0%
>
> 10/06/11 08:15:22 INFO streaming.StreamJob: map 50% reduce 0%
>
> 10/06/11 08:15:28 INFO streaming.StreamJob: map 100% reduce 0%
>
> 10/06/11 08:15:31 INFO streaming.StreamJob: map 100% reduce 17%
>
> 10/06/11 08:15:40 INFO streaming.StreamJob: map 100% reduce 100%
>
> 10/06/11 08:15:43 INFO streaming.StreamJob: Job complete:
> job_201006110802_0013
>
> 10/06/11 08:15:43 INFO streaming.StreamJob: Output: StegOut1
>
> *SECOND RUN
> *
> ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
> contrib/streaming/hadoop-0.20.2-streaming.jar -file
> streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
> streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input ImageList
> -output StegOut2
>
> packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
> /tmp/hadoop-ngc/hadoop-unjar7292727069710530665/] []
> /tmp/streamjob8749080748645718359.jar tmpDir=null
>
> 10/06/11 08:16:00 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: getLocalDirs():
> [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
> /media/hd3/mapred/local, /media/hd4/mapred/local]
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: Running job:
> job_201006110802_0016
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/11 08:16:00 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006110802_0016
>
> 10/06/11 08:16:00 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0016
>
> 10/06/11 08:16:01 INFO streaming.StreamJob: map 0% reduce 0%
>
> 10/06/11 08:16:19 INFO streaming.StreamJob: map 50% reduce 0%
>
> 10/06/11 08:16:28 INFO streaming.StreamJob: map 50% reduce 17%
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: map 100% reduce 100%
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: To kill this job, run:
>
> 10/06/11 08:16:32 INFO streaming.StreamJob:
> /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=
> 10.64.147.2:9002 -kill job_201006110802_0016
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: Tracking URL:
> http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0016
>
> 10/06/11 08:16:32 ERROR streaming.StreamJob: Job not Successful!
>
> 10/06/11 08:16:32 INFO streaming.StreamJob: killJob...
>
> Streaming Job Failed!
>
> *MAP LOG FILE OF SECOND RUN
> *
> Meta VERSION="1" .
>
> Job JOBID="job_201006110802_0016"
> JOBNAME="streamjob8749080748645718359\.jar" USER="ngc"
> SUBMIT_TIME="1276258560297"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006110802_0016/job\.xml"
> .
>
> Job JOBID="job_201006110802_0016" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006110802_0016" LAUNCH_TIME="1276258560564"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276258560932" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
> START_TIME="1276229924181"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229924886"
> HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258563937"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0016" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
> START_TIME="1276258563937"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
> START_TIME="1276258564747"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
> START_TIME="1276229927063"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229931379" HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000000_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
> START_TIME="1276229819233"
> TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:35631"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229823283" HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
> START_TIME="1276230008685"
> TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276230012735" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000000_1/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
> START_TIME="1276229520733"
> TRACKER_NAME="tracker_hadoop23\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:58025"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276229524784" HOSTNAME="hadoop23\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_1/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
> START_TIME="1276229773743"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229774851"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=1/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258579350"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> Task TASKID="task_201006110802_0016_r_000000" TASK_TYPE="REDUCE"
> START_TIME="1276258579351" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
> START_TIME="1276316358506"
> TRACKER_NAME="tracker_hadoop24\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:38111"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2" TASK_STATUS="FAILED"
> FINISH_TIME="1276316362553" HOSTNAME="hadoop24\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_2/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
> START_TIME="1276229596341"
> TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:56345"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3" TASK_STATUS="FAILED"
> FINISH_TIME="1276229600392" HOSTNAME="hadoop19\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_3/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
> TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_3/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " TASK_ATTEMPT_ID="" .
>
> Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276258589119" SPLITS="" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
> START_TIME="1276229602209"
> TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:56345"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229602877"
> HOSTNAME="/default-rack/hadoop19\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258592124"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0016" FINISH_TIME="1276258592124"
> JOB_STATUS="FAILED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .
>
> *MAP LOG FILE OF FIRST RUN
> *
> eta VERSION="1" .
>
> Job JOBID="job_201006110802_0013"
> JOBNAME="streamjob1574130777925793571\.jar" USER="ngc"
> SUBMIT_TIME="1276258509559"
> JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006110802_0013/job\.xml"
> .
>
> Job JOBID="job_201006110802_0013" JOB_PRIORITY="NORMAL" .
>
> Job JOBID="job_201006110802_0013" LAUNCH_TIME="1276258509729"
> TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
>
> Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
> START_TIME="1276258509836" SPLITS="" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
> START_TIME="1276229873134"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229873917"
> HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="setup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258512842"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0013" JOB_STATUS="RUNNING" .
>
> Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
> START_TIME="1276258512842"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
> START_TIME="1276258512946"
> SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com"
> .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
> START_TIME="1276229875959"
> TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229880125" HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000000_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
> START_TIME="1276229951632"
> TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0" TASK_STATUS="FAILED"
> FINISH_TIME="1276229955681" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000001_0/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
> START_TIME="1276229716711"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229717868"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/user/ngc/ImageList/imagelist:9+9"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(0)][(MAP_INPUT_BYTES)(Map input
> bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258522269"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(0)][(MAP_INPUT_BYTES)(Map input
> bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
> START_TIME="1276258522270" SPLITS="" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
> START_TIME="1276229957552"
> TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1" TASK_STATUS="FAILED"
> FINISH_TIME="1276229961598" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
> ERROR="java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
>
> at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
>
> at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 5 more
>
> Caused by: java\.lang\.RuntimeException: Error in configuring object
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
>
> at
> org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
>
> \.\.\. 10 more
>
> Caused by: java\.lang\.reflect\.InvocationTargetException
>
> at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
>
> at
> sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
>
> at
> sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
>
> at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
>
> at
> org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
>
> \.\.\. 13 more
>
> Caused by: java\.lang\.RuntimeException: configuration exception
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
>
> \.\.\. 18 more
>
> Caused by: java\.io\.IOException: Cannot run program
> \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000000_1/work/\./SDMapper\":
> java\.io\.IOException: error\=2, No such file or directory
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
>
> at
> org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
>
> \.\.\. 19 more
>
> Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such
> file or directory
>
> at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
>
> at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
>
> at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
>
> \.\.\. 20 more
>
> " .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
> START_TIME="1276229722583"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229723735"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=1/1"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258528279"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006110802_0013_r_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
> START_TIME="1276229719549"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006110802_0013_r_000000"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0" TASK_STATUS="SUCCESS"
> SHUFFLE_FINISHED="1276229731481" SORT_FINISHED="1276229731538"
> FINISH_TIME="1276229734818"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="Records R/W\=1/1 > reduce"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(2)][(SPILLED_RECORDS)(Spilled
> Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
>
> Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258540288"
> COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(2)][(SPILLED_RECORDS)(Spilled
> Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
>
> Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
> START_TIME="1276258540289" SPLITS="" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
> START_TIME="1276229737575"
> TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829"
> HTTP_PORT="50060" .
>
> MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
> TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0" TASK_STATUS="SUCCESS"
> FINISH_TIME="1276229738283"
> HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
> STATE_STRING="cleanup"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
> TASK_STATUS="SUCCESS" FINISH_TIME="1276258543294"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
>
> Job JOBID="job_201006110802_0013" FINISH_TIME="1276258543294"
> JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1" FAILED_MAPS="3"
> FAILED_REDUCES="0"
> COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters
> )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
> tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
> tasks)(5)][(TOTAL_LAUNCHED_MAPS)(Launched map
> tasks)(5)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(194)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
> Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
> groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
> records)(0)][(MAP_INPUT_RECORDS)(Map input
> records)(1)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
> bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
> records)(2)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map
> output bytes)(54)][(MAP_INPUT_BYTES)(Map input
> bytes)(18)][(MAP_OUTPUT_RECORDS)(Map output
> records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
> records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
>
RE: Irreproducible Streaming Jobs
Posted by "Ratner, Alan S (IS)" <Al...@ngc.com>.
Here is more background on the problem of irreproducible streaming jobs:
1) We are taking C code programs and converting them to run in
Hadoop's streaming mode.
2) First we debug these programs by streaming them on a Windows
laptop running a virtual machine with Ubuntu 9.10 and Hadoop 0.20.1. We
have done this with two C programs so far and both run correctly and
consistently in this environment (reproducing the output of the original
C programs). BTW: I tried the modified command line suggested by
Amareshwari and the program runs the same either way.
3) Problems crop us when we move these programs to our Hadoop
cluster which runs native Ubuntu (some servers running 9.10 and some
10.4) and Hadoop 0.20.2. Sometimes these programs run and sometimes
they don't and we have no idea as to what is causing this inconsistency
(unless it is due to the change from Hadoop 0.20.1 to 0.20.2). The logs
of failed jobs include file or directory not found errors but these
aren't especially helpful since they don't specify which file or
directory is missing. I've included the log files of a successful run
and a failed run in the hopes someone can tell me what is going wrong.
For example, here is successful Run 1:
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper
CliquerMap -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1
-reducer ARGH1 -input CliqueIn -output CliqueOut1
packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
/tmp/hadoop-ngc/hadoop-unjar5693480053986200084/] []
/tmp/streamjob2257941530123552427.jar tmpDir=null
10/06/14 15:49:54 INFO mapred.FileInputFormat: Total input paths to
process : 1
10/06/14 15:49:55 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/14 15:49:55 INFO streaming.StreamJob: Running job:
job_201006141152_0163
10/06/14 15:49:55 INFO streaming.StreamJob: To kill this job, run:
10/06/14 15:49:55 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006141152_0163
10/06/14 15:49:55 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006141152_0163
10/06/14 15:49:56 INFO streaming.StreamJob: map 0% reduce 0%
10/06/14 15:50:02 INFO streaming.StreamJob: map 100% reduce 0%
10/06/14 15:50:11 INFO streaming.StreamJob: map 100% reduce 33%
10/06/14 15:50:17 INFO streaming.StreamJob: map 100% reduce 100%
10/06/14 15:50:20 INFO streaming.StreamJob: Job complete:
job_201006141152_0163
10/06/14 15:50:20 INFO streaming.StreamJob: Output: CliqueOut1
Here is failed Run 2 - only the name of the output directory has been
changed:
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap -mapper
CliquerMap -file /home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1
-reducer ARGH1 -input CliqueIn -output CliqueOut3
packageJobJar: [/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/CliquerMap,
/home/ngc/hadoop-0.20.2/streamingapps/Cliq2/ARGH1,
/tmp/hadoop-ngc/hadoop-unjar3582440643290869791/] []
/tmp/streamjob6334481689253156407.jar tmpDir=null
10/06/14 15:52:30 INFO mapred.FileInputFormat: Total input paths to
process : 1
10/06/14 15:52:30 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/14 15:52:30 INFO streaming.StreamJob: Running job:
job_201006141152_0165
10/06/14 15:52:30 INFO streaming.StreamJob: To kill this job, run:
10/06/14 15:52:30 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006141152_0165
10/06/14 15:52:30 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006141152_0165
10/06/14 15:52:31 INFO streaming.StreamJob: map 0% reduce 0%
10/06/14 15:53:01 INFO streaming.StreamJob: map 100% reduce 100%
10/06/14 15:53:01 INFO streaming.StreamJob: To kill this job, run:
10/06/14 15:53:01 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006141152_0165
10/06/14 15:53:01 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006141152_0165
10/06/14 15:53:01 ERROR streaming.StreamJob: Job not Successful!
10/06/14 15:53:01 INFO streaming.StreamJob: killJob...
Streaming Job Failed!
Output log with successful Run 1:
Meta VERSION="1" .
Job JOBID="job_201006141152_0163"
JOBNAME="streamjob2257941530123552427\.jar" USER="ngc"
SUBMIT_TIME="1276544995086"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006141152_0163/job\.xml" .
Job JOBID="job_201006141152_0163" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006141152_0163" LAUNCH_TIME="1276544995298"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
START_TIME="1276544995355" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0"
START_TIME="1276544870715"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0163_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544871484"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006141152_0163_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544998360"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006141152_0163" JOB_STATUS="RUNNING" .
Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
START_TIME="1276544998360"
SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop12\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
START_TIME="1276544998367"
SPLITS="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop12\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0"
START_TIME="1276544873560"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000000_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544875195"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=10581/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467
)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(74122)][(SPILLED_RECORDS)(Spilled
Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
bytes)(993185)][(MAP_INPUT_BYTES)(Map input
bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .
Task TASKID="task_201006141152_0163_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545001367"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(919067)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(1141467
)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(74122)][(SPILLED_RECORDS)(Spilled
Records)(74122)][(MAP_OUTPUT_BYTES)(Map output
bytes)(993185)][(MAP_INPUT_BYTES)(Map input
bytes)(919063)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(74122)]}" .
Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276545001367" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0"
START_TIME="1276516505443"
TRACKER_NAME="tracker_hadoop4\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:59097" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0163_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000001_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276516507087"
HOSTNAME="/default-rack/hadoop4\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=10490/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(114084
8)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(73914)][(SPILLED_RECORDS)(Spilled
Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
bytes)(992982)][(MAP_INPUT_BYTES)(Map input
bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .
Task TASKID="task_201006141152_0163_m_000001" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545001372"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(1048576)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(114084
8)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(73914)][(SPILLED_RECORDS)(Spilled
Records)(73914)][(MAP_OUTPUT_BYTES)(Map output
bytes)(992982)][(MAP_INPUT_BYTES)(Map input
bytes)(919068)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(73914)]}" .
ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006141152_0163_r_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0"
START_TIME="1276544876558"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .
ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006141152_0163_r_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0163_r_000000_0"
TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1276544883268"
SORT_FINISHED="1276544883562" FINISH_TIME="1276544889011"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=148036/1 > reduce"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(228224
5)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoo
p\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(46)][(SPILLED_RECORDS)(Spilled
Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
Task TASKID="task_201006141152_0163_r_000000" TASK_TYPE="REDUCE"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545016389"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(2282245)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(228224
5)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoo
p\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(46)][(SPILLED_RECORDS)(Spilled
Records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276545016389" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0"
START_TIME="1276544891567"
TRACKER_NAME="tracker_hadoop7\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:42144" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0163_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0163_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276544892421"
HOSTNAME="/default-rack/hadoop7\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006141152_0163_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545019393"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006141152_0163" FINISH_TIME="1276545019394"
JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1"
FAILED_MAPS="0" FAILED_REDUCES="0"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job
Counters )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
tasks)(2)][(TOTAL_LAUNCHED_MAPS)(Launched map
tasks)(2)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(F
ILE_BYTES_READ)(2282245)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(1967643)][(
FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(4564560)][(HDFS_BYTES_WRITTEN)(H
DFS_BYTES_WRITTEN)(7259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(M
ap-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(148036)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(148036)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(2282251)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(46)][(SPILLED_RECORDS)(Spilled
Records)(296072)][(MAP_OUTPUT_BYTES)(Map output
bytes)(1986167)][(MAP_INPUT_BYTES)(Map input
bytes)(1838131)][(MAP_OUTPUT_RECORDS)(Map output
records)(148036)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(148036)]}" .
Output log with failed Run 2:
Meta VERSION="1" .
Job JOBID="job_201006141152_0165"
JOBNAME="streamjob6334481689253156407\.jar" USER="ngc"
SUBMIT_TIME="1276545150464"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006141152_0165/job\.xml" .
Job JOBID="job_201006141152_0165" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006141152_0165" LAUNCH_TIME="1276545150594"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
START_TIME="1276545150786" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0"
START_TIME="1276516268757"
TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:47520" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006141152_0165_m_000003"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276516269394"
HOSTNAME="/default-rack/hadoop11\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006141152_0165_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545153792"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006141152_0165" JOB_STATUS="RUNNING" .
Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
START_TIME="1276545153792"
SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop38\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006141152_0165_m_000001" TASK_TYPE="MAP"
START_TIME="1276545153886"
SPLITS="/default-rack/hadoop12\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop38\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0"
START_TIME="1276516271602"
TRACKER_NAME="tracker_hadoop11\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:47520" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276516275655"
HOSTNAME="hadoop11\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0"
START_TIME="1276602962723"
TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:40869" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276602966774"
HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000001_0/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1"
START_TIME="1276602968589"
TRACKER_NAME="tracker_hadoop31\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:40869" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276602972635"
HOSTNAME="hadoop31\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_016
5/attempt_201006141152_0165_m_000000_1/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1"
START_TIME="1276516428044"
TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:54798" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_1"
TASK_STATUS="FAILED" FINISH_TIME="1276516432095"
HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000001_1/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2"
START_TIME="1276516433881"
TRACKER_NAME="tracker_hadoop10\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:54798" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_2"
TASK_STATUS="FAILED" FINISH_TIME="1276516437931"
HOSTNAME="hadoop10\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_2/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2"
START_TIME="1276574021030"
TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:45065" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_2"
TASK_STATUS="FAILED" FINISH_TIME="1276574024976"
HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006141152_016
5/attempt_201006141152_0165_m_000001_2/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3"
START_TIME="1276574026882"
TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:45065" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000000"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000000_3"
TASK_STATUS="FAILED" FINISH_TIME="1276574030934"
HOSTNAME="hadoop38\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
Task TASKID="task_201006141152_0165_m_000000" TASK_TYPE="MAP"
TASK_STATUS="FAILED" FINISH_TIME="1276574030934"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000000_3/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" TASK_ATTEMPT_ID="" .
Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276545178009" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3"
START_TIME="1276516443646"
TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:46295" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006141152_0165_m_000001"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000001_3"
TASK_STATUS="FAILED" FINISH_TIME="1276516447699"
HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at
org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at
org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006141152_0165/att
empt_201006141152_0165_m_000001_3/work/\./CliquerMap\":
java\.io\.IOException: error\=2, No such file or directory
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at
java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at
java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0"
START_TIME="1276574032921"
TRACKER_NAME="tracker_hadoop38\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:45065" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006141152_0165_m_000002"
TASK_ATTEMPT_ID="attempt_201006141152_0165_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276574033570"
HOSTNAME="/default-rack/hadoop38\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006141152_0165_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276545181014"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006141152_0165" FINISH_TIME="1276545181014"
JOB_STATUS="FAILED" FINISHED_MAPS="0" FINISHED_REDUCES="0"
Alan
From: Amareshwari Sri Ramadasu [mailto:amarsri@yahoo-inc.com]
Sent: Monday, June 14, 2010 12:44 AM
To: mapreduce-user@hadoop.apache.org
Subject: Re: Irreproducible Streaming Jobs
I don't know how your first run passed, but your streaming command
should be :
bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper SDMapper -file
streamingapps/Steg/Test2 -reducer Test2 -input ImageList -output
StegOut1
Your mapper/reducer should be the command to run. The paths
streamingapps/Steg/SDMapper and streamingapps/Steg/Test2 would be
present on your local filesystem (on client machine), not on compute
nodes.
Thanks
Amareshwari
On 6/11/10 7:05 PM, "Ratner, Alan S (IS)" <Al...@ngc.com> wrote:
Our Hadoop streaming jobs are unpredictable. The following illustrates
this problem. I reset the system first to start with a clean slate
(deleting tmp files on master and all slaves, reformatting name node,
etc.). I then ran a streaming job which gave the expected results. I
then ran the exact same job again (using a different output file name)
and it bombed. Curiously although the second run generated "no such
file or directory" errors in the log file but so did the first run. I
suspect that our streaming job is doing something wrong (despite the
correct results) and corrupting the tmp files. (These jobs were run on
40 servers configured as 1 master and 39 slaves.) Any suggestions?
FIRST RUN
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input
ImageList -output StegOut1
packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
/tmp/hadoop-ngc/hadoop-unjar1378560104000865091/] []
/tmp/streamjob1574130777925793571.jar tmpDir=null
10/06/11 08:15:09 INFO mapred.FileInputFormat: Total input paths to
process : 1
10/06/11 08:15:09 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/11 08:15:09 INFO streaming.StreamJob: Running job:
job_201006110802_0013
10/06/11 08:15:09 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:15:09 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0013
10/06/11 08:15:09 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0013
10/06/11 08:15:10 INFO streaming.StreamJob: map 0% reduce 0%
10/06/11 08:15:22 INFO streaming.StreamJob: map 50% reduce 0%
10/06/11 08:15:28 INFO streaming.StreamJob: map 100% reduce 0%
10/06/11 08:15:31 INFO streaming.StreamJob: map 100% reduce 17%
10/06/11 08:15:40 INFO streaming.StreamJob: map 100% reduce 100%
10/06/11 08:15:43 INFO streaming.StreamJob: Job complete:
job_201006110802_0013
10/06/11 08:15:43 INFO streaming.StreamJob: Output: StegOut1
SECOND RUN
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar
contrib/streaming/hadoop-0.20.2-streaming.jar -file
streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file
streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input
ImageList -output StegOut2
packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2,
/tmp/hadoop-ngc/hadoop-unjar7292727069710530665/] []
/tmp/streamjob8749080748645718359.jar tmpDir=null
10/06/11 08:16:00 INFO mapred.FileInputFormat: Total input paths to
process : 1
10/06/11 08:16:00 INFO streaming.StreamJob: getLocalDirs():
[/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local,
/media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/11 08:16:00 INFO streaming.StreamJob: Running job:
job_201006110802_0016
10/06/11 08:16:00 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:16:00 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016
10/06/11 08:16:00 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0016
10/06/11 08:16:01 INFO streaming.StreamJob: map 0% reduce 0%
10/06/11 08:16:19 INFO streaming.StreamJob: map 50% reduce 0%
10/06/11 08:16:28 INFO streaming.StreamJob: map 50% reduce 17%
10/06/11 08:16:32 INFO streaming.StreamJob: map 100% reduce 100%
10/06/11 08:16:32 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:16:32 INFO streaming.StreamJob:
/home/ngc/hadoop-0.20.2/bin/../bin/hadoop job
-Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016
10/06/11 08:16:32 INFO streaming.StreamJob: Tracking URL:
http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201
006110802_0016
10/06/11 08:16:32 ERROR streaming.StreamJob: Job not Successful!
10/06/11 08:16:32 INFO streaming.StreamJob: killJob...
Streaming Job Failed!
MAP LOG FILE OF SECOND RUN
Meta VERSION="1" .
Job JOBID="job_201006110802_0016"
JOBNAME="streamjob8749080748645718359\.jar" USER="ngc"
SUBMIT_TIME="1276258560297"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006110802_0016/job\.xml" .
Job JOBID="job_201006110802_0016" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006110802_0016" LAUNCH_TIME="1276258560564"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
START_TIME="1276258560932" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
START_TIME="1276229924181"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229924886"
HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258563937"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0016" JOB_STATUS="RUNNING" .
Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
START_TIME="1276258563937"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
START_TIME="1276258564747"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
START_TIME="1276229927063"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229931379"
HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000000_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
START_TIME="1276229819233"
TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:35631" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229823283"
HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
START_TIME="1276230008685"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276230012735"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000000_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
START_TIME="1276229520733"
TRACKER_NAME="tracker_hadoop23\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:58025" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1"
TASK_STATUS="FAILED" FINISH_TIME="1276229524784"
HOSTNAME="hadoop23\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000001_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
START_TIME="1276229773743"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229774851"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258579350"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0016_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276258579351" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
START_TIME="1276316358506"
TRACKER_NAME="tracker_hadoop24\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:38111" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2"
TASK_STATUS="FAILED" FINISH_TIME="1276316362553"
HOSTNAME="hadoop24\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
6/attempt_201006110802_0016_m_000001_2/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
START_TIME="1276229596341"
TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:56345" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3"
TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
HOSTNAME="hadoop19\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_3/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP"
TASK_STATUS="FAILED" FINISH_TIME="1276229600392"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/att
empt_201006110802_0016_m_000001_3/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" TASK_ATTEMPT_ID="" .
Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276258589119" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
START_TIME="1276229602209"
TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\
.0\.0\.1:56345" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229602877"
HOSTNAME="/default-rack/hadoop19\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258592124"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0016" FINISH_TIME="1276258592124"
JOB_STATUS="FAILED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .
MAP LOG FILE OF FIRST RUN
eta VERSION="1" .
Job JOBID="job_201006110802_0013"
JOBNAME="streamjob1574130777925793571\.jar" USER="ngc"
SUBMIT_TIME="1276258509559"
JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/m
apred/system/job_201006110802_0013/job\.xml" .
Job JOBID="job_201006110802_0013" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006110802_0013" LAUNCH_TIME="1276258509729"
TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
START_TIME="1276258509836" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
START_TIME="1276229873134"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229873917"
HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com"
STATE_STRING="setup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258512842"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0013" JOB_STATUS="RUNNING" .
Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
START_TIME="1276258512842"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
START_TIME="1276258512946"
SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/
hadoop17\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
START_TIME="1276229875959"
TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229880125"
HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_001
3/attempt_201006110802_0013_m_000000_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
START_TIME="1276229951632"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0"
TASK_STATUS="FAILED" FINISH_TIME="1276229955681"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd4/mapred/local/taskTracker/jobcache/job_201006110802_0013/att
empt_201006110802_0013_m_000001_0/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
START_TIME="1276229716711"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229717868"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/user/ngc/Im
ageList/imagelist:9+9"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(0)][(SPILLED_RECORDS)(Spilled
Records)(0)][(MAP_OUTPUT_BYTES)(Map output
bytes)(0)][(MAP_INPUT_BYTES)(Map input
bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258522269"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(0)][(SPILLED_RECORDS)(Spilled
Records)(0)][(MAP_OUTPUT_BYTES)(Map output
bytes)(0)][(MAP_INPUT_BYTES)(Map input
bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
START_TIME="1276258522270" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
START_TIME="1276229957552"
TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1"
TASK_STATUS="FAILED" FINISH_TIME="1276229961598"
HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com"
ERROR="java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:93)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.jav
a:64)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\
.java:117)
at
org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native
Method)
at
sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\
.java:39)
at
sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAcces
sorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at
org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.
java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
82)
at
org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:6
3)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program
\"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0013/att
empt_201006110802_0013_m_000000_1/work/\./SDMapper\":
java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at
org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:1
66)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No
such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
START_TIME="1276229722583"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229723735"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258528279"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HD
FS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\
.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(SPILLED_RECORDS)(Spilled
Records)(1)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006110802_0013_r_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
START_TIME="1276229719549"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
ReduceAttempt TASK_TYPE="REDUCE"
TASKID="task_201006110802_0013_r_000000"
TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0"
TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1276229731481"
SORT_FINISHED="1276229731538" FINISH_TIME="1276229734818"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="Records R/W\=1/1 > reduce"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_
BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.T
ask$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258540288"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FI
LE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_
BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.T
ask$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
START_TIME="1276258540289" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
START_TIME="1276229737575"
TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.
0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002"
TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0"
TASK_STATUS="SUCCESS" FINISH_TIME="1276229738283"
HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com"
STATE_STRING="cleanup"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP"
TASK_STATUS="SUCCESS" FINISH_TIME="1276258543294"
COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0013" FINISH_TIME="1276258543294"
JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1"
FAILED_MAPS="3" FAILED_REDUCES="0"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job
Counters )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
tasks)(5)][(TOTAL_LAUNCHED_MAPS)(Launched map
tasks)(5)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(F
ILE_BYTES_READ)(62)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28)][(FILE_BYTES
_WRITTEN)(FILE_BYTES_WRITTEN)(194)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRIT
TEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(1)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(2)][(SPILLED_RECORDS)(Spilled
Records)(2)][(MAP_OUTPUT_BYTES)(Map output
bytes)(54)][(MAP_INPUT_BYTES)(Map input
bytes)(18)][(MAP_OUTPUT_RECORDS)(Map output
records)(1)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Re: Irreproducible Streaming Jobs
Posted by Amareshwari Sri Ramadasu <am...@yahoo-inc.com>.
I don't know how your first run passed, but your streaming command should be :
bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file streamingapps/Steg/SDMapper -mapper SDMapper -file streamingapps/Steg/Test2 -reducer Test2 -input ImageList -output StegOut1
Your mapper/reducer should be the command to run. The paths streamingapps/Steg/SDMapper and streamingapps/Steg/Test2 would be present on your local filesystem (on client machine), not on compute nodes.
Thanks
Amareshwari
On 6/11/10 7:05 PM, "Ratner, Alan S (IS)" <Al...@ngc.com> wrote:
Our Hadoop streaming jobs are unpredictable. The following illustrates this problem. I reset the system first to start with a clean slate (deleting tmp files on master and all slaves, reformatting name node, etc.). I then ran a streaming job which gave the expected results. I then ran the exact same job again (using a different output file name) and it bombed. Curiously although the second run generated "no such file or directory" errors in the log file but so did the first run. I suspect that our streaming job is doing something wrong (despite the correct results) and corrupting the tmp files. (These jobs were run on 40 servers configured as 1 master and 39 slaves.) Any suggestions?
FIRST RUN
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input ImageList -output StegOut1
packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2, /tmp/hadoop-ngc/hadoop-unjar1378560104000865091/] [] /tmp/streamjob1574130777925793571.jar tmpDir=null
10/06/11 08:15:09 INFO mapred.FileInputFormat: Total input paths to process : 1
10/06/11 08:15:09 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local, /media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/11 08:15:09 INFO streaming.StreamJob: Running job: job_201006110802_0013
10/06/11 08:15:09 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:15:09 INFO streaming.StreamJob: /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0013
10/06/11 08:15:09 INFO streaming.StreamJob: Tracking URL: http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0013
10/06/11 08:15:10 INFO streaming.StreamJob: map 0% reduce 0%
10/06/11 08:15:22 INFO streaming.StreamJob: map 50% reduce 0%
10/06/11 08:15:28 INFO streaming.StreamJob: map 100% reduce 0%
10/06/11 08:15:31 INFO streaming.StreamJob: map 100% reduce 17%
10/06/11 08:15:40 INFO streaming.StreamJob: map 100% reduce 100%
10/06/11 08:15:43 INFO streaming.StreamJob: Job complete: job_201006110802_0013
10/06/11 08:15:43 INFO streaming.StreamJob: Output: StegOut1
SECOND RUN
ngc@hadoop1:~/hadoop-0.20.2$ bin/hadoop jar contrib/streaming/hadoop-0.20.2-streaming.jar -file streamingapps/Steg/SDMapper -mapper streamingapps/Steg/SDMapper -file streamingapps/Steg/Test2 -reducer streamingapps/Steg/Test2 -input ImageList -output StegOut2
packageJobJar: [streamingapps/Steg/SDMapper, streamingapps/Steg/Test2, /tmp/hadoop-ngc/hadoop-unjar7292727069710530665/] [] /tmp/streamjob8749080748645718359.jar tmpDir=null
10/06/11 08:16:00 INFO mapred.FileInputFormat: Total input paths to process : 1
10/06/11 08:16:00 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-ngc/mapred/local, /media/hd2/mapred/local, /media/hd3/mapred/local, /media/hd4/mapred/local]
10/06/11 08:16:00 INFO streaming.StreamJob: Running job: job_201006110802_0016
10/06/11 08:16:00 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:16:00 INFO streaming.StreamJob: /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016
10/06/11 08:16:00 INFO streaming.StreamJob: Tracking URL: http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0016
10/06/11 08:16:01 INFO streaming.StreamJob: map 0% reduce 0%
10/06/11 08:16:19 INFO streaming.StreamJob: map 50% reduce 0%
10/06/11 08:16:28 INFO streaming.StreamJob: map 50% reduce 17%
10/06/11 08:16:32 INFO streaming.StreamJob: map 100% reduce 100%
10/06/11 08:16:32 INFO streaming.StreamJob: To kill this job, run:
10/06/11 08:16:32 INFO streaming.StreamJob: /home/ngc/hadoop-0.20.2/bin/../bin/hadoop job -Dmapred.job.tracker=10.64.147.2:9002 -kill job_201006110802_0016
10/06/11 08:16:32 INFO streaming.StreamJob: Tracking URL: http://hadoop1.aj.c2fse.northgrum.com:50030/jobdetails.jsp?jobid=job_201006110802_0016
10/06/11 08:16:32 ERROR streaming.StreamJob: Job not Successful!
10/06/11 08:16:32 INFO streaming.StreamJob: killJob...
Streaming Job Failed!
MAP LOG FILE OF SECOND RUN
Meta VERSION="1" .
Job JOBID="job_201006110802_0016" JOBNAME="streamjob8749080748645718359\.jar" USER="ngc" SUBMIT_TIME="1276258560297" JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006110802_0016/job\.xml" .
Job JOBID="job_201006110802_0016" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006110802_0016" LAUNCH_TIME="1276258560564" TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP" START_TIME="1276258560932" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0" START_TIME="1276229924181" TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0016_m_000003" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000003_0" TASK_STATUS="SUCCESS" FINISH_TIME="1276229924886" HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com" STATE_STRING="setup" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0016_m_000003" TASK_TYPE="SETUP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258563937" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0016" JOB_STATUS="RUNNING" .
Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP" START_TIME="1276258563937" SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP" START_TIME="1276258564747" SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0" START_TIME="1276229927063" TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_0" TASK_STATUS="FAILED" FINISH_TIME="1276229931379" HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000000_0/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0" START_TIME="1276229819233" TRACKER_NAME="tracker_hadoop8\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:35631" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_0" TASK_STATUS="FAILED" FINISH_TIME="1276229823283" HOSTNAME="hadoop8\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_0/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1" START_TIME="1276230008685" TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_1" TASK_STATUS="FAILED" FINISH_TIME="1276230012735" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000000_1/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1" START_TIME="1276229520733" TRACKER_NAME="tracker_hadoop23\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:58025" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_1" TASK_STATUS="FAILED" FINISH_TIME="1276229524784" HOSTNAME="hadoop23\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_1/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2" START_TIME="1276229773743" TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000000_2" TASK_STATUS="SUCCESS" FINISH_TIME="1276229774851" HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com" STATE_STRING="Records R/W\=1/1" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map output bytes)(54)][(MAP_INPUT_BYTES)(Map input bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0016_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258579350" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map output bytes)(54)][(MAP_INPUT_BYTES)(Map input bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0016_r_000000" TASK_TYPE="REDUCE" START_TIME="1276258579351" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2" START_TIME="1276316358506" TRACKER_NAME="tracker_hadoop24\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:38111" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_2" TASK_STATUS="FAILED" FINISH_TIME="1276316362553" HOSTNAME="hadoop24\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_2/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3" START_TIME="1276229596341" TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:56345" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0016_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000001_3" TASK_STATUS="FAILED" FINISH_TIME="1276229600392" HOSTNAME="hadoop19\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_3/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
Task TASKID="task_201006110802_0016_m_000001" TASK_TYPE="MAP" TASK_STATUS="FAILED" FINISH_TIME="1276229600392" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/media/hd2/mapred/local/taskTracker/jobcache/job_201006110802_0016/attempt_201006110802_0016_m_000001_3/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" TASK_ATTEMPT_ID="" .
Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP" START_TIME="1276258589119" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0" START_TIME="1276229602209" TRACKER_NAME="tracker_hadoop19\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:56345" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0016_m_000002" TASK_ATTEMPT_ID="attempt_201006110802_0016_m_000002_0" TASK_STATUS="SUCCESS" FINISH_TIME="1276229602877" HOSTNAME="/default-rack/hadoop19\.aj\.c2fse\.northgrum\.com" STATE_STRING="cleanup" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0016_m_000002" TASK_TYPE="CLEANUP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258592124" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0016" FINISH_TIME="1276258592124" JOB_STATUS="FAILED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .
MAP LOG FILE OF FIRST RUN
eta VERSION="1" .
Job JOBID="job_201006110802_0013" JOBNAME="streamjob1574130777925793571\.jar" USER="ngc" SUBMIT_TIME="1276258509559" JOBCONF="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/tmp/hadoop-ngc/mapred/system/job_201006110802_0013/job\.xml" .
Job JOBID="job_201006110802_0013" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201006110802_0013" LAUNCH_TIME="1276258509729" TOTAL_MAPS="2" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP" START_TIME="1276258509836" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0" START_TIME="1276229873134" TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201006110802_0013_m_000003" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000003_0" TASK_STATUS="SUCCESS" FINISH_TIME="1276229873917" HOSTNAME="/default-rack/hadoop6\.aj\.c2fse\.northgrum\.com" STATE_STRING="setup" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000003" TASK_TYPE="SETUP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258512842" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0013" JOB_STATUS="RUNNING" .
Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP" START_TIME="1276258512842" SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com" .
Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP" START_TIME="1276258512946" SPLITS="/default-rack/hadoop20\.aj\.c2fse\.northgrum\.com,/default-rack/hadoop17\.aj\.c2fse\.northgrum\.com" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0" START_TIME="1276229875959" TRACKER_NAME="tracker_hadoop6\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:49372" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_0" TASK_STATUS="FAILED" FINISH_TIME="1276229880125" HOSTNAME="hadoop6\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/tmp/hadoop-ngc/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000000_0/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0" START_TIME="1276229951632" TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_0" TASK_STATUS="FAILED" FINISH_TIME="1276229955681" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/media/hd4/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000001_0/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1" START_TIME="1276229716711" TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000001" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000001_1" TASK_STATUS="SUCCESS" FINISH_TIME="1276229717868" HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com" STATE_STRING="hdfs://hadoop1\.aj\.c2fse\.northgrum\.com:9000/user/ngc/ImageList/imagelist:9+9" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES)(Map output bytes)(0)][(MAP_INPUT_BYTES)(Map input bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000001" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258522269" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(10)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(38)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(MAP_OUTPUT_BYTES)(Map output bytes)(0)][(MAP_INPUT_BYTES)(Map input bytes)(0)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(0)]}" .
Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE" START_TIME="1276258522270" SPLITS="" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1" START_TIME="1276229957552" TRACKER_NAME="tracker_hadoop3\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:34294" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_1" TASK_STATUS="FAILED" FINISH_TIME="1276229961598" HOSTNAME="hadoop3\.aj\.c2fse\.northgrum\.com" ERROR="java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:354)
at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:307)
at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:170)
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 5 more
Caused by: java\.lang\.RuntimeException: Error in configuring object
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:93)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setConf(ReflectionUtils\.java:64)
at org\.apache\.hadoop\.util\.ReflectionUtils\.newInstance(ReflectionUtils\.java:117)
at org\.apache\.hadoop\.mapred\.MapRunner\.configure(MapRunner\.java:34)
\.\.\. 10 more
Caused by: java\.lang\.reflect\.InvocationTargetException
at sun\.reflect\.NativeMethodAccessorImpl\.invoke0(Native Method)
at sun\.reflect\.NativeMethodAccessorImpl\.invoke(NativeMethodAccessorImpl\.java:39)
at sun\.reflect\.DelegatingMethodAccessorImpl\.invoke(DelegatingMethodAccessorImpl\.java:25)
at java\.lang\.reflect\.Method\.invoke(Method\.java:597)
at org\.apache\.hadoop\.util\.ReflectionUtils\.setJobConf(ReflectionUtils\.java:88)
\.\.\. 13 more
Caused by: java\.lang\.RuntimeException: configuration exception
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:182)
at org\.apache\.hadoop\.streaming\.PipeMapper\.configure(PipeMapper\.java:63)
\.\.\. 18 more
Caused by: java\.io\.IOException: Cannot run program \"/media/hd3/mapred/local/taskTracker/jobcache/job_201006110802_0013/attempt_201006110802_0013_m_000000_1/work/\./SDMapper\": java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:460)
at org\.apache\.hadoop\.streaming\.PipeMapRed\.configure(PipeMapRed\.java:166)
\.\.\. 19 more
Caused by: java\.io\.IOException: java\.io\.IOException: error\=2, No such file or directory
at java\.lang\.UNIXProcess\.<init>(UNIXProcess\.java:148)
at java\.lang\.ProcessImpl\.start(ProcessImpl\.java:65)
at java\.lang\.ProcessBuilder\.start(ProcessBuilder\.java:453)
\.\.\. 20 more
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2" START_TIME="1276229722583" TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201006110802_0013_m_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000000_2" TASK_STATUS="SUCCESS" FINISH_TIME="1276229723735" HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com" STATE_STRING="Records R/W\=1/1" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map output bytes)(54)][(MAP_INPUT_BYTES)(Map input bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
Task TASKID="task_201006110802_0013_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258528279" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(18)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(94)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(SPILLED_RECORDS)(Spilled Records)(1)][(MAP_OUTPUT_BYTES)(Map output bytes)(54)][(MAP_INPUT_BYTES)(Map input bytes)(18)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(1)]}" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006110802_0013_r_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0" START_TIME="1276229719549" TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829" HTTP_PORT="50060" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201006110802_0013_r_000000" TASK_ATTEMPT_ID="attempt_201006110802_0013_r_000000_0" TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1276229731481" SORT_FINISHED="1276229731538" FINISH_TIME="1276229734818" HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com" STATE_STRING="Records R/W\=1/1 > reduce" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(2)][(SPILLED_RECORDS)(Spilled Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Task TASKID="task_201006110802_0013_r_000000" TASK_TYPE="REDUCE" TASK_STATUS="SUCCESS" FINISH_TIME="1276258540288" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(62)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(2)][(SPILLED_RECORDS)(Spilled Records)(1)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .
Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP" START_TIME="1276258540289" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0" START_TIME="1276229737575" TRACKER_NAME="tracker_hadoop2\.aj\.c2fse\.northgrum\.com:localhost/127\.0\.0\.1:51829" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201006110802_0013_m_000002" TASK_ATTEMPT_ID="attempt_201006110802_0013_m_000002_0" TASK_STATUS="SUCCESS" FINISH_TIME="1276229738283" HOSTNAME="/default-rack/hadoop2\.aj\.c2fse\.northgrum\.com" STATE_STRING="cleanup" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Task TASKID="task_201006110802_0013_m_000002" TASK_TYPE="CLEANUP" TASK_STATUS="SUCCESS" FINISH_TIME="1276258543294" COUNTERS="{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(SPILLED_RECORDS)(Spilled Records)(0)]}" .
Job JOBID="job_201006110802_0013" FINISH_TIME="1276258543294" JOB_STATUS="SUCCESS" FINISHED_MAPS="2" FINISHED_REDUCES="1" FAILED_MAPS="3" FAILED_REDUCES="0" COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters )[(TOTAL_LAUNCHED_REDUCES)(Launched reduce tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map tasks)(5)][(TOTAL_LAUNCHED_MAPS)(Launched map tasks)(5)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(62)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(28)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(194)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(63)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(1)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(6)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(2)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(54)][(MAP_INPUT_BYTES)(Map input bytes)(18)][(MAP_OUTPUT_RECORDS)(Map output records)(1)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(1)]}" .