Hadoop 0.21.0 streaming giving no status information

[Patrick Donnelly <ba...@batbytes.com>]

Hi,

I'm trying to upgrade an application previously written for Hadoop
0.20.0 for 0.21.0. I'm running into an issue with the status output
missing which is making it difficult to get the jobid/success status:

hadoop/bin/hadoop jar
hadoop/mapred/contrib/streaming/hadoop-0.21.0-streaming.jar -D
mapreduce.job.reduces=0 -input file:///dev/null -mapper ./cmd.sh -file
./cmd.sh -output '/users/foo/tmp/job-1234' -verbose > OUTPUT 2>&1

This gives me a bunch of settings output such as:

STREAM: net.topology.script.number.args=100
STREAM: s3.blocksize=67108864
STREAM: s3.bytes-per-checksum=512
STREAM: s3.client-write-packet-size=65536
STREAM: s3.replication=3
STREAM: s3.stream-buffer-size=4096

finally ending with:

STREAM: webinterface.private.actions=false
STREAM: ====
STREAM: submitting to jobconf:machine.hostname.domain:8023

After that, I get no further status information. The job does complete
successfully. I would expect to get this type status information:

11/04/23 01:03:24 INFO streaming.StreamJob: getLocalDirs():
[/home/hadoop/hadoop/tmp/dir/hadoop-hadoop/mapred/local]

11/04/23 01:03:24 INFO streaming.StreamJob: Running job: job_201104222325_0021

11/04/23 01:03:24 INFO streaming.StreamJob: To kill this job, run:

11/04/23 01:03:24 INFO streaming.StreamJob:
/home/hadoop/hadoop/bin/../bin/hadoop job
-Dmapred.job.tracker=localhost:54311 -kill job_201104222325_0021

11/04/23 01:03:24 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201104222325_0021

11/04/23 01:03:25 INFO streaming.StreamJob:  map 0%  reduce 0%

11/04/23 01:03:31 INFO streaming.StreamJob:  map 50%  reduce 0%

11/04/23 01:03:41 INFO streaming.StreamJob:  map 50%  reduce 17%

11/04/23 01:03:56 INFO streaming.StreamJob:  map 100%  reduce 100%


I've tried playing with various switches including:

-Dhadoop.root.logger=INFO,console
-Dhadoop.log.file=hadoop.log
-Dhadoop.log.dir=$PWD

but none of these make a difference.

Any help would be greatly appreciated!

-- 
- Patrick Donnelly