[Ask for help]: IOException: Expecting a line not the end of stream, hadoop-0.20.1 in Daemn Small Linux

[Neo Tan <ne...@hotmail.com>]

Dear all,

 

I am new in learning hadoop, encountered a problem while complying "Hadoop/Quick Start(http://hadoop.apache.org/common/docs/current/quickstart.html)" tutorial. Everything in "cygwin" is okay, but in "Daemn Small Linux(DSL)". 

 

In "Daemn Small Linux", after executing the command: 

------->bin/hadoop jar hadoop-0.20.1-examples.jar grep input output 'dfs[a-z.]+'

output errors as following "OUTPUT_01", base on the errors, I tried "df -k", output as "OUTPUT_02", it wasn't NULL/empty.

 

I tried searching all the mailing list of common-user & core-user and Google, got noting solution, so I have to send this email to ask you gus' help modestly. Please kindly reply if anyone have idea. Thanks in advance! =)

 

Best regards.
Neo Tan
 
====>OUTPUT_01:<==========================================================================

root@box:/home/hadoop/hadoop-0.20.1# bin/hadoop jar hadoop-0.20.1-examples.jar grep input output 'dfs[a-z.]+'          
09/11/10 17:12:43 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
09/11/10 17:12:43 INFO mapred.FileInputFormat: Total input paths to process : 5
09/11/10 17:12:44 INFO mapred.FileInputFormat: Total input paths to process : 5
09/11/10 17:12:44 INFO mapred.JobClient: Running job: job_local_0001
09/11/10 17:12:44 INFO mapred.MapTask: numReduceTasks: 1
09/11/10 17:12:44 INFO mapred.MapTask: io.sort.mb = 100
09/11/10 17:12:45 INFO mapred.MapTask: data buffer = 79691776/99614720
09/11/10 17:12:45 INFO mapred.MapTask: record buffer = 262144/327680
09/11/10 17:12:45 INFO mapred.MapTask: Starting flush of map output
09/11/10 17:12:45 WARN mapred.LocalJobRunner: job_local_0001
java.io.IOException: Expecting a line not the end of stream
        at org.apache.hadoop.fs.DF.parseExecResult(DF.java:109)
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:179)
        at org.apache.hadoop.util.Shell.run(Shell.java:134)
        at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
        at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:329)
        at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
        at org.apache.hadoop.mapred.MapOutputFile.getOutputFileForWrite(MapOutputFile.java:61)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:1431)
        at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1116)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:359)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:176)
09/11/10 17:12:45 WARN util.Shell: Error reading the error stream
java.io.IOException: Stream closed
        at java.io.BufferedReader.ensureOpen(BufferedReader.java:97)
        at java.io.BufferedReader.readLine(BufferedReader.java:292)
        at java.io.BufferedReader.readLine(BufferedReader.java:362)
        at org.apache.hadoop.util.Shell$1.run(Shell.java:164)
09/11/10 17:12:45 INFO mapred.JobClient:  map 0% reduce 0%
09/11/10 17:12:45 INFO mapred.JobClient: Job complete: job_local_0001
09/11/10 17:12:45 INFO mapred.JobClient: Counters: 0
java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252)
        at org.apache.hadoop.examples.Grep.run(Grep.java:69)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.examples.Grep.main(Grep.java:93)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
root@box:/home/hadoop/hadoop-0.20.1# 
=========================================================================================


====>OUTPUT_02:<=================================

root@box:/home/hadoop/hadoop-0.20.1# df -k
Filesystem           1k-blocks      Used Available Use% Mounted on
/dev/hda1              8254240   1027828   6807120  13% /
=================================================
 		 	   		  
_________________________________________________________________
Keep your friends updated―even when you’re not signed in.
http://www.microsoft.com/middleeast/windows/windowslive/see-it-in-action/social-network-basics.aspx?ocid=PID23461::T:WLMTAGL:ON:WL:en-xm:SI_SB_5:092010