You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by akhil1988 <ak...@gmail.com> on 2009/06/23 03:19:36 UTC
Strange Exeception
Hi All!
I have been running Hadoop jobs through my user account on a cluster, for a
while now. But now I am getting this strange exception when I try to execute
a job. If anyone knows, please let me know why this is happening.
[akhil1988@altocumulus WordCount]$ hadoop jar wordcount_classes_dir.jar
org.uiuc.upcrc.extClasses.WordCount /home/akhil1988/input
/home/akhil1988/output
JO
09/06/22 19:19:01 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
org.apache.hadoop.ipc.RemoteException: java.io.FileNotFoundException:
/hadoop/tmp/hadoop/mapred/local/jobTracker/job_200906111015_0167.xml
(Read-only file system)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:187)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:183)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:241)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:327)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:360)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:487)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:468)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:375)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:208)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1214)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1195)
at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:212)
at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:2230)
at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:892)
at org.apache.hadoop.ipc.Client.call(Client.java:696)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
at org.apache.hadoop.mapred.$Proxy1.submitJob(Unknown Source)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:828)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1127)
at org.uiuc.upcrc.extClasses.WordCount.main(WordCount.java:70)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
Thanks,
Akhil
--
View this message in context: http://www.nabble.com/Strange-Exeception-tp24158395p24158395.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
Re: Strange Exeception
Posted by akhil1988 <ak...@gmail.com>.
Thanks Jason!
I gave your suggestion to my cluster administrator and now it is working.
Following was his reply to me:
"But /hadoop/tmp is not /scratch and the only thing that I clean is
/scratch. It looks like the disks in the job tracker machine died. I
swapped the disks from another node and rebuilt it. As far as I can tell
it is working."
Thanks Again!
jason hadoop wrote:
>
> The directory specified by the configuration parameter mapred.system.dir,
> defaulting to /tmp/hadoop/mapred/system, doesn't exist.
>
> Most likely your tmp cleaner task has removed it, and I am guessing it is
> only created at cluster start time.
>
> On Mon, Jun 22, 2009 at 6:19 PM, akhil1988 <ak...@gmail.com> wrote:
>
>>
>> Hi All!
>>
>> I have been running Hadoop jobs through my user account on a cluster, for
>> a
>> while now. But now I am getting this strange exception when I try to
>> execute
>> a job. If anyone knows, please let me know why this is happening.
>>
>> [akhil1988@altocumulus WordCount]$ hadoop jar wordcount_classes_dir.jar
>> org.uiuc.upcrc.extClasses.WordCount /home/akhil1988/input
>> /home/akhil1988/output
>> JO
>> 09/06/22 19:19:01 WARN mapred.JobClient: Use GenericOptionsParser for
>> parsing the arguments. Applications should implement Tool for the same.
>> org.apache.hadoop.ipc.RemoteException: java.io.FileNotFoundException:
>> /hadoop/tmp/hadoop/mapred/local/jobTracker/job_200906111015_0167.xml
>> (Read-only file system)
>> at java.io.FileOutputStream.open(Native Method)
>> at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
>> at
>>
>> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:187)
>> at
>>
>> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:183)
>> at
>> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:241)
>> at
>>
>> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:327)
>> at
>> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:360)
>> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:487)
>> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:468)
>> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:375)
>> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:208)
>> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
>> at
>> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1214)
>> at
>> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1195)
>> at
>> org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:212)
>> at
>> org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:2230)
>> at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:892)
>>
>> at org.apache.hadoop.ipc.Client.call(Client.java:696)
>> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
>> at org.apache.hadoop.mapred.$Proxy1.submitJob(Unknown Source)
>> at
>> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:828)
>> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1127)
>> at org.uiuc.upcrc.extClasses.WordCount.main(WordCount.java:70)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
>> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
>>
>>
>> Thanks,
>> Akhil
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Strange-Exeception-tp24158395p24158395.html
>> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>>
>>
>
>
> --
> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
> http://www.amazon.com/dp/1430219424?tag=jewlerymall
> www.prohadoopbook.com a community for Hadoop Professionals
>
>
--
View this message in context: http://www.nabble.com/Strange-Exeception-tp24158395p24177363.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
Re: Strange Exeception
Posted by jason hadoop <ja...@gmail.com>.
The directory specified by the configuration parameter mapred.system.dir,
defaulting to /tmp/hadoop/mapred/system, doesn't exist.
Most likely your tmp cleaner task has removed it, and I am guessing it is
only created at cluster start time.
On Mon, Jun 22, 2009 at 6:19 PM, akhil1988 <ak...@gmail.com> wrote:
>
> Hi All!
>
> I have been running Hadoop jobs through my user account on a cluster, for a
> while now. But now I am getting this strange exception when I try to
> execute
> a job. If anyone knows, please let me know why this is happening.
>
> [akhil1988@altocumulus WordCount]$ hadoop jar wordcount_classes_dir.jar
> org.uiuc.upcrc.extClasses.WordCount /home/akhil1988/input
> /home/akhil1988/output
> JO
> 09/06/22 19:19:01 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
> org.apache.hadoop.ipc.RemoteException: java.io.FileNotFoundException:
> /hadoop/tmp/hadoop/mapred/local/jobTracker/job_200906111015_0167.xml
> (Read-only file system)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
> at
>
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:187)
> at
>
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:183)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:241)
> at
>
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:327)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:360)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:487)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:468)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:375)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:208)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:142)
> at
> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1214)
> at
> org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1195)
> at
> org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:212)
> at
> org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:2230)
> at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:452)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:892)
>
> at org.apache.hadoop.ipc.Client.call(Client.java:696)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:216)
> at org.apache.hadoop.mapred.$Proxy1.submitJob(Unknown Source)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:828)
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1127)
> at org.uiuc.upcrc.extClasses.WordCount.main(WordCount.java:70)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
> at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
>
>
> Thanks,
> Akhil
>
> --
> View this message in context:
> http://www.nabble.com/Strange-Exeception-tp24158395p24158395.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>
--
Pro Hadoop, a book to guide you from beginner to hadoop mastery,
http://www.amazon.com/dp/1430219424?tag=jewlerymall
www.prohadoopbook.com a community for Hadoop Professionals