You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by prabhu k <pr...@gmail.com> on 2012/08/03 14:24:30 UTC

DiskErrorException

Hi Users,

While creating the partitining, Im getting the following error in MR log.

Error:

org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any
valid local directory for
attempt_201208011427_0001_r_000078_0/intermediate.13 at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:381)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:146)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:127)
at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:492) at
org.apache.hadoop.mapred.Merger.merge(Merger.java:142) at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier.createKVIterator(ReduceTask.java:2503)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier.access$400(ReduceTask.java:659)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:398) at
org.apache.hadoop.mapred.Child$4.run(Child.java:255) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:396) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
java.io.IOException: Task: attempt_201208011427_0001_r_000078_1 - The
reduce copier failed at
org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
org.apache.hadoop.mapred.Child$4.run(Child.java:255) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:396) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any
valid local directory for
file:/app/hadoop/tmp/mapred/local/taskTracker/root/jobcache/job_201208011427_0001/attempt_201208011427_0001_r_000078_1/output/map_412.out
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:381)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:146)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:127)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTask.java:2639)


Please help me on this issue.

Thanks,
Prabhu.