You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Bradford Stephens <br...@gmail.com> on 2010/01/17 00:20:00 UTC
Exception: "Can not get the relative path..."
Hey guys,
I'm getting an exception I haven't seen before. I'm running hadoop in
single-node mode for some dev work. Tasktracker log gives me this:
java.io.IOException: Can not get the relative path: base =
hdfs://localhost:8020/user/bradfordstephens/queueout/_temporary/_attempt_201001152019_0004_m_000000_0
child = hdfs://localhost/user/bradfordstephens/queueout/_temporary/_attempt_201001152019_0004_m_000000_0/part-m-00000
at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.getFinalPath(FileOutputCommitter.java:200)
etc...
Around the same time, I see this in the tasktracker log:
2010-01-15 20:24:25,190 INFO org.apache.hadoop.mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_201001152019_0004/attempt_201001152019_0004_m_000001_0/output/file.out
in any of the configured local directories
I've got a gut feeling this may be a config issue, but not sure where...
Cheers,
Bradford
--
http://www.drawntoscalehq.com -- Big Data for all. The Big Data Platform.
http://www.roadtofailure.com -- The Fringes of Scalability, Social
Media, and Computer Science
Re: Exception: "Can not get the relative path..."
Posted by Todd Lipcon <to...@cloudera.com>.
Hi Bradford,
My guess is that somewhere it's using hdfs://localhost:8020/ and elsewhere
using hdfs://localhost/ (and letting the default port get used). It's
certainly a bug that this causes a problem, but if you want to work around
it I'd just make sure you've used the fully specified hdfs://localhost:8020/
everywhere.
-Todd
On Sat, Jan 16, 2010 at 3:20 PM, Bradford Stephens <
bradfordstephens@gmail.com> wrote:
> Hey guys,
>
> I'm getting an exception I haven't seen before. I'm running hadoop in
> single-node mode for some dev work. Tasktracker log gives me this:
>
> java.io.IOException: Can not get the relative path: base =
>
> hdfs://localhost:8020/user/bradfordstephens/queueout/_temporary/_attempt_201001152019_0004_m_000000_0
> child =
> hdfs://localhost/user/bradfordstephens/queueout/_temporary/_attempt_201001152019_0004_m_000000_0/part-m-00000
> at
> org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.getFinalPath(FileOutputCommitter.java:200)
>
> etc...
>
> Around the same time, I see this in the tasktracker log:
>
> 2010-01-15 20:24:25,190 INFO org.apache.hadoop.mapred.TaskTracker:
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
>
> taskTracker/jobcache/job_201001152019_0004/attempt_201001152019_0004_m_000001_0/output/file.out
> in any of the configured local directories
>
> I've got a gut feeling this may be a config issue, but not sure where...
>
> Cheers,
> Bradford
>
> --
> http://www.drawntoscalehq.com -- Big Data for all. The Big Data Platform.
>
> http://www.roadtofailure.com -- The Fringes of Scalability, Social
> Media, and Computer Science
>