You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Pavan Sudheendra <pa...@gmail.com> on 2013/08/16 08:02:39 UTC

Why do i get the following error all of a sudden?

I am using hbase with hadoop and i haven't seen this error until now..
I just switched to cloudera and now this happened.


java.io.IOException: java.lang.RuntimeException: java.io.IOException:
No such file or directory
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:598)
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:549)
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:513)
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:139)
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:216)
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:82)
    at com.cisco.spvtg.corona.audience.profiling.actiondatainterpret.ActionDataInterpret.main(ActionDataInterpret.java:493)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
Caused by: java.lang.RuntimeException: java.io.IOException: No such
file or directory
    at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:164)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:595)
    ... 11 more
Caused by: java.io.IOException: No such file or directory
    at java.io.UnixFileSystem.createFileExclusively(Native Method)
    at java.io.File.checkAndCreate(File.java:1704)
    at java.io.File.createTempFile(File.java:1792)
    at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:156)
    ... 16 more


-- 
Regards-
Pavan

Re: Why do i get the following error all of a sudden?

Posted by Michael Webster <mi...@bronto.com>.
I have seen this issue as well.  The problem seems to come down to an issue in 
TableMapReduceUtil#findOrCreateJars.  This class loads dependency jars into
the distributed cache for MR jobs, this class in turn calls JarFinder#getJar
from hadoop.  The getJar method  returns a jar file containing all of the
dependency classes. If it can find the dependency as jar, 
based on the protocol of the path URL, it just provides the path of the jar
file.  If it finds the class as a file it attempts to create a directory, by
default CWD/target/temp-dir, and build a jar there.  If the user submitting
the job doesn't have permissions to create that directory you get an
IOException.  Some possible solutions are:

1. chmod the directory you run the script from such that the user submitting
the job has permissions (i have verified that this works)
2. add a jar to the classpath containing the classes that you need, 
that should cause JarFinder#getJar to just provide the path of the jar file 
(I haven't yet tested this out yet, but it should work)

- michael

Re: Why do i get the following error all of a sudden?

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Pavan,

You will need to give us more details. When are you facing this exception?
What are you trying to achieve? For me, sound like your MR job is not able
to find a jar you asked it to load. Do you have more details? Version of
HBase also might help.

Thanks,

JM

2013/8/16 Pavan Sudheendra <pa...@gmail.com>

> I am using hbase with hadoop and i haven't seen this error until now..
> I just switched to cloudera and now this happened.
>
>
> java.io.IOException: java.lang.RuntimeException: java.io.IOException:
> No such file or directory
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:598)
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:549)
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:513)
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:139)
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:216)
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableMapperJob(TableMapReduceUtil.java:82)
>     at
> com.cisco.spvtg.corona.audience.profiling.actiondatainterpret.ActionDataInterpret.main(ActionDataInterpret.java:493)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
> Caused by: java.lang.RuntimeException: java.io.IOException: No such
> file or directory
>     at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:164)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at
> org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.findOrCreateJar(TableMapReduceUtil.java:595)
>     ... 11 more
> Caused by: java.io.IOException: No such file or directory
>     at java.io.UnixFileSystem.createFileExclusively(Native Method)
>     at java.io.File.checkAndCreate(File.java:1704)
>     at java.io.File.createTempFile(File.java:1792)
>     at org.apache.hadoop.util.JarFinder.getJar(JarFinder.java:156)
>     ... 16 more
>
>
> --
> Regards-
> Pavan
>