You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Siddharth Karandikar <si...@gmail.com> on 2013/08/06 12:26:55 UTC

Re: FileNotFound Exception while ExportSnapshot

Fixed the subject.



On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar
<si...@gmail.com> wrote:
> Hi All,
>
> I am continuing to tryout ExportSnapshot functionality. Most of the
> time it works perfectly fine.
>
> But recently, I am seeing some strange exception. When I run
> ExportSnapshot, it shows following error and I have no clue how to
> debug this.
>
> java.io.FileNotFoundException: Unable to open link:
> org.apache.hadoop.hbase.io.HLogLink
> locations=[hdfs://10.209.17.88:9000/hbase/.logs/f1/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6,
> hdfs://10.209.17.88:9000/hbase/.oldlogs/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6]
>         at org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.tryOpen(FileLink.java:305)
>         at org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:120)
>         at org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:111)
>         at org.apache.hadoop.hbase.io.FileLink.open(FileLink.java:390)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.openSourceFile(ExportSnapshot.java:299)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:168)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:139)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:88)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
>
>
> Full logs of this Export run can be found here - http://pastebin.com/1yxK3fKE
>
> If I try to Export this snapshot back (i.e. import), I get following error -
>
> siddharth@hbase1-bigdata:~/tools/hbase-0.95.1-hadoop1$ ./bin/hbase
> org.apache.hadoop.hbase.snapshot.ExportSnapshot
> -Dfs.default.name=hdfs://hbase1-bigdata.vxindia.veritas.com:9000/
> -Dhbase.rootdir=hdfs://hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/
> -snapshot sn2 -copy-to hdfs://10.209.17.88:9000/hbase/
> Exception in thread "main" java.io.FileNotFoundException: Unable to
> open link: org.apache.hadoop.hbase.io.HFileLink
> locations=[hdfs://hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6,
> hdfs://hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.tmp/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6,
> hdfs://hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.archive/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6]
>         at org.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot$1.storeFile(ExportSnapshot.java:383)
>         at org.apache.hadoop.hbase.util.FSVisitor.visitRegionStoreFiles(FSVisitor.java:115)
>         at org.apache.hadoop.hbase.util.FSVisitor.visitTableStoreFiles(FSVisitor.java:81)
>         at org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitTableStoreFiles(SnapshotReferenceUtil.java:110)
>         at org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitReferencedFiles(SnapshotReferenceUtil.java:95)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot.getSnapshotFiles(ExportSnapshot.java:378)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot.run(ExportSnapshot.java:618)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot.innerMain(ExportSnapshot.java:690)
>         at org.apache.hadoop.hbase.snapshot.ExportSnapshot.main(ExportSnapshot.java:694)
>
>
>
> Thanks,
> Siddharth

Re: FileNotFound Exception while ExportSnapshot

Posted by Siddharth Karandikar <si...@gmail.com>.
You are correct. Exception is gone after switching to 0.94.10.

Thanks a lot!

-
Siddharth

On Tue, Aug 6, 2013 at 3:59 PM, Matteo Bertozzi <th...@gmail.com> wrote:
> This looks like HBASE-8455 which was fixed in 0.94.8, 0.95.2
>
> Matteo
>
>
>
> On Tue, Aug 6, 2013 at 11:26 AM, Siddharth Karandikar <
> siddharth.karandikar@gmail.com> wrote:
>
>> Fixed the subject.
>>
>>
>>
>> On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar
>> <si...@gmail.com> wrote:
>> > Hi All,
>> >
>> > I am continuing to tryout ExportSnapshot functionality. Most of the
>> > time it works perfectly fine.
>> >
>> > But recently, I am seeing some strange exception. When I run
>> > ExportSnapshot, it shows following error and I have no clue how to
>> > debug this.
>> >
>> > java.io.FileNotFoundException: Unable to open link:
>> > org.apache.hadoop.hbase.io.HLogLink
>> > locations=[hdfs://
>> 10.209.17.88:9000/hbase/.logs/f1/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
>> ,
>> > hdfs://
>> 10.209.17.88:9000/hbase/.oldlogs/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
>> ]
>> >         at
>> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.tryOpen(FileLink.java:305)
>> >         at
>> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:120)
>> >         at
>> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:111)
>> >         at org.apache.hadoop.hbase.io.FileLink.open(FileLink.java:390)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.openSourceFile(ExportSnapshot.java:299)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:168)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:139)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:88)
>> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >         at
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>> >         at
>> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
>> >
>> >
>> > Full logs of this Export run can be found here -
>> http://pastebin.com/1yxK3fKE
>> >
>> > If I try to Export this snapshot back (i.e. import), I get following
>> error -
>> >
>> > siddharth@hbase1-bigdata:~/tools/hbase-0.95.1-hadoop1$ ./bin/hbase
>> > org.apache.hadoop.hbase.snapshot.ExportSnapshot
>> > -Dfs.default.name=hdfs://hbase1-bigdata.vxindia.veritas.com:9000/
>> > -Dhbase.rootdir=hdfs://
>> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/
>> > -snapshot sn2 -copy-to hdfs://10.209.17.88:9000/hbase/
>> > Exception in thread "main" java.io.FileNotFoundException: Unable to
>> > open link: org.apache.hadoop.hbase.io.HFileLink
>> > locations=[hdfs://
>> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
>> ,
>> > hdfs://
>> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.tmp/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
>> ,
>> > hdfs://
>> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.archive/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
>> ]
>> >         at
>> org.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot$1.storeFile(ExportSnapshot.java:383)
>> >         at
>> org.apache.hadoop.hbase.util.FSVisitor.visitRegionStoreFiles(FSVisitor.java:115)
>> >         at
>> org.apache.hadoop.hbase.util.FSVisitor.visitTableStoreFiles(FSVisitor.java:81)
>> >         at
>> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitTableStoreFiles(SnapshotReferenceUtil.java:110)
>> >         at
>> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitReferencedFiles(SnapshotReferenceUtil.java:95)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot.getSnapshotFiles(ExportSnapshot.java:378)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot.run(ExportSnapshot.java:618)
>> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot.innerMain(ExportSnapshot.java:690)
>> >         at
>> org.apache.hadoop.hbase.snapshot.ExportSnapshot.main(ExportSnapshot.java:694)
>> >
>> >
>> >
>> > Thanks,
>> > Siddharth
>>

Re: FileNotFound Exception while ExportSnapshot

Posted by Matteo Bertozzi <th...@gmail.com>.
This looks like HBASE-8455 which was fixed in 0.94.8, 0.95.2

Matteo



On Tue, Aug 6, 2013 at 11:26 AM, Siddharth Karandikar <
siddharth.karandikar@gmail.com> wrote:

> Fixed the subject.
>
>
>
> On Tue, Aug 6, 2013 at 3:55 PM, Siddharth Karandikar
> <si...@gmail.com> wrote:
> > Hi All,
> >
> > I am continuing to tryout ExportSnapshot functionality. Most of the
> > time it works perfectly fine.
> >
> > But recently, I am seeing some strange exception. When I run
> > ExportSnapshot, it shows following error and I have no clue how to
> > debug this.
> >
> > java.io.FileNotFoundException: Unable to open link:
> > org.apache.hadoop.hbase.io.HLogLink
> > locations=[hdfs://
> 10.209.17.88:9000/hbase/.logs/f1/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> 10.209.17.88:9000/hbase/.oldlogs/t1=553ae805df577846bea889ebbec885f2-t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ]
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.tryOpen(FileLink.java:305)
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:120)
> >         at
> org.apache.hadoop.hbase.io.FileLink$FileLinkInputStream.<init>(FileLink.java:111)
> >         at org.apache.hadoop.hbase.io.FileLink.open(FileLink.java:390)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.openSourceFile(ExportSnapshot.java:299)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.copyFile(ExportSnapshot.java:168)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:139)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$ExportMapper.map(ExportSnapshot.java:88)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >         at
> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> >         at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
> >
> >
> > Full logs of this Export run can be found here -
> http://pastebin.com/1yxK3fKE
> >
> > If I try to Export this snapshot back (i.e. import), I get following
> error -
> >
> > siddharth@hbase1-bigdata:~/tools/hbase-0.95.1-hadoop1$ ./bin/hbase
> > org.apache.hadoop.hbase.snapshot.ExportSnapshot
> > -Dfs.default.name=hdfs://hbase1-bigdata.vxindia.veritas.com:9000/
> > -Dhbase.rootdir=hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/
> > -snapshot sn2 -copy-to hdfs://10.209.17.88:9000/hbase/
> > Exception in thread "main" java.io.FileNotFoundException: Unable to
> > open link: org.apache.hadoop.hbase.io.HFileLink
> > locations=[hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.tmp/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ,
> > hdfs://
> hbase1-bigdata.vxindia.veritas.com:9000/hbase-ss/sn2/.archive/t1/553ae805df577846bea889ebbec885f2/f1/t1=553ae805df577846bea889ebbec885f2-919998c061eb444eb3ac69ee55c71fd6
> ]
> >         at
> org.apache.hadoop.hbase.io.FileLink.getFileStatus(FileLink.java:376)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot$1.storeFile(ExportSnapshot.java:383)
> >         at
> org.apache.hadoop.hbase.util.FSVisitor.visitRegionStoreFiles(FSVisitor.java:115)
> >         at
> org.apache.hadoop.hbase.util.FSVisitor.visitTableStoreFiles(FSVisitor.java:81)
> >         at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitTableStoreFiles(SnapshotReferenceUtil.java:110)
> >         at
> org.apache.hadoop.hbase.snapshot.SnapshotReferenceUtil.visitReferencedFiles(SnapshotReferenceUtil.java:95)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.getSnapshotFiles(ExportSnapshot.java:378)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.run(ExportSnapshot.java:618)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.innerMain(ExportSnapshot.java:690)
> >         at
> org.apache.hadoop.hbase.snapshot.ExportSnapshot.main(ExportSnapshot.java:694)
> >
> >
> >
> > Thanks,
> > Siddharth
>