Re: [?? Probable Spam] Re: KFS and Hbase

[Krzysztof Szlapinski <kr...@starline.hk>]

Hi Sriram,
> I just got saw via a Google alert.  Yes, KFS works with Hbase.  Jun
> Rao at IBM Almaden got KFS to work with Hbase.  Feel free to email me
> if you need help.
>   

Thx for your answer,
We've tried couple of times following the steps from this doc.: 
http://kosmosfs.wiki.sourceforge.net/UsingWithHadoop
We managed to run hadoop on kfs, but the main problem was that Hbase was 
not able to put data into it.
Are there any tricky issues that are not mentioned in the doc above that 
we should pay attention to?

Krzysiek

Re: [?? Probable Spam] Re: KFS and Hbase

[Jun Rao <ju...@almaden.ibm.com>]

I only tried some simple MapFile read performance on KFS (random key
lookups on about 1GB of MapFile). Preliminary results showed that HDFS run
about 3 times slower than KFS.

I haven't really tried running hbase on KFS. I assume that one just need to
change hbase.root.dir to something like "kfs://kfsnamenode/hbase_root". The
kfs jar file has to be copied to hbase/lib too. When setting up kfs for
hadoop, I have to set JAVA_LIBRARY_PATH  in bin/hadoop manually to add the
dynamic link library dir used by KFS. I would do the same thing in
bin/hbase.

Jun
IBM Almaden Research Center
K55/B1, 650 Harry Road, San Jose, CA  95120-6099

junrao@almaden.ibm.com
(408)927-1886 (phone)
(408)927-3215 (fax)


Krzysztof Szlapinski <kr...@starline.hk> wrote on 09/25/2008
04:12:30 PM:

> Hi Sriram,
> > I just got saw via a Google alert.  Yes, KFS works with Hbase.  Jun
> > Rao at IBM Almaden got KFS to work with Hbase.  Feel free to email me
> > if you need help.
> >
>
> Thx for your answer,
> We've tried couple of times following the steps from this doc.:
> http://kosmosfs.wiki.sourceforge.net/UsingWithHadoop
> We managed to run hadoop on kfs, but the main problem was that Hbase was
> not able to put data into it.
> Are there any tricky issues that are not mentioned in the doc above that
> we should pay attention to?
>
> Krzysiek
>
>