porting from hbase 0.20.3 to 0.90

[Oleg Ruchovets <or...@gmail.com>]

Hi ,
  We are going to port our production environment to 0.90 and I have couple
of questions:
1) We are using HTablePool which returned HTable in version 0.20.3 , but now
it returns HTableInterface
In our  code we used    HTable class methods :

 getStartEndKeys();
 setAutoFlush(false);
 setWriteBufferSize();
....

 The question is : what is the idea to use interface which hide access to
the most HTable methods?
Actually I can cast (HTable)HBaseInterface and use all methods that I need
but it looks ugly solution.
What is the way to write data to hbase using  WriteBufferSize  (
setAutoFlush(false) ,  setWriteBufferSize()) and using HTablePool in 0.90?

2) Our hbase 0.20.3 installation runs  over hadoop 0.21. As I understand
hbase 0.90 uses hadoop-core-0.20-append-r1056497 version.
    Is it correct that only this version have to be used or hbase 0.90
suports hadoop 0.20.X too? Simply we were very happy with hadoop 0.21 and
never tested 0.20-append.


Oleg.

Re: porting from hbase 0.20.3 to 0.90

[Ted Yu <yu...@gmail.com>]

Great questions.

For #2, I think hadoop append feature is for durability.

>From master log, you would see:
2011-02-11 00:34:09,494 INFO
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter: Using syncFs
-- HDFS-200
2011-02-11 00:34:09,495 INFO org.apache.hadoop.hbase.regionserver.wal.HLog:
Using getNumCurrentReplicas--HDFS-826

Please check your hadoop distribution to see whether the JIRAs above are
supported.

I recently had some success using cdh3b2 for hbase 0.90.1
I think you can use cdh3b2 or cdh3b3.

Cheers

On Sat, Feb 12, 2011 at 1:10 PM, Oleg Ruchovets <or...@gmail.com>wrote:

> Hi ,
>  We are going to port our production environment to 0.90 and I have couple
> of questions:
> 1) We are using HTablePool which returned HTable in version 0.20.3 , but
> now
> it returns HTableInterface
> In our  code we used    HTable class methods :
>
>  getStartEndKeys();
>  setAutoFlush(false);
>  setWriteBufferSize();
> ....
>
>  The question is : what is the idea to use interface which hide access to
> the most HTable methods?
> Actually I can cast (HTable)HBaseInterface and use all methods that I need
> but it looks ugly solution.
> What is the way to write data to hbase using  WriteBufferSize  (
> setAutoFlush(false) ,  setWriteBufferSize()) and using HTablePool in 0.90?
>
> 2) Our hbase 0.20.3 installation runs  over hadoop 0.21. As I understand
> hbase 0.90 uses hadoop-core-0.20-append-r1056497 version.
>    Is it correct that only this version have to be used or hbase 0.90
> suports hadoop 0.20.X too? Simply we were very happy with hadoop 0.21 and
> never tested 0.20-append.
>
>
> Oleg.
>