You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Something Something <ma...@gmail.com> on 2011/06/13 03:25:41 UTC

Transaction Management in HBase?

What's the best way of implementing transaction management in HBase?  I have
a use case in which I update multiple tables.  If for some reason an update
fails on the 2nd table, I would like to rollback changes to the first
table.  A quick Google search got me to this document:
http://hbase.apache.org/docs/r0.20.6/api/org/apache/hadoop/hbase/client/transactional/TransactionManager.html

But this class is not available in 0.20.3 or in the latest version 0.90.3.

Please help.  Thanks.

Re: Transaction Management in HBase?

Posted by Eric Charles <er...@u-mangate.com>.
This is now maintained for 0.90.RC3 on
https://github.com/hbase-trx/hbase-transactional-tableindexed/

I guess it is compatible with 0.90.3 (I plan to test it one of these days).

Tks,
Eric

On 13/06/11 03:25, Something Something wrote:
> What's the best way of implementing transaction management in HBase?  I have
> a use case in which I update multiple tables.  If for some reason an update
> fails on the 2nd table, I would like to rollback changes to the first
> table.  A quick Google search got me to this document:
> http://hbase.apache.org/docs/r0.20.6/api/org/apache/hadoop/hbase/client/transactional/TransactionManager.html
>
> But this class is not available in 0.20.3 or in the latest version 0.90.3.
>
> Please help.  Thanks.
>


Re: secondary index

Posted by Eric Charles <er...@u-mangate.com>.
I guess it github project is no more compatible with last HBase API changes.
Maybe contact directly the author (James Kennedy) on Github (last commit
was 2 months ago), or still better, fork, fix and request for pull on
github :)

Tks,
- Eric


On 13/06/11 09:42, hmchiud@tsmc.com wrote:
> 
> 
> Hi,
> 
> It seems that it is not compatible with 0.90.1-cdh3u0.
> There are compile errors in openHRegion and replayRecoveredEditsIfAny.
> Any ideas?
> Thank you
> 
> 
> public class TransactionalRegion extends HRegion {
> 
>      @Override
>      protected HRegion openHRegion(final Progressable reporter) throws
> IOException {
> 
> 
>      @Override
>      protected long replayRecoveredEditsIfAny(final Path regiondir, final
> long minSeqId, final Progressable reporter)
> 
> 
> 
> Fleming Chiu(邱宏明)
> Ext: 707-2260
> Be Veg, Go Green, Save the Planet!
> 
> 
> 
>               Eric Charles
>               <eric.charles@u-mangate.c
>               om>                                                                                                                        To
>                                                 user@hbase.apache.org
>                                                                                                                                         cc
> 
>               2011/06/13 下午 02:35                                                                                                Subject
>                                                 Re: secondary index
> 
>                   Please respond to
>                 user@hbase.apache.org
> 
> 
> 
> 
> 
> 
> 
> Hi,
> This is the place for the source
> https://github.com/hbase-trx/hbase-transactional-tableindexed
> 
> You will have to build it (mvn package) and validate it is still
> compatible with 0.90.1-cdh3u0.
> 
> About the installation, they say "Drop the jar in the classpath of your
> application". I guess adding it to the lib folder of the HBase
> installation will do the job (to be verified).
> There's also some configuration and TableIndexed.rb to add to have
> additional commands via the console.
> 
> Tks,
> - Eric
> 
> 
> On 13/06/11 08:00, hmchiud@tsmc.com wrote:
>>
>>
>> Hi,
>>
>> I am trying to build secondary index by hbase-transactional-tableindexed.
>> My HBase version is hbase-0.90.1-cdh3u0.jar.
>> Where can I download the hbase-transactional-tableindexed jar ?
>> and how can I deploy that jar (to each region server?)
>> or is there any best secondary index components?
>> Thank you very much
>>
>> Fleming
>>
> ---------------------------------------------------------------------------
>>                                                            TSMC PROPERTY
>>    This email communication (and any attachments) is proprietary
> information
>>    for the sole use of its
>>    intended recipient. Any unauthorized review, use or distribution by
> anyone
>>    other than the intended
>>    recipient is strictly prohibited.  If you are not the intended
> recipient,
>>    please notify the sender by
>>    replying to this email, and then delete this email and any copies of it
>>    immediately. Thank you.
>>
> ---------------------------------------------------------------------------
>>
>>
>>
> 
> 
> 
>   ---------------------------------------------------------------------------
>                                                           TSMC PROPERTY
>   This email communication (and any attachments) is proprietary information
>   for the sole use of its
>   intended recipient. Any unauthorized review, use or distribution by anyone
>   other than the intended
>   recipient is strictly prohibited.  If you are not the intended recipient,
>   please notify the sender by
>   replying to this email, and then delete this email and any copies of it
>   immediately. Thank you.
>   ---------------------------------------------------------------------------
> 
> 
> 


Re: secondary index

Posted by hm...@tsmc.com.

Hi,

It seems that it is not compatible with 0.90.1-cdh3u0.
There are compile errors in openHRegion and replayRecoveredEditsIfAny.
Any ideas?
Thank you


public class TransactionalRegion extends HRegion {

    @Override
    protected HRegion openHRegion(final Progressable reporter) throws
IOException {


    @Override
    protected long replayRecoveredEditsIfAny(final Path regiondir, final
long minSeqId, final Progressable reporter)



Fleming Chiu(邱宏明)
Ext: 707-2260
Be Veg, Go Green, Save the Planet!


                                                                                                                                          
             Eric Charles                                                                                                                 
             <eric.charles@u-mangate.c                                                                                                    
             om>                                                                                                                       To 
                                               user@hbase.apache.org                                                                      
                                                                                                                                       cc 
                                                                                                                                          
             2011/06/13 下午 02:35                                                                                                Subject 
                                               Re: secondary index                                                                        
                                                                                                                                          
                 Please respond to                                                                                                        
               user@hbase.apache.org                                                                                                      
                                                                                                                                          
                                                                                                                                          
                                                                                                                                          




Hi,
This is the place for the source
https://github.com/hbase-trx/hbase-transactional-tableindexed

You will have to build it (mvn package) and validate it is still
compatible with 0.90.1-cdh3u0.

About the installation, they say "Drop the jar in the classpath of your
application". I guess adding it to the lib folder of the HBase
installation will do the job (to be verified).
There's also some configuration and TableIndexed.rb to add to have
additional commands via the console.

Tks,
- Eric


On 13/06/11 08:00, hmchiud@tsmc.com wrote:
>
>
> Hi,
>
> I am trying to build secondary index by hbase-transactional-tableindexed.
> My HBase version is hbase-0.90.1-cdh3u0.jar.
> Where can I download the hbase-transactional-tableindexed jar ?
> and how can I deploy that jar (to each region server?)
> or is there any best secondary index components?
> Thank you very much
>
> Fleming
>
---------------------------------------------------------------------------
>                                                           TSMC PROPERTY
>   This email communication (and any attachments) is proprietary
information
>   for the sole use of its
>   intended recipient. Any unauthorized review, use or distribution by
anyone
>   other than the intended
>   recipient is strictly prohibited.  If you are not the intended
recipient,
>   please notify the sender by
>   replying to this email, and then delete this email and any copies of it
>   immediately. Thank you.
>
---------------------------------------------------------------------------
>
>
>



 --------------------------------------------------------------------------- 
                                                         TSMC PROPERTY       
 This email communication (and any attachments) is proprietary information   
 for the sole use of its                                                     
 intended recipient. Any unauthorized review, use or distribution by anyone  
 other than the intended                                                     
 recipient is strictly prohibited.  If you are not the intended recipient,   
 please notify the sender by                                                 
 replying to this email, and then delete this email and any copies of it     
 immediately. Thank you.                                                     
 --------------------------------------------------------------------------- 




Re: secondary index

Posted by Eric Charles <er...@u-mangate.com>.
Hi,
This is the place for the source
https://github.com/hbase-trx/hbase-transactional-tableindexed

You will have to build it (mvn package) and validate it is still 
compatible with 0.90.1-cdh3u0.

About the installation, they say "Drop the jar in the classpath of your 
application". I guess adding it to the lib folder of the HBase 
installation will do the job (to be verified).
There's also some configuration and TableIndexed.rb to add to have 
additional commands via the console.

Tks,
- Eric


On 13/06/11 08:00, hmchiud@tsmc.com wrote:
>
>
> Hi,
>
> I am trying to build secondary index by hbase-transactional-tableindexed.
> My HBase version is hbase-0.90.1-cdh3u0.jar.
> Where can I download the hbase-transactional-tableindexed jar ?
> and how can I deploy that jar (to each region server?)
> or is there any best secondary index components?
> Thank you very much
>
> Fleming
>   ---------------------------------------------------------------------------
>                                                           TSMC PROPERTY
>   This email communication (and any attachments) is proprietary information
>   for the sole use of its
>   intended recipient. Any unauthorized review, use or distribution by anyone
>   other than the intended
>   recipient is strictly prohibited.  If you are not the intended recipient,
>   please notify the sender by
>   replying to this email, and then delete this email and any copies of it
>   immediately. Thank you.
>   ---------------------------------------------------------------------------
>
>
>


secondary index

Posted by hm...@tsmc.com.

Hi,

I am trying to build secondary index by hbase-transactional-tableindexed.
My HBase version is hbase-0.90.1-cdh3u0.jar.
Where can I download the hbase-transactional-tableindexed jar ?
and how can I deploy that jar (to each region server?)
or is there any best secondary index components?
Thank you very much

Fleming
 --------------------------------------------------------------------------- 
                                                         TSMC PROPERTY       
 This email communication (and any attachments) is proprietary information   
 for the sole use of its                                                     
 intended recipient. Any unauthorized review, use or distribution by anyone  
 other than the intended                                                     
 recipient is strictly prohibited.  If you are not the intended recipient,   
 please notify the sender by                                                 
 replying to this email, and then delete this email and any copies of it     
 immediately. Thank you.                                                     
 ---------------------------------------------------------------------------