[jira] [Updated] (HBASE-8348) Polish the migration to 0.96

["rajeshbabu (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

rajeshbabu updated HBASE-8348:
------------------------------

    Attachment: HBASE-8348_trunk.patch

Here is the patch for trunk which includes migration tool to
1) Migrate zookeeper data if no hbase process is alive
■ Find .META region server from -ROOT- and create meta-region-server
■ Migrate table states to PB(solve HBASE-7766 and helps to find exact state of a table otherwise even disabled tables also be will enabled during master startup.)
■ clean the znodes which are not used in 0.95.0 or not needed during clean cluster startup(znodes like rs,root-region-server,unassigned,splitlog,hbase-id,shutdown are removed).
2) remove -ROOT- table from filesystem
3) Identify HFiles of version 1(using HFileV1Detector tool). 

and also removed TestMetaMigrationRemovingHTD#testMetaUpdatedFlagInROOT

[~saint.ack@gmail.com]
bq. Also "..test that < 0.95 hlogs and hfiles are readable" (from Matteo)
Able to read hfiles and user table hlogs of older hbase version properly but not able to read META table hlogs because we are writing edits of it into a separate hlog suffixed by "-meta". So not able to find it from hlogs od older version.
I think It would be better to flush -ROOT- and .META. tables atleast before stopping the cluster. Please suggest some solution for this scenario.


Please review the patch and provide any suggestions/comments.






                
> Polish the migration to 0.96
> ----------------------------
>
>                 Key: HBASE-8348
>                 URL: https://issues.apache.org/jira/browse/HBASE-8348
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.95.0
>            Reporter: Jean-Daniel Cryans
>            Priority: Critical
>             Fix For: 0.95.2
>
>         Attachments: HBASE-8348_trunk.patch
>
>
> Currently, migration works but there's still a couple of rough edges:
>  - HBASE-8045 finished the .META. migration but didn't remove ROOT, so it's still on the filesystem.
>  - Data in ZK needs to be removed manually. Either we fix up the data in ZK or we delete it ourselves.
>  - TestMetaMigrationRemovingHTD has a testMetaUpdatedFlagInROOT method, but ROOT is gone now.
> Elliott was also mentioning that we could have "hbase migrate" do the HFileV1 checks, clear ZK, remove ROOT, etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira