You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "chunhui shen (Created) (JIRA)" <ji...@apache.org> on 2012/03/01 08:38:01 UTC
[jira] [Created] (HBASE-5501) Handle potential data loss due to
concurrent processing of processFaileOver and ServerShutdownHandler
Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
-----------------------------------------------------------------------------------------------------
Key: HBASE-5501
URL: https://issues.apache.org/jira/browse/HBASE-5501
Project: HBase
Issue Type: Bug
Reporter: chunhui shen
Assignee: chunhui shen
In a live cluster, we do the following step
1.kill the master;
1.start the master, and master is initializing；
3.master complete splitLog
4.kill the META server
5.master start assigning ROOT and META
6.Now meta region data will loss since we may assign meta region before SSH finish split log for dead META server.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5501) Handle potential data loss due to
concurrent processing of processFaileOver and ServerShutdownHandler
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220180#comment-13220180 ]
stack commented on HBASE-5501:
------------------------------
Is this patch right? You have a disablessh flag. What about other callbacks that could come in during the initialization? I don't see where you queue up callbacks for processing post-initialization.
> Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
> -----------------------------------------------------------------------------------------------------
>
> Key: HBASE-5501
> URL: https://issues.apache.org/jira/browse/HBASE-5501
> Project: HBase
> Issue Type: Bug
> Reporter: chunhui shen
> Assignee: chunhui shen
> Attachments: hbase-5501.patch
>
>
> In a live cluster, we do the following step
> 1.kill the master;
> 1.start the master, and master is initializing；
> 3.master complete splitLog
> 4.kill the META server
> 5.master start assigning ROOT and META
> 6.Now meta region data will loss since we may assign meta region before SSH finish split log for dead META server.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-5501) Handle potential data loss due to
concurrent processing of processFaileOver and ServerShutdownHandler
Posted by "stack (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-5501.
--------------------------
Resolution: Invalid
Being fixed over in HBASE-5270
> Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
> -----------------------------------------------------------------------------------------------------
>
> Key: HBASE-5501
> URL: https://issues.apache.org/jira/browse/HBASE-5501
> Project: HBase
> Issue Type: Bug
> Reporter: chunhui shen
> Assignee: chunhui shen
> Attachments: hbase-5501.patch
>
>
> In a live cluster, we do the following step
> 1.kill the master;
> 1.start the master, and master is initializing；
> 3.master complete splitLog
> 4.kill the META server
> 5.master start assigning ROOT and META
> 6.Now meta region data will loss since we may assign meta region before SSH finish split log for dead META server.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5501) Handle potential data loss due to
concurrent processing of processFaileOver and ServerShutdownHandler
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220178#comment-13220178 ]
stack commented on HBASE-5501:
------------------------------
Whats going on here Chunhui? You've opened a new issue w/ same title as 5270? How do they relate? Shouldn't this patch be on 5270, not on this new issue?
> Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
> -----------------------------------------------------------------------------------------------------
>
> Key: HBASE-5501
> URL: https://issues.apache.org/jira/browse/HBASE-5501
> Project: HBase
> Issue Type: Bug
> Reporter: chunhui shen
> Assignee: chunhui shen
> Attachments: hbase-5501.patch
>
>
> In a live cluster, we do the following step
> 1.kill the master;
> 1.start the master, and master is initializing；
> 3.master complete splitLog
> 4.kill the META server
> 5.master start assigning ROOT and META
> 6.Now meta region data will loss since we may assign meta region before SSH finish split log for dead META server.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5501) Handle potential data loss due to
concurrent processing of processFaileOver and ServerShutdownHandler
Posted by "chunhui shen (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
chunhui shen updated HBASE-5501:
--------------------------------
Attachment: hbase-5501.patch
In the hbase-5501.patch, we prevent processing of SSH before finish assign ROOTandMETA,and use the same onlineServers for splitLog and joinCluster during initializing
> Handle potential data loss due to concurrent processing of processFaileOver and ServerShutdownHandler
> -----------------------------------------------------------------------------------------------------
>
> Key: HBASE-5501
> URL: https://issues.apache.org/jira/browse/HBASE-5501
> Project: HBase
> Issue Type: Bug
> Reporter: chunhui shen
> Assignee: chunhui shen
> Attachments: hbase-5501.patch
>
>
> In a live cluster, we do the following step
> 1.kill the master;
> 1.start the master, and master is initializing；
> 3.master complete splitLog
> 4.kill the META server
> 5.master start assigning ROOT and META
> 6.Now meta region data will loss since we may assign meta region before SSH finish split log for dead META server.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira