You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bookkeeper.apache.org by "Flavio Junqueira (Created) (JIRA)" <ji...@apache.org> on 2012/03/31 16:44:25 UTC

[jira] [Created] (BOOKKEEPER-201) Interface to remove slow disks

Interface to remove slow disks
------------------------------

                 Key: BOOKKEEPER-201
                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-201
             Project: Bookkeeper
          Issue Type: Improvement
            Reporter: Flavio Junqueira


As per a conversation with Ivan and Ben, we propose an interface that enables an operator to make a bookie disk inactive. The general idea is that if a bookie has multiple ledger disks and one is continuously underperforming, then we would like to tell the bookie to stop creating ledgers on that disk. Eventually the bookie stops using that disk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BOOKKEEPER-201) Interface to remove slow disks

Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267356#comment-13267356 ] 

Uma Maheswara Rao G commented on BOOKKEEPER-201:
------------------------------------------------

What if Bookie restarts? It may consider back again right. operator can not remove that disk from config as there might be some data written already. Am I missing?
                
> Interface to remove slow disks
> ------------------------------
>
>                 Key: BOOKKEEPER-201
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-201
>             Project: Bookkeeper
>          Issue Type: Improvement
>            Reporter: Flavio Junqueira
>
> As per a conversation with Ivan and Ben, we propose an interface that enables an operator to make a bookie disk inactive. The general idea is that if a bookie has multiple ledger disks and one is continuously underperforming, then we would like to tell the bookie to stop creating ledgers on that disk. Eventually the bookie stops using that disk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BOOKKEEPER-201) Interface to remove slow disks

Posted by "Uma Maheswara Rao G (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267426#comment-13267426 ] 

Uma Maheswara Rao G commented on BOOKKEEPER-201:
------------------------------------------------

Thanks a lot, Flavio for the explanation.
I got your point here. Operator should ensure that, he will repair the failed directories or replace with new before node down and start again back. So, that it will be consider it back as normal.

{quote}
We probably also want to give the operator the chance to add disks, just so that we can bring the bookie back to its original state in the case we replace the disk.
{quote}
Seems like a dynamic addition of directories. Good one.
                
> Interface to remove slow disks
> ------------------------------
>
>                 Key: BOOKKEEPER-201
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-201
>             Project: Bookkeeper
>          Issue Type: Improvement
>            Reporter: Flavio Junqueira
>
> As per a conversation with Ivan and Ben, we propose an interface that enables an operator to make a bookie disk inactive. The general idea is that if a bookie has multiple ledger disks and one is continuously underperforming, then we would like to tell the bookie to stop creating ledgers on that disk. Eventually the bookie stops using that disk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (BOOKKEEPER-201) Interface to remove slow disks

Posted by "Ivan Kelly (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/BOOKKEEPER-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ivan Kelly updated BOOKKEEPER-201:
----------------------------------

    Fix Version/s:     (was: 4.2.0)
                   4.3.0
    
> Interface to remove slow disks
> ------------------------------
>
>                 Key: BOOKKEEPER-201
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-201
>             Project: Bookkeeper
>          Issue Type: Improvement
>            Reporter: Flavio Junqueira
>             Fix For: 4.3.0
>
>
> As per a conversation with Ivan and Ben, we propose an interface that enables an operator to make a bookie disk inactive. The general idea is that if a bookie has multiple ledger disks and one is continuously underperforming, then we would like to tell the bookie to stop creating ledgers on that disk. Eventually the bookie stops using that disk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (BOOKKEEPER-201) Interface to remove slow disks

Posted by "Flavio Junqueira (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13267416#comment-13267416 ] 

Flavio Junqueira commented on BOOKKEEPER-201:
---------------------------------------------

bq. What if Bookie restarts? It may consider back again right.

The idea in this jira targets a single disk. The general idea is that a bookie might be mostly fine, except for a disk that is underperforming. Perhaps instead of giving the operator only the option of removing the bookie completely, we could give this option that enables the bookie to eventually stop writing to that disk. We probably also want to give the operator the chance to add disks, just so that we can bring the bookie back to its original state in the case we replace the disk.

bq. operator can not remove that disk from config as there might be some data written already.

One idea is to use the bookie recovery tool to reconstruct the ledger fragments on the faulty disk in another bookie.
                
> Interface to remove slow disks
> ------------------------------
>
>                 Key: BOOKKEEPER-201
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-201
>             Project: Bookkeeper
>          Issue Type: Improvement
>            Reporter: Flavio Junqueira
>
> As per a conversation with Ivan and Ben, we propose an interface that enables an operator to make a bookie disk inactive. The general idea is that if a bookie has multiple ledger disks and one is continuously underperforming, then we would like to tell the bookie to stop creating ledgers on that disk. Eventually the bookie stops using that disk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (BOOKKEEPER-201) Interface to remove slow disks

Posted by "Ivan Kelly (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/BOOKKEEPER-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ivan Kelly updated BOOKKEEPER-201:
----------------------------------

    Fix Version/s: 4.2.0
    
> Interface to remove slow disks
> ------------------------------
>
>                 Key: BOOKKEEPER-201
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-201
>             Project: Bookkeeper
>          Issue Type: Improvement
>            Reporter: Flavio Junqueira
>             Fix For: 4.2.0
>
>
> As per a conversation with Ivan and Ben, we propose an interface that enables an operator to make a bookie disk inactive. The general idea is that if a bookie has multiple ledger disks and one is continuously underperforming, then we would like to tell the bookie to stop creating ledgers on that disk. Eventually the bookie stops using that disk.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira