[jira] Commented: (HBASE-1062) Compactions at (re)start on a large table can overwhelm DFS

["stack (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771282#action_12771282 ] 

stack commented on HBASE-1062:
------------------------------

@Andrew In IRC discussions, did we say we could do away with this bandaid now we don't compact on every open, only if region has references (which is usually well after startup).  I've cut this patch from TRUNK.  Let me know if removing it a misstack [sic].  I did it as part of my hbase-1816 hackup job.

> Compactions at (re)start on a large table can overwhelm DFS
> -----------------------------------------------------------
>
>                 Key: HBASE-1062
>                 URL: https://issues.apache.org/jira/browse/HBASE-1062
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: regionserver
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Critical
>             Fix For: 0.19.0
>
>         Attachments: 1062-1.patch, 1062-2.patch, 1062-3.patch, 1062-4.patch
>
>
> Given a large table, > 1000 regions for example, if a cluster restart is necessary, the compactions undertaken by the regionservers when the master makes initial region assignments can overwhelm DFS, leading to file errors and data loss. This condition is exacerbated if write load was heavy before restart and so many regions want to split as soon as they are opened. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.