You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "stack (JIRA)" <ji...@apache.org> on 2008/01/25 18:57:35 UTC
[jira] Created: (HADOOP-2712) [hbase] under load, regions won't
split
[hbase] under load, regions won't split
---------------------------------------
Key: HADOOP-2712
URL: https://issues.apache.org/jira/browse/HADOOP-2712
Project: Hadoop Core
Issue Type: Bug
Components: contrib/hbase
Reporter: stack
Priority: Blocker
Fix For: 0.16.0
First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2712) [hbase] under load, regions won't
split
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HADOOP-2712:
--------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed.
> [hbase] under load, regions won't split
> ---------------------------------------
>
> Key: HADOOP-2712
> URL: https://issues.apache.org/jira/browse/HADOOP-2712
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: flag-v2.patch, flag-v4.patch
>
>
> First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2712) [hbase] under load, regions won't
split
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HADOOP-2712:
--------------------------
Attachment: flag-v2.patch
Add flag that blocks compactions. Gets set when trying to close a region.
> [hbase] under load, regions won't split
> ---------------------------------------
>
> Key: HADOOP-2712
> URL: https://issues.apache.org/jira/browse/HADOOP-2712
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: flag-v2.patch
>
>
> First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2712) [hbase] under load, regions won't
split
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562853#action_12562853 ]
Hudson commented on HADOOP-2712:
--------------------------------
Integrated in Hadoop-trunk #380 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/380/])
> [hbase] under load, regions won't split
> ---------------------------------------
>
> Key: HADOOP-2712
> URL: https://issues.apache.org/jira/browse/HADOOP-2712
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: flag-v2.patch, flag-v4.patch
>
>
> First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2712) [hbase] under load, regions won't
split
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HADOOP-2712:
--------------------------
Status: Patch Available (was: Open)
Passes tests locally. Passing to hudson.
> [hbase] under load, regions won't split
> ---------------------------------------
>
> Key: HADOOP-2712
> URL: https://issues.apache.org/jira/browse/HADOOP-2712
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: flag-v2.patch
>
>
> First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2712) [hbase] under load, regions won't
split
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HADOOP-2712:
--------------------------
Attachment: flag-v4.patch
Move setting of block compactions flag outside of while loop.
This improves the story but still a few (non-fatal) issues. When split goes to close region, under load, waiting on outstanding scanners to come in and the last flush can take tens of seconds to complete -- longer than the retries in the client. Client gets bumped.
> [hbase] under load, regions won't split
> ---------------------------------------
>
> Key: HADOOP-2712
> URL: https://issues.apache.org/jira/browse/HADOOP-2712
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: flag-v2.patch, flag-v4.patch
>
>
> First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2712) [hbase] under load, regions won't
split
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562772#action_12562772 ]
Hadoop QA commented on HADOOP-2712:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12374088/flag-v4.patch
against trunk revision 614721.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1682/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1682/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1682/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1682/console
This message is automatically generated.
> [hbase] under load, regions won't split
> ---------------------------------------
>
> Key: HADOOP-2712
> URL: https://issues.apache.org/jira/browse/HADOOP-2712
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: flag-v2.patch, flag-v4.patch
>
>
> First reported by Billy Preston over in HADOOP-2615, hbase won't split a region when under load; runaway compactions prevent it. This is a blocker because under load, we'll just make a region so big, we just kill the region server.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.