You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Eric Newton (JIRA)" <ji...@apache.org> on 2012/09/20 20:04:07 UTC

[jira] [Created] (ACCUMULO-770) TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly

Eric Newton created ACCUMULO-770:
------------------------------------

             Summary: TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly
                 Key: ACCUMULO-770
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-770
             Project: Accumulo
          Issue Type: Bug
          Components: master
    Affects Versions: 1.4.1
            Reporter: Eric Newton
            Assignee: Eric Newton
             Fix For: 1.4.2


During assignment, each table balancer starts assigning tablets in order.  This ensures the the "lowest" tabletserver gets at least one tablet for each table.  This can make for an unbalanced cluster when there are many small tables.  Randomize the list of tablets in the DefaultLoadBalancer to evenly distribute tablets on a new cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (ACCUMULO-770) TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly

Posted by "Eric Newton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Newton resolved ACCUMULO-770.
----------------------------------

    Resolution: Fixed

fixed the unit test
                
> TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly
> ---------------------------------------------------------------
>
>                 Key: ACCUMULO-770
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-770
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 1.4.1
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.4.2
>
>
> During assignment, each table balancer starts assigning tablets in order.  This ensures the the "lowest" tabletserver gets at least one tablet for each table.  This can make for an unbalanced cluster when there are many small tables.  Randomize the list of tablets in the DefaultLoadBalancer to evenly distribute tablets on a new cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (ACCUMULO-770) TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly

Posted by "Eric Newton (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Newton resolved ACCUMULO-770.
----------------------------------

    Resolution: Fixed

resolved with r1397048 and r1397050
                
> TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly
> ---------------------------------------------------------------
>
>                 Key: ACCUMULO-770
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-770
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 1.4.1
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.4.2
>
>
> During assignment, each table balancer starts assigning tablets in order.  This ensures the the "lowest" tabletserver gets at least one tablet for each table.  This can make for an unbalanced cluster when there are many small tables.  Randomize the list of tablets in the DefaultLoadBalancer to evenly distribute tablets on a new cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Reopened] (ACCUMULO-770) TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly

Posted by "John Vines (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Vines reopened ACCUMULO-770:
---------------------------------


On Ubuntu systems, tests are inconsistently failing. Occured on both Ubuntu 12.04 and 12.10 Beta2 with openjdk as well as Oracle java 6u35. Was able to recreate with just running junit tests in eclipse, as well as maven runs.
                
> TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly
> ---------------------------------------------------------------
>
>                 Key: ACCUMULO-770
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-770
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 1.4.1
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.4.2
>
>
> During assignment, each table balancer starts assigning tablets in order.  This ensures the the "lowest" tabletserver gets at least one tablet for each table.  This can make for an unbalanced cluster when there are many small tables.  Randomize the list of tablets in the DefaultLoadBalancer to evenly distribute tablets on a new cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Comment Edited] (ACCUMULO-770) TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly

Posted by "John Vines (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13474258#comment-13474258 ] 

John Vines edited comment on ACCUMULO-770 at 10/11/12 3:58 PM:
---------------------------------------------------------------

On Ubuntu systems, tests are inconsistently failing. Occured on both Ubuntu 12.04 and 12.10 Beta2 with openjdk as well as Oracle java 6u35. Was able to recreate with just running junit tests in eclipse, as well as maven runs. Specifically, org.apache.accumulo.server.master.balancer.DefaultLoadBalancerTest#testAssignMigrations(). I saw successes as well as failures where 3 was expected and got 4 or 2.
                
      was (Author: vines):
    On Ubuntu systems, tests are inconsistently failing. Occured on both Ubuntu 12.04 and 12.10 Beta2 with openjdk as well as Oracle java 6u35. Was able to recreate with just running junit tests in eclipse, as well as maven runs.
                  
> TableLoadBalancer / DefaultLoadBalancer assigns tables unevenly
> ---------------------------------------------------------------
>
>                 Key: ACCUMULO-770
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-770
>             Project: Accumulo
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 1.4.1
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.4.2
>
>
> During assignment, each table balancer starts assigning tablets in order.  This ensures the the "lowest" tabletserver gets at least one tablet for each table.  This can make for an unbalanced cluster when there are many small tables.  Randomize the list of tablets in the DefaultLoadBalancer to evenly distribute tablets on a new cluster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira