[jira] [Resolved] (IMPALA-7061) PlannerTests should assign HBase splits as part of the test

["Joe McDonnell (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe McDonnell resolved IMPALA-7061.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.1.0

This is fixed in master. It is being backported to 2.x.

> PlannerTests should assign HBase splits as part of the test
> -----------------------------------------------------------
>
>                 Key: IMPALA-7061
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7061
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend, Infrastructure
>    Affects Versions: Impala 2.13.0, Impala 3.1.0
>            Reporter: Joe McDonnell
>            Assignee: Joe McDonnell
>            Priority: Blocker
>             Fix For: Impala 3.1.0
>
>
> Some frontend PlannerTests rely on HBase tables being split into specific regions with those regions assigned to specific region servers. Right now, the HBase tables are created via the HBase shell with a single region, then they are populated via Hive DMLs, then there is a Java program that splits the tables into appropriate regions and assigns those regions to region servers. Once that is done, nothing is maintaining the assignments. The Java code for doing the splitting is hard to maintain and flaky. The assignments can sometimes drift due to rebalancing.
> We should convert this to specify the splits at HBase table creation time. We should have the frontend PlannerTest do assignments at setup time to avoid flakiness due to rebalancing. This should move some flakiness out of dataload.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)