You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2018/05/23 16:40:00 UTC

[jira] [Created] (IMPALA-7061) PlannerTests should assign HBase splits as part of the test

Joe McDonnell created IMPALA-7061:
-------------------------------------

             Summary: PlannerTests should assign HBase splits as part of the test
                 Key: IMPALA-7061
                 URL: https://issues.apache.org/jira/browse/IMPALA-7061
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend, Infrastructure
    Affects Versions: Impala 2.13.0, Impala 3.1.0
            Reporter: Joe McDonnell
            Assignee: Joe McDonnell


Some frontend PlannerTests rely on HBase tables being split into specific regions with those regions assigned to specific region servers. Right now, the HBase tables are created via the HBase shell with a single region, then they are populated via Hive DMLs, then there is a Java program that splits the tables into appropriate regions and assigns those regions to region servers. Once that is done, nothing is maintaining the assignments. The Java code for doing the splitting is hard to maintain and flaky. The assignments can sometimes drift due to rebalancing.

We should convert this to specify the splits at HBase table creation time. We should have the frontend PlannerTest do assignments at setup time to avoid flakiness due to rebalancing. This should move some flakiness out of dataload.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)