You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/08/15 20:49:00 UTC
[jira] [Commented] (IMPALA-8842) Impala should set correct value
for 'engine' column in TAB_COL_STATS HMS table and read stats accordingly
[ https://issues.apache.org/jira/browse/IMPALA-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908463#comment-16908463 ]
ASF subversion and git services commented on IMPALA-8842:
---------------------------------------------------------
Commit 60ac7c07511015de130dbd01885421459e96bc3e in impala's branch refs/heads/master from Attila Jeges
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=60ac7c0 ]
IMPALA-8842 part 1: (Hive3) Use 'engine' field in HMS stat API
HIVE-22046 added 'engine' column to TAB_COL_STATS and PART_COL_STATS
HMS tables. The new column is used to differentiate among column stats
computed by different engines. The related HMS API calls were changed
accordingly.
This change is Step 2 in a series of steps to coordinate the
introduction of HMS API changes to Hive3 and Impala. Step 4 is also
Impala related, it will be covered in IMPALA-8842 part 2.
The steps are as follows:
1. Change in Hive3.
We push new APIs so Impala can use them. New APIs will simply call old
existing methods so there should not be any change of functionality
there. Since there were many incompatible changes, new APIs are tagged
method_name_V2.
2. Change in Impala.
Push changes to use new methods *V2.
3. Change in Hive3.
Push patch with complete functionality. *V2 methods contains the new
logic. The old existing methods are not used anymore by Impala at this
point, hence they can be removed. For every method_name_V2, I will
create a corresponding method method_name that calls the former one.
4. Change in Impala
Replace *V2 calls by *.
5. Change in Hive3.
Remove *V2 methods from API.
This change also adds exclusions to fe/pom.xml and shaded-deps/pom.xml
to work around the Hive3 Hadoop2 dependency.
TESTING:
Only Step 1 has been merged in into Hive3 at this point, which means
that there's no change in Impala and Hive3 functionality yet.
Change-Id: I9a73f5eeac8e84d63b22aaed5dfbcd8ea39f0af4
Reviewed-on: http://gerrit.cloudera.org:8080/14043
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Impala should set correct value for 'engine' column in TAB_COL_STATS HMS table and read stats accordingly
> ---------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-8842
> URL: https://issues.apache.org/jira/browse/IMPALA-8842
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 3.3.0
> Reporter: Attila Jeges
> Assignee: Attila Jeges
> Priority: Critical
>
> Note that Impala doesn't use PART_COL_STATS HMS table at all, therefore the 'engine' value needs to be set for TAB_COL_STATS HMS table only.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org