You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2020/10/14 22:49:00 UTC
[jira] [Commented] (IMPALA-10113) Add feature flag for incremental
metadata update
[ https://issues.apache.org/jira/browse/IMPALA-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214320#comment-17214320 ]
ASF subversion and git services commented on IMPALA-10113:
----------------------------------------------------------
Commit 308d692a1ba0c86c7ff718425495d787571c1484 in impala's branch refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=308d692 ]
IMPALA-10113: Add feature flag for incremental metadata updates
This patch adds a feature flag, enable_incremental_metadata_updates, to
turn off incremental metadata (i.e. partition level metadata)
propagation from catalogd to coordinators. It defaults to true. When
setting to false, catalogd will send metadata updates in table
granularity (the legacy behavior).
Also fixes a bug of logging an empty aggregated partition update log
when no partitions are changed in a DDL.
Tests:
- Run CORE tests with this flag set to true and false.
- Add tests with enable_incremental_metadata_updates=false.
Change-Id: I98676fc8ca886f3d9f550f9b96fa6d6bff178ebb
Reviewed-on: http://gerrit.cloudera.org:8080/16436
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Add feature flag for incremental metadata update
> ------------------------------------------------
>
> Key: IMPALA-10113
> URL: https://issues.apache.org/jira/browse/IMPALA-10113
> Project: IMPALA
> Issue Type: New Feature
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Critical
>
> Now catalogd sends metadata updates in partition level. A feature flag to switch back to the original behavior (i.e. sending metadata updates in table level) will ease performance tests like IMPALA-10079.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org