[jira] [Created] (IMPALA-9937) Catalogd should send incremental metadata updates in DDL responses to legacy coordinators

["Quanlong Huang (Jira)" <ji...@apache.org>]

Quanlong Huang created IMPALA-9937:
--------------------------------------

             Summary: Catalogd should send incremental metadata updates in DDL responses to legacy coordinators
                 Key: IMPALA-9937
                 URL: https://issues.apache.org/jira/browse/IMPALA-9937
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Quanlong Huang


After IMPALA-3127, catalogd is able to send incremental metadata updates in partition level. Ideally, legacy coordinators should receive incremental updates in DDL responses. E.g. when adding one partition, only get back the metadata of this partition and some table level updates, not including metadata of other unchanged partitions.

However, catalogd still sends full table objects in DDL responses because catalogd is not aware of the table metadata cached in coordinator's cache. Catalogd can't compare them to send incremental updates. To support this, the Catalogd RPC requests should include the partition id list of the target table, catalogd uses it to generate incremental metadata updates in responses.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org