[jira] [Created] (IMPALA-10794) Improve observability of execDdl code paths

["Quanlong Huang (Jira)" <ji...@apache.org>]

Quanlong Huang created IMPALA-10794:
---------------------------------------

             Summary: Improve observability of execDdl code paths
                 Key: IMPALA-10794
                 URL: https://issues.apache.org/jira/browse/IMPALA-10794
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog, Frontend
            Reporter: Quanlong Huang


It's hard to debug a hanging DDL/DML:
* The last log before coordinator sending execDdl RPC to catalogd is "Analysis and authorization finished."
* Catalogd just prints logs when it finishes the HMS operations and start reloading metadata incrementally.

It'd be helpful to add logs:
* On coordinator side, add logs when start/finish the execDdl RPCs.
* On catalogd side, add logs when start/finish executing an execDdl request. More loggings in specifit complex ddls will also be helpful.

We also need to add thread annotation in catalogd for the part executing HMS RPCs. We currently only have them in loading metadata. That's not enough.

CC [~vihangk1] who may already have a draft for this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org