You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2020/10/28 01:05:00 UTC
[jira] [Resolved] (IMPALA-10168) Expose JSON catalog objects in
catalogd's debug page
[ https://issues.apache.org/jira/browse/IMPALA-10168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang resolved IMPALA-10168.
-------------------------------------
Fix Version/s: Impala 4.0
Resolution: Fixed
> Expose JSON catalog objects in catalogd's debug page
> ----------------------------------------------------
>
> Key: IMPALA-10168
> URL: https://issues.apache.org/jira/browse/IMPALA-10168
> Project: IMPALA
> Issue Type: New Feature
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
> Labels: observability
> Fix For: Impala 4.0
>
>
> Catalogd has a debug web page for showing catalog objects. Example URL: [http://localhost:25020/catalog_object?object_type=TABLE&object_name=functional.alltypes]
> Catalog objects are shown in thrift debug strings which are hard to parse for tests. We do have some tests parsing simple things from the thrift debug strings. For instances, we extract the catalog version here:
> [https://github.com/apache/impala/blob/fc19e70cbc94735c38e64573c1e015878f218281/tests/common/impala_service.py#L165]
> We verify whether a table is loaded by checking some substrings:
> [https://github.com/apache/impala/blob/9ecbe7d3dc22d7233e4bf2f91aaab43d0ad4e373/tests/custom_cluster/test_automatic_invalidation.py#L33-L34]
> However, it's hard to parse the partition ids of a hdfs table since the debug string is too complex. It'd be better to support exposing JSON results to ease test codes. JSON format results also help for customer to develop their monitor tools.
> The new URL can be something like [http://localhost:25020/catalog_object?json&object_type=TABLE&object_name=functional.alltypes] (Just adding a "json" parameter).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org