You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Adrian Ng (JIRA)" <ji...@apache.org> on 2019/01/10 23:24:00 UTC
[jira] [Commented] (IMPALA-7937) Breakdown of aggregated
LocalCatalog cache metrics
[ https://issues.apache.org/jira/browse/IMPALA-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16739857#comment-16739857 ]
Adrian Ng commented on IMPALA-7937:
-----------------------------------
Agreed with Bharath. This one is low priority.
> Breakdown of aggregated LocalCatalog cache metrics
> --------------------------------------------------
>
> Key: IMPALA-7937
> URL: https://issues.apache.org/jira/browse/IMPALA-7937
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Affects Versions: Impala 3.1.0
> Reporter: bharath v
> Priority: Minor
> Labels: observability
>
> Currently, we have a neat breakdown of per-query LocalCatalog cache metrics in the query runtime profile (in LocalCatalog mode). For ex:
> {noformat}
> - CatalogFetch.ColumnStats.Misses: 13
> - CatalogFetch.ColumnStats.Requests: 13
> - CatalogFetch.ColumnStats.Time: 17ms
> - CatalogFetch.Config.Misses: 1
> - CatalogFetch.Config.Requests: 1
> - CatalogFetch.Config.Time: 4ms
> - CatalogFetch.DatabaseList.Hits: 1
> - CatalogFetch.DatabaseList.Requests: 1
> - CatalogFetch.DatabaseList.Time: 0
> - CatalogFetch.PartitionLists.Misses: 1
> - CatalogFetch.PartitionLists.Requests: 1
> - CatalogFetch.PartitionLists.Time: 5ms
> - CatalogFetch.Partitions.Hits: 48
> - CatalogFetch.Partitions.Misses: 24
> - CatalogFetch.Partitions.Requests: 72
> - CatalogFetch.Partitions.Time: 26ms
> - CatalogFetch.RPCs.Bytes: 33.96 KB (34775)
> - CatalogFetch.RPCs.Requests: 4
> - CatalogFetch.RPCs.Time: 358ms
> - CatalogFetch.TableNames.Hits: 2
> - CatalogFetch.TableNames.Requests: 2
> - CatalogFetch.TableNames.Time: 0
> - CatalogFetch.Tables.Misses: 1
> - CatalogFetch.Tables.Requests: 1
> - CatalogFetch.Tables.Time: 359ms
> {noformat}
> The idea here is to aggregate these across all the queries and present them on the coordinator web UI so that we can answer questions like following,
> - What type of requests constitute the majority of cache hits/misses.
> - What type of requests spend most of the time spent in RPCs / fetch most RPC data
> .......
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org