You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Kurt Deschler (Jira)" <ji...@apache.org> on 2023/06/01 10:58:00 UTC

[jira] [Updated] (IMPALA-12176) Improve client fetch metrics

     [ https://issues.apache.org/jira/browse/IMPALA-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kurt Deschler updated IMPALA-12176:
-----------------------------------
    Description: 
These changes address limitations with the current metrics:
 * ClientFetchWaitTimer includes both Thrift serialization/write and client time.
 * RowMaterializationTimer includes both coordinator fetch time and time to convert rows to the client protocol.

Proposed changes:
 * Add CreateResultSetTime metric to PLAN_ROOT_SINK node in the query profile. This will isolate the cost to convert fetched rows to the client protocol.
 * Add read/write times for RPCs in /rpcz webui. These will be hidden by default with a checkbox to enable display.
 * Add sum to RPC histogram metrics
 * Show client RPC read/write/count stats in the query profile

  was:
These changes address limitations with the current metrics:
 * ClientFetchWaitTimer includes both Thrift serialization/write and client time.
 * RowMaterializationTimer includes both coordinator fetch time and time to convert rows to the client protocol.

Proposed changes:
 * Add CreateResultSetTime metric to PLAN_ROOT_SINK node in the query profile. This will isolate the cost to convert fetched rows to the client protocol.
 * Add read/write times for RPCs in /rpcz webui. These will be hidden by default with a checkbox to enable display.
 * Show client RPC read/write/count stats in the query profile


> Improve client fetch metrics
> ----------------------------
>
>                 Key: IMPALA-12176
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12176
>             Project: IMPALA
>          Issue Type: Improvement
>            Reporter: Kurt Deschler
>            Assignee: Kurt Deschler
>            Priority: Major
>
> These changes address limitations with the current metrics:
>  * ClientFetchWaitTimer includes both Thrift serialization/write and client time.
>  * RowMaterializationTimer includes both coordinator fetch time and time to convert rows to the client protocol.
> Proposed changes:
>  * Add CreateResultSetTime metric to PLAN_ROOT_SINK node in the query profile. This will isolate the cost to convert fetched rows to the client protocol.
>  * Add read/write times for RPCs in /rpcz webui. These will be hidden by default with a checkbox to enable display.
>  * Add sum to RPC histogram metrics
>  * Show client RPC read/write/count stats in the query profile



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org