You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2018/12/06 00:09:00 UTC

[jira] [Commented] (IMPALA-5397) Set "End Time" earlier rather than on unregistration.

    [ https://issues.apache.org/jira/browse/IMPALA-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710781#comment-16710781 ] 

Tim Armstrong commented on IMPALA-5397:
---------------------------------------

I think we should adopt a definition of "End Time" that more closely aligns to intuition, i.e. when the "real work" of the operation has completed.
* For queries, where execution proceeds concurrently with results being fetched, End Time should be set when admission resources are released (when the query is cancelled, or all results are fetched). 
* For other operations, End Time should be set when the operation enters the FINISHED state.

> Set "End Time" earlier rather than on unregistration.
> -----------------------------------------------------
>
>                 Key: IMPALA-5397
>                 URL: https://issues.apache.org/jira/browse/IMPALA-5397
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 2.9.0
>            Reporter: Mostafa Mokhtar
>            Priority: Major
>              Labels: query-lifecycle
>
> When queries are executed from Hue and hit the idle query timeout then the query duration keeps going up even though the query was cancelled and it is not actually doing any more work. The end time is only set when the query is actually unregistered.
> Queries below finished in 1s640ms while the reported time is much longer. 
> |User||Default Db||Statement||Query Type||Start Time||Waiting Time||Duration||Scan Progress||State||Last Event||# rows fetched||Resource Pool||Details||Action|
> |hue/va1026.halxg.cloudera.com@HALXG.CLOUDERA.COM|tpcds_1000_parquet|select count(*) from tpcds_1000_parquet.inventory|QUERY|2017-05-31 09:38:20.472804000|4m27s|4m32s|261 / 261 ( 100%)|FINISHED|First row fetched|1|root.default|Details|Close|
> |hue/va1026.halxg.cloudera.com@HALXG.CLOUDERA.COM|tpcds_1000_parquet|select count(*) from tpcds_1000_parquet.inventory|QUERY|2017-05-31 08:38:52.780237000|2017-05-31 09:38:20.289582000|59m27s|261 / 261 ( 100%)|FINISHED|1|root.default|Details|



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org