You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2018/11/21 21:40:00 UTC
[jira] [Commented] (IMPALA-7879) Final profiles of queries should
be reliably retrievable
[ https://issues.apache.org/jira/browse/IMPALA-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16695278#comment-16695278 ]
Tim Armstrong commented on IMPALA-7879:
---------------------------------------
Some rough thoughts on what we could do:
* Extend the GetRuntimeProfile() API to indicate whether the returned profile is final or not.
* Support some kind of long polling via that API where the call will wait some amount of time for the profile to be finalised. E.g. so it's safe for the client to poll for the final profile.
> Final profiles of queries should be reliably retrievable
> --------------------------------------------------------
>
> Key: IMPALA-7879
> URL: https://issues.apache.org/jira/browse/IMPALA-7879
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 3.0
> Reporter: Michael Ho
> Priority: Major
> Labels: query-lifecycle
>
> During a [code review|https://gerrit.cloudera.org/#/c/11964/1/tests/beeswax/impala_beeswax.py@206], [~tarmstrong] pointed out that there may be a problem with the query life cycle management which prevents the final profile from being accessible reliably for a query.
> In particular, the ExecSummary and Error sections are not added to the profile until a query is unregistered. At which point, the profile is archived. It's possible that the archive log rolls over before the profile is retrieved or that the profile archive log has been disabled. In which case, there is no way to get the final profile of a query. Ideally, the final profile should be available before query unregistration (e.g. once all backends have completed).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org