You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2025/02/12 18:59:00 UTC

[jira] [Commented] (IMPALA-13033) impala-profile-tool should support parsing thrift profiles downloaded from WebUI

    [ https://issues.apache.org/jira/browse/IMPALA-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926549#comment-17926549 ] 

Riza Suminto commented on IMPALA-13033:
---------------------------------------

[^impala_profile_log_1.1-1739386192341] is example of query log written by Impalad. It usually goes to /var/log/impalad/profiles.

[^thrift_profile_a24f644ffd56a8ad_7011d75300000000.txt] is example of the same thrift profile that downloaded by clicking "Thrift" button in Coordinator's query profile page.

> impala-profile-tool should support parsing thrift profiles downloaded from WebUI
> --------------------------------------------------------------------------------
>
>                 Key: IMPALA-13033
>                 URL: https://issues.apache.org/jira/browse/IMPALA-13033
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>            Reporter: Quanlong Huang
>            Assignee: Anshula Jain
>            Priority: Major
>              Labels: newbie, ramp-up
>         Attachments: impala_profile_log_1.1-1739386192341, thrift_profile_a24f644ffd56a8ad_7011d75300000000.txt
>
>
> In the coordinator WebUI, users can download query profiles in text/json/thrift formats. The thrift profile is the same as one line in the profile log without the timestamp and query id at the beginning.
> impala-profile-tool fails to parse such a file. It should retry parsing the whole line as the encoded profile. Current code snipper:
> {code:cpp}
>     // Parse out fields from the line.
>     istringstream liness(line);
>     int64_t timestamp;
>     string query_id, encoded_profile;
>     liness >> timestamp >> query_id >> encoded_profile;
>     if (liness.fail()) {
>       cerr << "Error parsing line " << lineno << ": '" << line << "'\n";
>       ++errors;
>       continue;
>     }{code}
> https://github.com/apache/impala/blob/f620e5d5c0bbdb0fd97bac31c7b7439cd13c6d08/be/src/util/impala-profile-tool.cc#L109



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org