You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Riza Suminto (Jira)" <ji...@apache.org> on 2025/02/12 18:59:00 UTC
[jira] [Commented] (IMPALA-13033) impala-profile-tool should support parsing thrift profiles downloaded from WebUI
[ https://issues.apache.org/jira/browse/IMPALA-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926549#comment-17926549 ]
Riza Suminto commented on IMPALA-13033:
---------------------------------------
[^impala_profile_log_1.1-1739386192341] is example of query log written by Impalad. It usually goes to /var/log/impalad/profiles.
[^thrift_profile_a24f644ffd56a8ad_7011d75300000000.txt] is example of the same thrift profile that downloaded by clicking "Thrift" button in Coordinator's query profile page.
> impala-profile-tool should support parsing thrift profiles downloaded from WebUI
> --------------------------------------------------------------------------------
>
> Key: IMPALA-13033
> URL: https://issues.apache.org/jira/browse/IMPALA-13033
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Quanlong Huang
> Assignee: Anshula Jain
> Priority: Major
> Labels: newbie, ramp-up
> Attachments: impala_profile_log_1.1-1739386192341, thrift_profile_a24f644ffd56a8ad_7011d75300000000.txt
>
>
> In the coordinator WebUI, users can download query profiles in text/json/thrift formats. The thrift profile is the same as one line in the profile log without the timestamp and query id at the beginning.
> impala-profile-tool fails to parse such a file. It should retry parsing the whole line as the encoded profile. Current code snipper:
> {code:cpp}
> // Parse out fields from the line.
> istringstream liness(line);
> int64_t timestamp;
> string query_id, encoded_profile;
> liness >> timestamp >> query_id >> encoded_profile;
> if (liness.fail()) {
> cerr << "Error parsing line " << lineno << ": '" << line << "'\n";
> ++errors;
> continue;
> }{code}
> https://github.com/apache/impala/blob/f620e5d5c0bbdb0fd97bac31c7b7439cd13c6d08/be/src/util/impala-profile-tool.cc#L109
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org