[jira] [Commented] (IMPALA-10921) Script to compare 2 different TPCDS runs.

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430035#comment-17430035 ] 

ASF subversion and git services commented on IMPALA-10921:
----------------------------------------------------------

Commit dc313b3e4cae3dd57c55cc40e9c2b824082918a7 in impala's branch refs/heads/master from Amogh Margoor
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=dc313b3 ]

IMPALA-10921 Add script to compare TPCDS runs.

This script compares 2 runs of TPCDS by parsing their respective
Impala plain text query profiles. It currently outputs the peak
memory comparision of both runs where:
1. It compares average per-node peak memory and geo-mean
   per-node peak memory.
2. It compares max peak memory reduction among Hash operators.

It can be extended to other comparisions in future.

Example usage:

 tpcds_run_comparator.py <path to base run profile>
 <path to new run profile> [path to result csv file]

Change-Id: Ib2e9ae1a2919156b0022072f47ff71d7775b20e6
Reviewed-on: http://gerrit.cloudera.org:8080/17855
Reviewed-by: Riza Suminto <ri...@cloudera.com>
Reviewed-by: Zoltan Borok-Nagy <bo...@cloudera.com>
Tested-by: Zoltan Borok-Nagy <bo...@cloudera.com>


> Script to compare 2 different TPCDS runs.
> -----------------------------------------
>
>                 Key: IMPALA-10921
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10921
>             Project: IMPALA
>          Issue Type: Task
>            Reporter: Amogh Margoor
>            Assignee: Amogh Margoor
>            Priority: Major
>
> We need script to compare 2 different TPCDS runs and do comparisons like changes in peak memory etc between 2 runs. It can be extended to many such analysis in future.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org