You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Amogh Margoor (Code Review)" <ge...@cloudera.org> on 2021/10/11 13:16:46 UTC

[Impala-ASF-CR] IMPALA-10921 Add script to compare TPCDS runs.

Amogh Margoor has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/17855 )

Change subject: IMPALA-10921 Add script to compare TPCDS runs.
......................................................................

IMPALA-10921 Add script to compare TPCDS runs.

This script compares 2 runs of TPCDS by parsing their respective
Impala plain text query profiles. It currently outputs the peak
memory comparision of both runs where:
1. It compares average per-node peak memory and geo-mean
   per-node peak memory.
2. It compares max peak memory reduction among Hash operators.

It can be extended to other comparisions in future.

Example usage:

 tpcds_run_comparator.py <path to base run profile> <path to new run profile>
 <path to result csv file>

Change-Id: Ib2e9ae1a2919156b0022072f47ff71d7775b20e6
---
A bin/diagnostics/experimental/tpcds_run_comparator.py
1 file changed, 299 insertions(+), 0 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/55/17855/2
-- 
To view, visit http://gerrit.cloudera.org:8080/17855
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ib2e9ae1a2919156b0022072f47ff71d7775b20e6
Gerrit-Change-Number: 17855
Gerrit-PatchSet: 2
Gerrit-Owner: Amogh Margoor <am...@gmail.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Riza Suminto <ri...@cloudera.com>
Gerrit-Reviewer: Zoltan Borok-Nagy <bo...@cloudera.com>