You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Jim Apple (Code Review)" <ge...@cloudera.org> on 2018/09/01 02:16:02 UTC

[Impala-ASF-CR] IMPALA-7426: Use Mann-Whitney U to compare benchmarks

Hello Philip Zeyliger, Impala Public Jenkins, 

I'd like you to reexamine a change. Please visit

    http://gerrit.cloudera.org:8080/11194

to look at the new patch set (#3).

Change subject: IMPALA-7426: Use Mann-Whitney U to compare benchmarks
......................................................................

IMPALA-7426: Use Mann-Whitney U to compare benchmarks

The Mann-Whitney test can be used to compare samples taken from
non-normal distributions, and so can more accurately reflect
performance changes than a T-test. This patch does not remove t-tests
from the benchmark reporting, it just supplements them by including
the Mann-Whitney test result as well.

Change-Id: I8d6631ebeba1422b832def5cd68537624f672fa0
---
M tests/benchmark/report_benchmark_results.py
M tests/util/calculation_util.py
2 files changed, 85 insertions(+), 37 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/94/11194/3
-- 
To view, visit http://gerrit.cloudera.org:8080/11194
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I8d6631ebeba1422b832def5cd68537624f672fa0
Gerrit-Change-Number: 11194
Gerrit-PatchSet: 3
Gerrit-Owner: Jim Apple <jb...@apache.org>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Jim Apple <jb...@apache.org>
Gerrit-Reviewer: Philip Zeyliger <ph...@cloudera.com>