You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/08/07 17:19:00 UTC

[jira] [Commented] (IMPALA-7354) Validate memory estimates for standard workloads in planner tests

    [ https://issues.apache.org/jira/browse/IMPALA-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571992#comment-16571992 ] 

ASF subversion and git services commented on IMPALA-7354:
---------------------------------------------------------

Commit a8d7a50bd51f49c67291915164ad36154e83b8da in impala's branch refs/heads/master from [~tarmstrong@cloudera.com]
[ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=a8d7a50 ]

IMPALA-7354: planner test resource estimates for more workloads

Adds the resource estimates for key benchmark workloads:
TPC-H, TPC-DS, TPC-H Nested and TPC-H Kudu to the planner
test so that we can track changes in resource requirements
and estimates for these queries.

Also don't show decimal places for MB and KB estimates. The
estimates are not accurate to that level and displaying
extra precision has some disadvantages:
* It communicates to readers that the estimates have a high level of
  precision.
* It increases the odds of small variations in file sizes, etc
  causing test failures.

Also fixed a regex in the stress test that didn't escape the decimal
point correctly.

Testing:
Ran core tests.

Change-Id: I6a9f836699200ea87fb03bf36abad0e23949ac26
Reviewed-on: http://gerrit.cloudera.org:8080/11087
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Validate memory estimates for standard workloads in planner tests
> -----------------------------------------------------------------
>
>                 Key: IMPALA-7354
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7354
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Frontend
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>            Priority: Major
>              Labels: resource-management
>             Fix For: Impala 3.1.0
>
>
> Currently we have targeted tests for estimates of individual plan nodes, but it would be good to get coverage of some more interesting query shapes. We should verify the total memory estimate produced by the planner for key workloads - TPC-DS, TPC-H, TPC-H Nested and TPC-H Kudu



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org