You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Michael Brown (JIRA)" <ji...@apache.org> on 2018/03/24 22:29:00 UTC

[jira] [Created] (IMPALA-6736) stress test --filter-query-mem-ratio doesn't work

Michael Brown created IMPALA-6736:
-------------------------------------

             Summary: stress test --filter-query-mem-ratio doesn't work
                 Key: IMPALA-6736
                 URL: https://issues.apache.org/jira/browse/IMPALA-6736
             Project: IMPALA
          Issue Type: Task
          Components: Infrastructure
    Affects Versions: Impala 2.8.0
            Reporter: Michael Brown


In testing https://gerrit.cloudera.org/#/c/9758/ I noticed that TPC-DS Q67A at SF 300 takes 49525M to run without spilling. This is an order of magnitude larger than any other query. The query is too large for the cluster to also stress the cluster concurrency-wise.

The stress test has an option that in theory is supposed to catch this
{noformat}
  --filter-query-mem-ratio FILTER_QUERY_MEM_RATIO
                        Queries that require this ratio of total available
                        memory will be filtered. (default: 0.333)
{noformat}
but it's broken. Fix/improve the option.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)