You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2017/09/25 02:21:00 UTC

[jira] [Created] (DRILL-5815) Provide option to set query memory as percent of total

Paul Rogers created DRILL-5815:
----------------------------------

             Summary: Provide option to set query memory as percent of total
                 Key: DRILL-5815
                 URL: https://issues.apache.org/jira/browse/DRILL-5815
             Project: Apache Drill
          Issue Type: Improvement
    Affects Versions: 1.11.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
             Fix For: 1.12.0


Drill provides a parameter to set the memory per query as a static number which defaults to 2 GB. This number is a wonderful setting for the default Drillbit configuration of 8 GB heap; it allows 2-3 concurrent queries. But, as Drillbit memory increases, the default becomes a bit constraining. While users can change the setting, they seldom do.

In addition, provide an option that sets memory as a percent of total memory. If the allocation is 10%, say, and total memory is 128 GB, then each query gets ~13GB, which is a big improvement.

The existing option acts as a floor: the query must receive at least that much memory.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)