You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2017/10/16 19:51:00 UTC
[jira] [Resolved] (DRILL-5815) Provide option to set query memory
as percent of total
[ https://issues.apache.org/jira/browse/DRILL-5815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Rogers resolved DRILL-5815.
--------------------------------
Resolution: Fixed
> Provide option to set query memory as percent of total
> ------------------------------------------------------
>
> Key: DRILL-5815
> URL: https://issues.apache.org/jira/browse/DRILL-5815
> Project: Apache Drill
> Issue Type: Improvement
> Affects Versions: 1.11.0
> Reporter: Paul Rogers
> Assignee: Paul Rogers
> Labels: doc-impacting, ready-to-commit
> Fix For: 1.12.0
>
>
> Drill provides a parameter to set the memory per query as a static number which defaults to 2 GB. This number is a wonderful setting for the default Drillbit configuration of 8 GB heap; it allows 2-3 concurrent queries. But, as Drillbit memory increases, the default becomes a bit constraining. While users can change the setting, they seldom do.
> In addition, provide an option that sets memory as a percent of total memory. If the allocation is 10%, say, and total memory is 128 GB, then each query gets ~13GB, which is a big improvement.
> The existing option acts as a floor: the query must receive at least that much memory.
> *DOCUMENTATION*
> New option should be documented - planner.memory.percent_per_query
> Default - 0.05 (which is equivalent to 5 %)
> To disable feature set to 0.
> More information can be found in pull request description.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)