[jira] [Closed] (DRILL-6076) Reduce the default memory from a total of 13GB to 5GB

["James Turton (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/DRILL-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Turton closed DRILL-6076.
-------------------------------
    Fix Version/s: 2.0.0
                       (was: Future)
         Assignee: James Turton  (was: Kunal Khatua)
       Resolution: Later

I propose that we return to this after Drill 2.0 and the probable ValueVector overhaul.

> Reduce the default memory from a total of 13GB to 5GB
> -----------------------------------------------------
>
>                 Key: DRILL-6076
>                 URL: https://issues.apache.org/jira/browse/DRILL-6076
>             Project: Apache Drill
>          Issue Type: Task
>            Reporter: Kunal Khatua
>            Assignee: James Turton
>            Priority: Critical
>             Fix For: 2.0.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Currently, the default memory requirements for Drill are about 13GB, with the following allocations:
> * 4GB Heap
> * 8GB Direct Memory
> * 1GB CodeCache
> * 512MB MaxPermSize
> Also, with Drill 1.12.0, the recommendation is to move to JDK8, which makes the MaxPermSize as irrelevant.
> With that, the default requirements total to 13GB, which is rather high. This is especially a problem for scenarios where people are trying out Drill and might be using this in a development environment where 13GB is too high.
> When using the public [test framework|https://github.com/mapr/drill-test-framework/] for Apache Drill, it was observed that the framework's functional and unit tests passed successfully with memory as little as 5GB; based on the following allocation:
> * 1GB Heap
> * 3GB Direct Memory
> * 512MB CodeCache
> * 512MB MaxPermSize
> Based on this finding, the proposal is to reduce the defaults from the current settings to the values just mentioned above. The drill-env.sh file already has details in the comments, along with the recommended values that reflect the original 13GB defaults.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)