[jira] [Created] (DRILL-5154) OOM error in external sort on top of 400GB data set generated using terasort benchamark

["Rahul Challapalli (JIRA)" <ji...@apache.org>]

Rahul Challapalli created DRILL-5154:
----------------------------------------

             Summary: OOM error in external sort on top of 400GB data set generated using terasort benchamark
                 Key: DRILL-5154
                 URL: https://issues.apache.org/jira/browse/DRILL-5154
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Relational Operators
    Affects Versions: 1.10.0
            Reporter: Rahul Challapalli


git.commit.id.abbrev=cf2b7c7

The below query fails with an OOM in external sort
{code}
No of drillbits : 1
Nodes in Mapr cluster : 2
DRILL_MAX_DIRECT_MEMORY="16G"
DRILL_MAX_HEAP="4G"
select * from (select * from dfs.`/drill/testdata/resource-manager/terasort-data/part-m-00000.tbl` order by columns[0]) d where d.columns[0] = 'null';
Error: RESOURCE ERROR: One or more nodes ran out of memory while executing the query.

Unable to allocate buffer of size 8388608 due to memory limit. Current allocation: 8441872
Fragment 1:6

[Error Id: 87ede736-b480-4286-b472-7694fdd2f7da on qa-node183.qa.lab:31010] (state=,code=0)
{code}

I attached the logs and the query profile



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)