You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Rahul Challapalli (JIRA)" <ji...@apache.org> on 2016/12/22 19:23:58 UTC
[jira] [Created] (DRILL-5154) OOM error in external sort on top of
400GB data set generated using terasort benchamark
Rahul Challapalli created DRILL-5154:
----------------------------------------
Summary: OOM error in external sort on top of 400GB data set generated using terasort benchamark
Key: DRILL-5154
URL: https://issues.apache.org/jira/browse/DRILL-5154
Project: Apache Drill
Issue Type: Bug
Components: Execution - Relational Operators
Affects Versions: 1.10.0
Reporter: Rahul Challapalli
git.commit.id.abbrev=cf2b7c7
The below query fails with an OOM in external sort
{code}
No of drillbits : 1
Nodes in Mapr cluster : 2
DRILL_MAX_DIRECT_MEMORY="16G"
DRILL_MAX_HEAP="4G"
select * from (select * from dfs.`/drill/testdata/resource-manager/terasort-data/part-m-00000.tbl` order by columns[0]) d where d.columns[0] = 'null';
Error: RESOURCE ERROR: One or more nodes ran out of memory while executing the query.
Unable to allocate buffer of size 8388608 due to memory limit. Current allocation: 8441872
Fragment 1:6
[Error Id: 87ede736-b480-4286-b472-7694fdd2f7da on qa-node183.qa.lab:31010] (state=,code=0)
{code}
I attached the logs and the query profile
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)