[jira] [Updated] (DRILL-5505) Enabling exchanges increased the external sorts spill count by 2 times

["Rahul Challapalli (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/DRILL-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rahul Challapalli updated DRILL-5505:
-------------------------------------
    Attachment: exch_enabled.sys.drill
                exch_disabled.sys.drill
                drillbit.log

> Enabling exchanges increased the external sorts spill count by 2 times
> ----------------------------------------------------------------------
>
>                 Key: DRILL-5505
>                 URL: https://issues.apache.org/jira/browse/DRILL-5505
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.10.0
>            Reporter: Rahul Challapalli
>            Assignee: Paul Rogers
>         Attachments: drillbit.log, exch_disabled.sys.drill, exch_enabled.sys.drill
>
>
> git.commit.id.abbrev=1e0a14c
> Based on the profile, the below query spilled 32 times
> {code}
> ALTER SESSION SET `exec.sort.disable_managed` = false;
> alter session set `planner.width.max_per_node` = 1;
> alter session set `planner.width.max_per_node` = 1;
> alter session set `planner.disable_exchanges` = true;
> alter session set `planner.memory.max_query_memory_per_node` = 62914560;
> select count(*) from (select * from dfs.`/drill/testdata/resource-manager/250wide-small.tbl` order by columns[0])d where d.columns[0] = 'ljdfhwuehnoiueyf';
> {code}
> Now if I enabled the exchanges, rest all being same, the same query spilled 66 times. I attached the 2 profiles and the log file.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)