You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Jinfeng Ni (JIRA)" <ji...@apache.org> on 2015/09/11 03:17:45 UTC
[jira] [Created] (DRILL-3765) Partition prune rule is unnecessary
fired multiple times.
Jinfeng Ni created DRILL-3765:
---------------------------------
Summary: Partition prune rule is unnecessary fired multiple times.
Key: DRILL-3765
URL: https://issues.apache.org/jira/browse/DRILL-3765
Project: Apache Drill
Issue Type: Bug
Components: Query Planning & Optimization
Reporter: Jinfeng Ni
Assignee: Jinfeng Ni
It seems that the partition prune rule may be fired multiple times, even after the first rule execution has pushed the filter into the scan operator. Since partition prune has to build the vectors to contain the partition /file / directory information, to invoke the partition prune rule unnecessary may lead to big memory overhead.
Drill planner should avoid the un-necessary partition prune rule, in order to reduce the chance of hitting OOM exception, while the partition prune rule is executed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)