You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "Sorabh Hamirwasia (JIRA)" <ji...@apache.org> on 2018/08/09 22:26:00 UTC

[jira] [Created] (DRILL-6678) Improve SelectionVectorRemover to pack output batch based on BatchSizing

Sorabh Hamirwasia created DRILL-6678:
----------------------------------------

             Summary: Improve SelectionVectorRemover to pack output batch based on BatchSizing
                 Key: DRILL-6678
                 URL: https://issues.apache.org/jira/browse/DRILL-6678
             Project: Apache Drill
          Issue Type: Improvement
          Components: Execution - Relational Operators
    Affects Versions: 1.14.0
            Reporter: Sorabh Hamirwasia
            Assignee: Sorabh Hamirwasia


SelectionVectorRemover in most of the cases is downstream to Filter which reduces the number of records to be copied in output container. In those cases if SelectionVectorRemover can pack the output batch to maximum utilization that will reduce the number of output batches from it and will help to improve performance. During Lateral & Unnest  Performance evaluation we have noticed a significant decrease in performance as number of batches increases for same number of rows (i.e. Batch is not fully packed)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)