You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "Padma Penumarthy (JIRA)" <ji...@apache.org> on 2018/01/31 00:20:00 UTC

[jira] [Created] (DRILL-6123) Limit batch size for Merge Join based on memory

Padma Penumarthy created DRILL-6123:
---------------------------------------

             Summary: Limit batch size for Merge Join based on memory
                 Key: DRILL-6123
                 URL: https://issues.apache.org/jira/browse/DRILL-6123
             Project: Apache Drill
          Issue Type: Improvement
          Components: Execution - Flow
    Affects Versions: 1.12.0
            Reporter: Padma Penumarthy
            Assignee: Padma Penumarthy
             Fix For: 1.13.0


Merge join limits output batch size to 32K rows irrespective of row size. This can create very large or very small batches (in terms of memory), depending upon average row width. Change this to figure out output row count based on memory specified with the new outputBatchSize option and average row width of incoming left and right batches. Output row count will be minimum of 1 and max of 64k. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)