You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "Padma Penumarthy (JIRA)" <ji...@apache.org> on 2018/02/15 02:44:00 UTC

[jira] [Created] (DRILL-6160) Limit batch size for streaming aggregate based on memory

Padma Penumarthy created DRILL-6160:
---------------------------------------

             Summary: Limit batch size for streaming aggregate based on memory
                 Key: DRILL-6160
                 URL: https://issues.apache.org/jira/browse/DRILL-6160
             Project: Apache Drill
          Issue Type: Improvement
          Components: Execution - Flow
    Affects Versions: 1.12.0
            Reporter: Padma Penumarthy
            Assignee: Padma Penumarthy
             Fix For: 1.13.0


Streaming aggregate has batch size of 32k rows. Change it to figure out number of rows in the outgoing batch based on memory configured with the option outputBatchSize and actual incoming batch size. Limit it to max of 64k and min of 1. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)