You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "salim achouche (JIRA)" <ji...@apache.org> on 2018/08/03 20:14:00 UTC

[jira] [Created] (DRILL-6664) Parquet reader should not allow batches with more than 64k rows

salim achouche created DRILL-6664:
-------------------------------------

             Summary: Parquet reader should not allow batches with more than 64k rows
                 Key: DRILL-6664
                 URL: https://issues.apache.org/jira/browse/DRILL-6664
             Project: Apache Drill
          Issue Type: Improvement
            Reporter: salim achouche
            Assignee: salim achouche


The Drill configuration allows the Parquet reader to handle batches larger than 64. We should limit this setting to 64k as several operators assume a maximum batch size of 64k.

NOTE - This Jira is precautionary as the default is 32k rows maximum



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)