You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "salim achouche (JIRA)" <ji...@apache.org> on 2018/06/22 18:10:00 UTC

[jira] [Created] (DRILL-6528) Planner setting the wrong number of records to read (Parquet Reader)

salim achouche created DRILL-6528:
-------------------------------------

             Summary: Planner setting the wrong number of records to read (Parquet Reader)
                 Key: DRILL-6528
                 URL: https://issues.apache.org/jira/browse/DRILL-6528
             Project: Apache Drill
          Issue Type: Bug
          Components: Query Planning &amp; Optimization
            Reporter: salim achouche


- Recently fixed the Flat Parquet reader to honor the number of records to read
 - Though few tests failed:
TestUnionDistinct.testUnionDistinctEmptySides:356 Different number of records returned expected:<5> but was:<1>
TestUnionAll.testUnionAllEmptySides:355 Different number of records returned expected:<5> but was:<1>

 - I debugged one of them and realized the Planner was setting the wrong number of rows to read (in this case, one)
 - You can put a break point and see this happening:
Class: ParquetGroupScan
Method: updateRowGroupInfo(long maxRecords)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)