[jira] [Updated] (DRILL-285) Some operators fail to process all records

["Jacques Nadeau (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/DRILL-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacques Nadeau updated DRILL-285:
---------------------------------

    Attachment: big_filter.patch

> Some operators fail to process all records
> ------------------------------------------
>
>                 Key: DRILL-285
>                 URL: https://issues.apache.org/jira/browse/DRILL-285
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Ben Becker
>            Assignee: Jacques Nadeau
>         Attachments: big_filter.patch
>
>
> The test below shows that the Filter operator cannot process more than  more than 15625 records from the mock scanner.  The issue may affect multiple operators and scanners.
> h4. Steps to reproduce:
> # Edit {{filter/test1.json}} and increase the record count to some number above 15625 (e.g. 20k).
> # Update the assertion in TestSimpleFilter.testFilter().
> # Run TestSimpleFilter.testFilter().
> h4. Expected Results:
> The test would return 1/2 the record count.
> h4. Results:
> FilterRecordBatch.doWork() gets a value of 15625 from incoming.getRecordCount().  Only one batch is processed, and never more than 15625 records.  The same holds true when the mock reader generates multiple batches.



--
This message was sent by Atlassian JIRA
(v6.1#6144)