You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Ben Becker (JIRA)" <ji...@apache.org> on 2013/11/08 22:06:17 UTC

[jira] [Created] (DRILL-285) Some operators fail to process all records

Ben Becker created DRILL-285:
--------------------------------

             Summary: Some operators fail to process all records
                 Key: DRILL-285
                 URL: https://issues.apache.org/jira/browse/DRILL-285
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Ben Becker


The test below shows that the Filter operator cannot process more than  more than 15625 records from the mock scanner.  The issue may affect multiple operators and scanners.

h4. Steps to reproduce:
# Edit {{filter/test1.json}} and increase the record count to some number above 15625 (e.g. 20k).
# Update the assertion in TestSimpleFilter.testFilter().
# Run TestSimpleFilter.testFilter().

h4. Expected Results:
The test would return 1/2 the record count.

h4. Results:
FilterRecordBatch.doWork() gets a value of 15625 from incoming.getRecordCount().  Only one batch is processed, and never more than 15625 records.  The same holds true when the mock reader generates multiple batches.





--
This message was sent by Atlassian JIRA
(v6.1#6144)