[jira] [Created] (DRILL-1960) Automatically realloc buffers when vector runs out of space

["Steven Phillips (JIRA)" <ji...@apache.org>]

Steven Phillips created DRILL-1960:
--------------------------------------

             Summary: Automatically realloc buffers when vector runs out of space
                 Key: DRILL-1960
                 URL: https://issues.apache.org/jira/browse/DRILL-1960
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Steven Phillips


When reaching the end of a buffer, the current way drill handles this is for setSafe() to return false, and then whatever operator is doing the write will send the batch, and the redo the last record. This creates a lot of difficulty, because it sometimes requires being able to "rewind" the input stream to replay the last record.

The proposal is to move the handling of buffer sizing and allocation into the value vectors themselves, making it transparent to the user of the value vector. The operators will now no longer have to worry about the possibility that writing into a vector may fail due to lack of space.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)