You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2021/06/01 19:07:00 UTC

[jira] [Created] (ARROW-12920) [C++] Fix issues with enumerated generator's last=true approach

Weston Pace created ARROW-12920:
-----------------------------------

             Summary: [C++] Fix issues with enumerated generator's last=true approach
                 Key: ARROW-12920
                 URL: https://issues.apache.org/jira/browse/ARROW-12920
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


The current approach has two problems.  First, it forces the stream to buffer one which breaks cache coherency.  Second, it breaks the scanner as it is today.  An empty file would emit zero batches and the resequencer would see it as a skip in the fragment index and fail.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)