You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2021/06/01 19:08:00 UTC
[jira] [Commented] (ARROW-12920) [C++] Fix issues with enumerated
generator's last=true approach
[ https://issues.apache.org/jira/browse/ARROW-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355299#comment-17355299 ]
Weston Pace commented on ARROW-12920:
-------------------------------------
Related Zulip discussion: https://ursalabs.zulipchat.com/#narrow/stream/180245-dev/topic/IterationTraits.3A.3AIsEnd.28.29
> [C++] Fix issues with enumerated generator's last=true approach
> ---------------------------------------------------------------
>
> Key: ARROW-12920
> URL: https://issues.apache.org/jira/browse/ARROW-12920
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Weston Pace
> Priority: Major
>
> The current approach has two problems. First, it forces the stream to buffer one which breaks cache coherency. Second, it breaks the scanner as it is today. An empty file would emit zero batches and the resequencer would see it as a skip in the fragment index and fail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)