You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/06/26 19:55:00 UTC
[jira] [Commented] (ARROW-5744) [C++] Do not error in
Table::CombineChunks for BinaryArray types that overflow 2GB limit
[ https://issues.apache.org/jira/browse/ARROW-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16873630#comment-16873630 ]
Wes McKinney commented on ARROW-5744:
-------------------------------------
Ah, it wasn't obvious from reading the source code, I found it now.
I updated the JIRA title. The behavior should be to eagerly concatenate chunks to produce as large chunks as possible. So if you have 10GB of total data you might end up with 5 or so concatenated chunks.
I'm moving this out of 0.14.0 since it's not urgent
> [C++] Do not error in Table::CombineChunks for BinaryArray types that overflow 2GB limit
> ----------------------------------------------------------------------------------------
>
> Key: ARROW-5744
> URL: https://issues.apache.org/jira/browse/ARROW-5744
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Wes McKinney
> Assignee: Benjamin Kietzman
> Priority: Critical
> Fix For: 0.14.0
>
>
> Discovered during ARROW-5635 code review
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)