You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jjbskir (via GitHub)" <gi...@apache.org> on 2023/08/01 15:41:59 UTC

[GitHub] [arrow] jjbskir commented on issue #34046: [Java] BaseVariableWidthVector only supports 1 GiB through safe interfaces

jjbskir commented on issue #34046:
URL: https://github.com/apache/arrow/issues/34046#issuecomment-1660582514

   Hey! I ran into the same issue recently. I wanted to see if there was any progress to support variables between 1GB to 2GB? Or any supported work arounds? 
   
   Happy to open a PR to support this. I think an solution would to add an additional check in [reallocDataBuffer](https://github.com/apache/arrow/blob/main/java/vector/src/main/java/org/apache/arrow/vector/BaseVariableWidthVector.java#L539 ) if the `desiredAllocSize` is greater then 1GB, but less then 2GB to just set the `newAllocationSize` to the max value.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org