You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Ji Liu (JIRA)" <ji...@apache.org> on 2019/08/13 03:55:00 UTC
[jira] [Commented] (ARROW-6219) [Java] Add API for JDBC adapter
that can convert less then the full result set at a time.
[ https://issues.apache.org/jira/browse/ARROW-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905788#comment-16905788 ]
Ji Liu commented on ARROW-6219:
-------------------------------
This is what I actually want to do in jdbc and avro adapter, I will take this if you don't mind.
> [Java] Add API for JDBC adapter that can convert less then the full result set at a time.
> -----------------------------------------------------------------------------------------
>
> Key: ARROW-6219
> URL: https://issues.apache.org/jira/browse/ARROW-6219
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Java
> Reporter: Micah Kornfield
> Assignee: Ji Liu
> Priority: Major
>
> Somehow we should configure number of rows per batch and either let clients iterate or provide an iterator API. Otherwise for large result sets we might run out of memory.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)