You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Ji Liu (Jira)" <ji...@apache.org> on 2019/09/23 07:59:00 UTC

[jira] [Commented] (ARROW-6601) [Java] Improve JDBC adapter performance & add benchmark

    [ https://issues.apache.org/jira/browse/ARROW-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935613#comment-16935613 ] 

Ji Liu commented on ARROW-6601:
-------------------------------

When working with Jdbc adapter benchmark, I found the jmh result is very worse (about 1680000 ns/op), and I finally found that when we initialize a VectorSchemaRoot, when call JdbcToArrowUtils#allocateVectors which is time consuming, and this is not necessary since we use setSafe API in consumers. After remove this, the jmh result is about 2000ns/op (3 coulumns with valueCount = 3000).

I think this one should merged into 0.15 release.

> [Java] Improve JDBC adapter performance & add benchmark
> -------------------------------------------------------
>
>                 Key: ARROW-6601
>                 URL: https://issues.apache.org/jira/browse/ARROW-6601
>             Project: Apache Arrow
>          Issue Type: Task
>          Components: Java
>            Reporter: Ji Liu
>            Assignee: Ji Liu
>            Priority: Critical
>
> Add a performance test as well to get a baseline number, to avoid performance regression when we change related code.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)