[jira] [Commented] (ARROW-11901) [Java] Investigate potential performance improvement of compression codec

["Benjamin Wilhelm (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-11901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17303953#comment-17303953 ] 

Benjamin Wilhelm commented on ARROW-11901:
------------------------------------------

Note that there is a discussion about the LZ4 library selection on the mailing list:

https://lists.apache.org/thread.html/reb8ae01ad544072ce1dd77feea640aab2e9834f55ccee04292e9da42%40%3Cdev.arrow.apache.org%3E

> [Java] Investigate potential performance improvement of compression codec
> -------------------------------------------------------------------------
>
>                 Key: ARROW-11901
>                 URL: https://issues.apache.org/jira/browse/ARROW-11901
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Java
>            Reporter: Liya Fan
>            Assignee: Liya Fan
>            Priority: Major
>
> In response to the discussion in https://github.com/apache/arrow/pull/8949/files#r588046787
> There are some performance penalties in the implementation of the compression codecs (e.g. data copying between heap/off-heap data). We need to revise the code to improve the performance. 
> We should also provide some benchmarks to validate that the performance actually improves. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)