You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "zhijiang (Jira)" <ji...@apache.org> on 2019/12/19 07:06:00 UTC

[jira] [Assigned] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

     [ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

zhijiang reassigned FLINK-15311:
--------------------------------

    Assignee: Yingjie Cao

> Lz4BlockCompressionFactory should use native compressor instead of java unsafe
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-15311
>                 URL: https://issues.apache.org/jira/browse/FLINK-15311
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Network
>            Reporter: Jingsong Lee
>            Assignee: Yingjie Cao
>            Priority: Critical
>             Fix For: 1.10.0
>
>
> According to:
> [https://lz4.github.io/lz4-java/1.7.0/lz4-compression-benchmark/]
> Java java unsafe compressor has lower performance than native lz4 compressor.
> After FLINK-14845 , we use lz4 compression for shuffler.
> In testing, I found shuffle using java unsafe compressor.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)