[jira] [Commented] (HADOOP-17532) Yarn Job execution get failed when LZ4 Compression Codec is used

["Bhavik Patel (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292920#comment-17292920 ] 

Bhavik Patel commented on HADOOP-17532:
---------------------------------------

is the issue here caused by the conflicting version from Kafka? ==> Yes, and provided scope is not related to this issue.

I thought that it will be good to provide the dependency rather than giving an option to the user(as the user has to find the required location).

 

If we want to keep the scope as provided then I will update the patch to exclude only the lz4 1.2.0 version from the Kafka client.

> Yarn Job execution get failed when LZ4 Compression Codec is used
> ----------------------------------------------------------------
>
>                 Key: HADOOP-17532
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17532
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Bhavik Patel
>            Priority: Major
>         Attachments: HADOOP-17532.001.patch, LZ4.png, lz4-test.jpg
>
>
> When we try to compress a file using the LZ4 codec compression type then the yarn job gets failed with the error message :
> {code:java}
> net.jpountz.lz4.LZ4Compressorcompres(Ljava/nio/ByteBuffer;Ljava/nio/ByteBuffer;)V
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org