You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Evgeny (JIRA)" <ji...@apache.org> on 2019/05/14 13:32:00 UTC

[jira] [Comment Edited] (BEAM-7299) Upgrade kafka client for KafkaIO to support new compression zstd

    [ https://issues.apache.org/jira/browse/BEAM-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839411#comment-16839411 ] 

Evgeny edited comment on BEAM-7299 at 5/14/19 1:31 PM:
-------------------------------------------------------

If I pass  kafka-clients version 2.1.1 , it stuck on infinite loop of resetting offset.

And If I use 1.0.0 and change the producer compression type to gzip, it works.

Looks like issue with beam & kafka-clients 2.1.1


was (Author: varelasavela):
If I pass  kafka-clients version 2.1.1 , it stuck on infinite loop of resetting offset

> Upgrade kafka client for KafkaIO to support new compression zstd
> ----------------------------------------------------------------
>
>                 Key: BEAM-7299
>                 URL: https://issues.apache.org/jira/browse/BEAM-7299
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-kafka
>    Affects Versions: 2.12.0
>            Reporter: Evgeny
>            Priority: Major
>
> Current io-java-kafka dependency contains kafka-clients 1.0.0 which does not support new compression type of Kafka 2.1.1 "zstd".



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)