You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Alexander Koval (JIRA)" <ji...@apache.org> on 2018/03/01 11:08:00 UTC

[jira] [Resolved] (KAFKA-6396) Possibly kafka-connect converter should be able to stop processing chain

     [ https://issues.apache.org/jira/browse/KAFKA-6396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexander Koval resolved KAFKA-6396.
------------------------------------
    Resolution: Invalid

Thank you for the explanation.

> Possibly kafka-connect converter should be able to stop processing chain
> ------------------------------------------------------------------------
>
>                 Key: KAFKA-6396
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6396
>             Project: Kafka
>          Issue Type: Wish
>          Components: KafkaConnect
>    Affects Versions: 1.0.0
>            Reporter: Alexander Koval
>            Priority: Minor
>
> At present only transformations can discard records returning null. But I think sometimes it would be nice to discard processing chain after converting message. For example I have some tags shipped with a message key and I want to stop processing the message after converting its key (there are a lot of messages and I don't want to deserialize message values that I don't need).
> At the moment to do that I should disable converters and move message deserializing to the transformation chain:
> {code}
> key.converter=org.apache.kafka.connect.converters.ByteArrayConverter
> value.converter=org.apache.kafka.connect.converters.ByteArrayConverter
> transforms=proto,catalog
> transforms.proto.type=company.evo.kafka.ProtobufTransformation
> transforms.proto.key.protobuf.class=company.evo.uaprom.indexator.KeyProto$KeyMessage
> transforms.proto.value.protobuf.class=company.evo.uaprom.indexator.catalog.CompanyProto$UniversalCompanyMessage
> transforms.proto.tag=catalog
> {code}
> If [WorkerSinkTask|https://github.com/apache/kafka/blob/1.0.0/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/WorkerSinkTask.java#L453] checked converted values on {{null}} it would solved my problem more gracefully



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)