You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Randall Hauch (Jira)" <ji...@apache.org> on 2019/10/03 19:25:00 UTC
[jira] [Resolved] (KAFKA-8523) InsertField transformation fails
when encountering tombstone event
[ https://issues.apache.org/jira/browse/KAFKA-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Randall Hauch resolved KAFKA-8523.
----------------------------------
Fix Version/s: 2.3.1
2.4.0
2.2.2
2.1.2
2.0.2
1.1.2
1.0.3
Reviewer: Randall Hauch
Resolution: Fixed
> InsertField transformation fails when encountering tombstone event
> ------------------------------------------------------------------
>
> Key: KAFKA-8523
> URL: https://issues.apache.org/jira/browse/KAFKA-8523
> Project: Kafka
> Issue Type: Bug
> Components: KafkaConnect
> Reporter: Gunnar Morling
> Priority: Major
> Fix For: 1.0.3, 1.1.2, 2.0.2, 2.1.2, 2.2.2, 2.4.0, 2.3.1
>
> Attachments: image-2019-09-17-15-53-44-038.png
>
>
> When applying the {{InsertField}} transformation to a tombstone event, an exception is raised:
> {code}
> org.apache.kafka.connect.errors.DataException: Only Map objects supported in absence of schema for [field insertion], found: null
> at org.apache.kafka.connect.transforms.util.Requirements.requireMap(Requirements.java:38)
> at org.apache.kafka.connect.transforms.InsertField.applySchemaless(InsertField.java:138)
> at org.apache.kafka.connect.transforms.InsertField.apply(InsertField.java:131)
> at org.apache.kafka.connect.transforms.InsertFieldTest.tombstone(InsertFieldTest.java:128)
> {code}
> -AFAICS, the transform can still be made working in in this case by simply building up a new value map from scratch.-
> Update as per the discussion in the comments: tombstones should be left as-is by this SMT, as any insertion would defeat their purpose of enabling log compaction.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)