[jira] [Resolved] (KAFKA-9326) Kafka Connect JSON Converter results in data loss when additional fields apart from provided JSON schema is present in the payload

["rameshkrishnan muthusamy (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

rameshkrishnan muthusamy resolved KAFKA-9326.
---------------------------------------------
    Resolution: Invalid

> Kafka Connect JSON Converter results in data loss when additional fields apart from provided JSON schema is present in the payload
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-9326
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9326
>             Project: Kafka
>          Issue Type: Bug
>          Components: KafkaConnect
>    Affects Versions: 3.0.0, 2.3.0, 2.2.1, 2.3.1
>            Reporter: rameshkrishnan muthusamy
>            Priority: Major
>              Labels: kafka-connect
>
> JSON Convertor in Kafka Connect validates the payload against the schema provided by the user. In case there is an additional field in the payload which is not mentioned in the schema the JSON convertor does not fail and returns the value without the additional column. 
> e.g) message has additional column "new_col"
> {
>  "schema": {
>  "type": "struct",
>  "fields": [
>  {
>  "type": "string",
>  "optional": true,
>  "field": "type"
>  },
>  {
>  "type": "string",
>  "optional": false,
>  "field": "data"
>  }
>  ],
>  "optional": false,
>  "name": "test"
>  },
>  "payload": {
>  "type": "testpayload",
>  "data": "test_data",
>  "new_col": 1
>  }
> }
> The output of JSON convertor "Struct\{type=testpayload,data=test_data}" should ideally fail assuming fail fast rather than skipping the field in the output payload. 
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)