[jira] [Commented] (DRILL-5940) Avro with schema registry support for Kafka

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-5940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17352092#comment-17352092 ] 

ASF GitHub Bot commented on DRILL-5940:
---------------------------------------

vvysotskyi opened a new pull request #2239:
URL: https://github.com/apache/drill/pull/2239


   # [DRILL-5940](https://issues.apache.org/jira/browse/DRILL-5940): Add support for Avro messages with schema registry for Kafka
   
   ## Description
   - Refactored `KafkaRecordReader` to use EVF.
   - Updated `JsonMessageReader` to use V2 JSON reader
   - Added `AvroMessageReader` for processing messages serialized as Avro records and added schema registry support.
   
   To be able to deserialize Kafka messages of Avro type, schema registry URL should be specified in the Kafka storage plugin `kafkaConsumerProps` (and other schema registry options if required):
   ``` 
   "schema.registry.url": "http://localhost:8081"
   ```
   After that, `store.kafka.record.reader` session option should be set to `org.apache.drill.exec.store.kafka.decoders.AvroMessageReader`.
   
   ## Documentation
   NA
   
   ## Testing
   Added UT that reads Avro messages.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Avro with schema registry support for Kafka
> -------------------------------------------
>
>                 Key: DRILL-5940
>                 URL: https://issues.apache.org/jira/browse/DRILL-5940
>             Project: Apache Drill
>          Issue Type: New Feature
>          Components: Storage - Avro, Storage - Kafka
>            Reporter: AnilKumar B
>            Assignee: Vova Vysotskyi
>            Priority: Major
>
> Support Avro messages with Schema registry for Kafka storage plugin



--
This message was sent by Atlassian Jira
(v8.3.4#803005)