You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/12/19 17:41:41 UTC

[GitHub] [arrow] kflansburg edited a comment on pull request #8968: ARROW-10979: [Rust] Basic Kafka Reader

kflansburg edited a comment on pull request #8968:
URL: https://github.com/apache/arrow/pull/8968#issuecomment-748502960


   > I'd be interested in seeing how we could go about with implementing this.
   
   Giving this some thought, I think we can have configuration fields that indicate the keys and/or payloads should be parsed as Raw Bytes, JSON, Arrow Flight, Avro, etc. The stretch goal here could be support for integration with a schema registry, but I haven't worked much with that. 
   
   The only concern I have is with inconsistent schemas between messages in the same `RecordBatch`, there may be some merging needed. 
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org