Re: [I] Add support for reading Protobuf data from Kafka [hudi]

["nsivabalan (via GitHub)" <gi...@apache.org>]

nsivabalan commented on issue #15278:
URL: https://github.com/apache/hudi/issues/15278#issuecomment-4795346141

   This appears to already be supported on `master`. Reading Protobuf data from Kafka in the streamer (formerly DeltaStreamer) was added in 2022 via [HUDI-4418](https://issues.apache.org/jira/browse/HUDI-4418) (commit f5de4e434b3, PR #6135):
   
   - `org.apache.hudi.utilities.sources.ProtoKafkaSource` — Kafka source that reads Protobuf `Message` records.
   - `org.apache.hudi.utilities.schema.ProtoClassBasedSchemaProvider` — derives the Avro schema from a Protobuf class on the classpath (`hoodie.streamer.schemaprovider.proto.class.name`).
   - `org.apache.hudi.utilities.sources.helpers.ProtoConversionUtil` — Proto → Avro → Row conversion.
   
   Confluent Schema Registry support for Protobuf was added later via [HUDI-4732](https://issues.apache.org/jira/browse/HUDI-4732) in `SchemaRegistryProvider`, so both schema sources requested here (class/file and schema registry) work today.
   
   Closing as already-implemented — please reopen if a specific gap remains (e.g., a particular registry mode or schema-evolution case).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org