You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 05:00:28 UTC
[I] Add protobuf deserializer for delta streamer [hudi]
hudi-bot opened a new issue, #15213:
URL: https://github.com/apache/hudi/issues/15213
currently hudi only support read json and avro messages from kafka. This ticket is to support delta streamer to read protobuf messages
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-4208
- Type: Task
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add protobuf deserializer for delta streamer [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #15213: Add protobuf deserializer for delta streamer
URL: https://github.com/apache/hudi/issues/15213
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add protobuf deserializer for delta streamer [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #15213:
URL: https://github.com/apache/hudi/issues/15213#issuecomment-4795335383
This appears to already be implemented on master. Protobuf support for the delta streamer (HoodieStreamer) was added under [HUDI-4418](https://issues.apache.org/jira/browse/HUDI-4418) in commit `f5de4e434b33` (PR #6135), which introduced:
- `org.apache.hudi.utilities.sources.ProtoKafkaSource` — Kafka source that deserializes protobuf messages (supports both `KafkaProtobufDeserializer` for Confluent schema-registry payloads and `ByteArrayDeserializer` for class-based deserialization).
- `org.apache.hudi.utilities.schema.ProtoClassBasedSchemaProvider` — schema provider driven by `hoodie.streamer.schemaprovider.proto.class.name`.
- `org.apache.hudi.utilities.sources.helpers.ProtoConversionUtil` — proto-to-Avro conversion.
Confluent schema-registry proto support was subsequently added in [HUDI-4732](https://issues.apache.org/jira/browse/HUDI-4732) (PR #11070). Closing as resolved — please reopen with a concrete gap if something is still missing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org