You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Tianyu Lang (Jira)" <ji...@apache.org> on 2020/03/31 22:06:00 UTC
[jira] [Created] (AVRO-2788) Generated Avro schema from Protobuf is
missing default values for repeated fields
Tianyu Lang created AVRO-2788:
---------------------------------
Summary: Generated Avro schema from Protobuf is missing default values for repeated fields
Key: AVRO-2788
URL: https://issues.apache.org/jira/browse/AVRO-2788
Project: Apache Avro
Issue Type: Improvement
Components: java
Affects Versions: 1.9.2
Reporter: Tianyu Lang
Avro schemas generated from Protobuf schemas by *ProtobufData.java* are missing default values for repeated (array) fields.
This will break compatibility when Avro is used as a transport format between 2 services that use Protobuf internally.
For example:
A publisher converts Protobuf to Avro, then sends the message through Kafka to a consumer. The consumer then converts Avro back into Protobuf, then does all the processing with Protobuf.
A compatibility issue will occur when a new repeated Protobuf field is added to the consumer Protobuf schema. The corresponding Avro schema generated from
{code:java}
Schema schema = ProtobufData.get().getSchema(MyProtobufClass.class);
{code}
will not assign default values to the newly added repeated field. Because the publisher is still on the schema without the newly added array field, deserialization on the consumer side will fail since there is no default values to fill in.
I discussed this with [~cutting] on the mailing list and it makes sense to just add default values for Protobuf repeated fields.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)