You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Mohan Parthasarathy (Jira)" <ji...@apache.org> on 2022/10/06 22:51:00 UTC

[jira] [Commented] (SPARK-40658) Protobuf v2 & v3 support

    [ https://issues.apache.org/jira/browse/SPARK-40658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613806#comment-17613806 ] 

Mohan Parthasarathy commented on SPARK-40658:
---------------------------------------------

Looking at the changes between proto2 and proto3 here: [https://cloud.google.com/apis/design/proto3]
 * Extensions and Group Syntax won't work from proto2
 * When serializing, should we treat Optional fields any differently ? 

Apart from that we don't support Any or OneOf as mentioned in the original PR description. 

[~rangadi] , [~sanysandish@gmail.com] do you see anything else ?

> Protobuf v2 & v3 support
> ------------------------
>
>                 Key: SPARK-40658
>                 URL: https://issues.apache.org/jira/browse/SPARK-40658
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.3.0
>            Reporter: Raghu Angadi
>            Priority: Major
>
> We want to ensure Protobuf functions support both Protobuf version 2 and version 3 schemas (e.g. descriptor file or compiled classes with v2 and v3).
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org