You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dale Lane (Jira)" <ji...@apache.org> on 2023/09/07 09:43:00 UTC
[jira] [Updated] (FLINK-33058) Support for JSON-encoded Avro
[ https://issues.apache.org/jira/browse/FLINK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dale Lane updated FLINK-33058:
------------------------------
Description:
Avro supports two serialization encoding methods: binary and JSON
cf. [https://avro.apache.org/docs/1.11.1/specification/#encodings]
flink-avro currently has a hard-coded assumption that Avro data is binary-encoded (and cannot process Avro data that has been JSON-encoded).
I propose adding a new optional format option to flink-avro: *avro.encoding*
It will support two options: 'binary' and 'json'.
It unset, it will default to 'binary' to maintain compatibility/consistency with current behaviour.
was:
Avro supports two encoding methods: binary and JSON
cf. [https://avro.apache.org/docs/1.11.1/specification/#encodings]
flink-avro currently has a hard-coded assumption that Avro data is binary-encoded (and cannot process Avro data that has been JSON-encoded).
I propose adding a new optional format option to flink-avro: *avro.encoding*
It will support two options: 'binary' and 'json'.
It unset, it will default to 'binary' to maintain compatibility/consistency with current behaviour.
> Support for JSON-encoded Avro
> -----------------------------
>
> Key: FLINK-33058
> URL: https://issues.apache.org/jira/browse/FLINK-33058
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Reporter: Dale Lane
> Priority: Minor
> Labels: avro, flink, flink-formats
>
> Avro supports two serialization encoding methods: binary and JSON
> cf. [https://avro.apache.org/docs/1.11.1/specification/#encodings]
> flink-avro currently has a hard-coded assumption that Avro data is binary-encoded (and cannot process Avro data that has been JSON-encoded).
> I propose adding a new optional format option to flink-avro: *avro.encoding*
> It will support two options: 'binary' and 'json'.
> It unset, it will default to 'binary' to maintain compatibility/consistency with current behaviour.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)