You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ismaël Mejía (Jira)" <ji...@apache.org> on 2026/08/09 11:15:00 UTC
[jira] [Created] (SPARK-58673) Upgrade Avro to 1.12.2
Ismaël Mejía created SPARK-58673:
------------------------------------
Summary: Upgrade Avro to 1.12.2
Key: SPARK-58673
URL: https://issues.apache.org/jira/browse/SPARK-58673
Project: Spark
Issue Type: Dependency upgrade
Components: Build
Affects Versions: 5.0.0
Reporter: Ismaël Mejía
Upgrade the Avro dependency from 1.12.1 to 1.12.2.
Notable changes required by the upgrade:
- Avro 1.12.2 enforces a ClassSecurityValidator / SERIALIZABLE_PACKAGES
restriction when deserializing schemas. Spark tests that ship reader
schemas to executors need "org.apache.spark" allowlisted via
org.apache.avro.SERIALIZABLE_PACKAGES.
- AVRO-4257 changes Schema.readResolve() to use the non-validating internal
parser (JsonSchemaParser.parseInternal). As a result, a reader schema that
carries invalid but unused default values is no longer re-validated after
crossing the driver/executor boundary, so reads succeed end to end. This is
consistent with the goal of SPARK-39775; the corresponding test is updated
to assert the read returns the expected rows instead of failing.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org