You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/04/16 08:47:00 UTC
[jira] [Updated] (SPARK-51817) [CONNECT][SCALA] Removing ansiConfig parameter in error-class causes client to be incompatible
[ https://issues.apache.org/jira/browse/SPARK-51817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated SPARK-51817:
-----------------------------------
Labels: pull-request-available (was: )
> [CONNECT][SCALA] Removing ansiConfig parameter in error-class causes client to be incompatible
> ----------------------------------------------------------------------------------------------
>
> Key: SPARK-51817
> URL: https://issues.apache.org/jira/browse/SPARK-51817
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: 4.0.0
> Reporter: Niranjan Jayakar
> Priority: Major
> Labels: pull-request-available
>
> In Spark Connect, we guarantee that older clients are compatible with newer versions of the Spark Connect service.
>
> A previous change[1] broke this compatibility by removing the "ansiConfig" field in the message parameters for two error codes - "CAST_OVERFLOW" and "CAST_INVALID_INPUT".
> The Spark Connect client includes GrpcExceptionConverter.scala[2] to convert error codes from the server to produce SQL compliant error codes on the client. This uses the error-conditions.json file. Older clients do not include the change[1] to this file and still include the `ansiConfig` parameter. Later versions of the Spark Connect service don't return this parameter resulting in an internal error[3] that the correct error condition could not be formulated.
>
> [1]: [https://github.com/apache/spark/commit/e28c33bcf784b8a5b7cf29c2527ce78e4a3ada0f|https://github.com/apache/spark/commit/e28c33bcf784b8a5b7cf29c2527ce78e4a3ada0f#diff-34e280062b2b58a677fe8fae16f67bfff596e80f59f61aeea6743dd9903eb7f0]
> [2]: [https://github.com/apache/spark/blob/2ba156096e83adf7b0b2f5c38453d6fd37d95ded/sql/connect/common/src/main/scala/org/apache/spark/sql/connect/client/GrpcExceptionConverter.scala#L184]
> [3]: https://github.com/apache/spark/blob/2ba156096e83adf7b0b2f5c38453d6fd37d95ded/common/utils/src/main/scala/org/apache/spark/ErrorClassesJSONReader.scala#L58
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org