You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/03/17 04:54:00 UTC
[jira] [Created] (SPARK-34769) AnsiTypeCoercion: return narrowest
convertible type among TypeCollection
Gengliang Wang created SPARK-34769:
--------------------------------------
Summary: AnsiTypeCoercion: return narrowest convertible type among TypeCollection
Key: SPARK-34769
URL: https://issues.apache.org/jira/browse/SPARK-34769
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 3.2.0
Reporter: Gengliang Wang
Assignee: Gengliang Wang
Currently, when implicit casting a data type to a `TypeCollection`, Spark returns the first convertible data type among `TypeCollection`.
In ANSI mode, we can make the behavior more reasonable by returning the narrowest convertible data type in `TypeCollection`.
In details, we first try to find the all the expected types we can implicitly cast:
1. if there is no convertible data types, return None;
2. if there is only one convertible data type, cast input as it;
3. otherwise if there are multiple convertible data types, find the narrowest common data
type among them. If there is no such narrowest common data type, return None.
Note that if the narrowest common type is Float type and the convertible types contains Double ype, simply return Double type as the narrowest common type to avoid potential
precision loss on converting the Integral type as Float type.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org