You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yuanjian Li (Jira)" <ji...@apache.org> on 2019/12/04 13:46:00 UTC
[jira] [Updated] (SPARK-30125) Remove PostgreSQL dialect
[ https://issues.apache.org/jira/browse/SPARK-30125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuanjian Li updated SPARK-30125:
--------------------------------
Summary: Remove PostgreSQL dialect (was: Remove PostgreSQL dialect to reduce codebase maintenance cost)
> Remove PostgreSQL dialect
> -------------------------
>
> Key: SPARK-30125
> URL: https://issues.apache.org/jira/browse/SPARK-30125
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Yuanjian Li
> Priority: Major
>
> As the discussion in [http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-PostgreSQL-dialect-td28417.html], we need to remove PostgreSQL dialect form code base for several reasons:
> 1. The current approach makes the codebase complicated and hard to maintain.
> 2. Fully migrating PostgreSQL workloads to Spark SQL is not our focus for now.
>
> Curently we have 3 features under PostgreSQL dialect:
> 1. SPARK-27931: when casting string to boolean, `t`, `tr`, `tru`, `yes`, .. are also allowed as true string.
> 2. SPARK-29364: `date - date` returns interval in Spark (SQL standard behavior), but return int in PostgreSQL
> 3. SPARK-28395: `int / int` returns double in Spark, but returns int in PostgreSQL. (there is no standard)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org