You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gengliang Wang (JIRA)" <ji...@apache.org> on 2017/06/28 01:41:00 UTC
[jira] [Updated] (SPARK-21222) Move elimination of Distinct clause
from analyzer to optimizer
[ https://issues.apache.org/jira/browse/SPARK-21222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gengliang Wang updated SPARK-21222:
-----------------------------------
Description:
Move elimination of Distinct clause from analyzer to optimizer
Distinct clause is useless after MAX/MIN clause. For example,
"Select MAX(distinct a) FROM src from"
is equivalent of
"Select MAX(a) FROM src from"
However, this optimization is implemented in analyzer. It should be in optimizer.
was:
Distinct clause is after MAX/MIN clause
"Select MAX(distinct a) FROM src from"
is equivalent of
"Select MAX(distinct a) FROM src from"
However, this optimization is implemented in analyzer. It should be in optimizer.
> Move elimination of Distinct clause from analyzer to optimizer
> --------------------------------------------------------------
>
> Key: SPARK-21222
> URL: https://issues.apache.org/jira/browse/SPARK-21222
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Gengliang Wang
> Priority: Minor
>
> Move elimination of Distinct clause from analyzer to optimizer
> Distinct clause is useless after MAX/MIN clause. For example,
> "Select MAX(distinct a) FROM src from"
> is equivalent of
> "Select MAX(a) FROM src from"
> However, this optimization is implemented in analyzer. It should be in optimizer.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org