You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2015/05/08 01:28:59 UTC

[jira] [Resolved] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

     [ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-2155.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.4.0

Issue resolved by pull request 5979
[https://github.com/apache/spark/pull/5979]

> Support effectful / non-deterministic key expressions in CASE WHEN statements
> -----------------------------------------------------------------------------
>
>                 Key: SPARK-2155
>                 URL: https://issues.apache.org/jira/browse/SPARK-2155
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Zongheng Yang
>            Priority: Minor
>             Fix For: 1.4.0
>
>
> Currently we translate CASE KEY WHEN to CASE WHEN, hence incurring redundant evaluations of the key expression. Relevant discussions here: https://github.com/apache/spark/pull/1055/files#r13784248
> If we are very in need of support for effectful key expressions, at least we can resort to the baseline approach of having both CaseWhen and CaseKeyWhen as expressions, which seem to introduce much code duplication (e.g. see https://github.com/concretevitamin/spark/blob/47d406a58d129e5bba68bfadf9dd1faa9054d834/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala#L216 for a sketch implementation). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org