You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Arnab (JIRA)" <ji...@apache.org> on 2014/12/19 18:08:13 UTC
[jira] [Commented] (SPARK-4869) The variable names in IF statement
of Spark SQL doesn't resolve to its value.
[ https://issues.apache.org/jira/browse/SPARK-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14253659#comment-14253659 ]
Arnab commented on SPARK-4869:
------------------------------
Can you kindly clarify what DAYS_30 refers to.
I tried out a nested if statement and it seems to work fine in SparkSql.
val child = sqlContext.sql("select name,age,IF(age < 20,IF(age<12,0,1),1) as child from people")
child.collect.foreach(println)
> The variable names in IF statement of Spark SQL doesn't resolve to its value.
> ------------------------------------------------------------------------------
>
> Key: SPARK-4869
> URL: https://issues.apache.org/jira/browse/SPARK-4869
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.1.1
> Reporter: Ajay
> Priority: Blocker
>
> We got stuck with “IF-THEN” statement in Spark SQL. As per our usecase, we have to have nested “if” statements. But, spark sql is not able to resolve the variable names in final evaluation but the literal values are working. An "Unresolved Attributes" error is being thrown. Please fix this bug.
> This works:
> sqlSC.sql("SELECT DISTINCT UNIT, PAST_DUE ,IF( PAST_DUE = 'CURRENT_MONTH', 0,1) as ROLL_BACKWARD FROM OUTER_RDD")
> This doesn’t :
> sqlSC.sql("SELECT DISTINCT UNIT, PAST_DUE ,IF( PAST_DUE = 'CURRENT_MONTH', 0,DAYS_30) as ROLL_BACKWARD FROM OUTER_RDD")
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org