You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Michael Armbrust (JIRA)" <ji...@apache.org> on 2015/09/15 23:37:46 UTC

[jira] [Resolved] (SPARK-5410) Error parsing scientific notation in a select statement

     [ https://issues.apache.org/jira/browse/SPARK-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Armbrust resolved SPARK-5410.
-------------------------------------
    Resolution: Fixed

I tested and in Spark 1.5 the HiveContext can parse {{2.2E10}}.  HiveContext is recommended for all users even if you aren't using Hive support as the parser is much better.

> Error parsing scientific notation in a select statement
> -------------------------------------------------------
>
>                 Key: SPARK-5410
>                 URL: https://issues.apache.org/jira/browse/SPARK-5410
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.2.0
>            Reporter: Hugo Ferrira
>              Labels: numeric, parsing, sql
>
> I am using the Cassandra DB and am attempting a select through the Spark SQL interface.
> SELECT * from key_value WHERE f2 < 2.2E10
> And get the following error (no error if I remove the E10):
> [info] - should be able to select a subset of applicable features *** FAILED ***
> [info]   java.lang.RuntimeException: [1.39] failure: ``UNION'' expected but identifier E10 found
> [info] 
> [info] SELECT * from key_value WHERE f2 < 2.2E10
> [info]                                       ^
> [info]   at scala.sys.package$.error(package.scala:27)
> [info]   at org.apache.spark.sql.catalyst.AbstractSparkSQLParser.apply(SparkSQLParser.scala:33)
> [info]   at org.apache.spark.sql.SQLContext$$anonfun$1.apply(SQLContext.scala:79)
> [info]   at org.apache.spark.sql.SQLContext$$anonfun$1.apply(SQLContext.scala:79)
> [info]   at org.apache.spark.sql.catalyst.SparkSQLParser$$anonfun$org$apache$spark$sql$catalyst$SparkSQLParser$$others$1.apply(SparkSQLParser.scala:174)
> [info]   at org.apache.spark.sql.catalyst.SparkSQLParser$$anonfun$org$apache$spark$sql$catalyst$SparkSQLParser$$others$1.apply(SparkSQLParser.scala:173)
> [info]   at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:136)
> [info]   at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:135)
> [info]   at scala.util.parsing.combinator.Parsers$Parser$$anonfun$map$1.apply(Parsers.scala:242)
> [info]   at scala.util.parsing.combinator.Parsers$Parser$$anonfun$map$1.apply(Parsers.scala:242)
> [info]   ...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org