You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Grzegorz Chilkiewicz (JIRA)" <ji...@apache.org> on 2016/01/25 17:27:39 UTC
[jira] [Updated] (SPARK-12982) SQLContext: temporary table
registration does not accept valid identifier
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grzegorz Chilkiewicz updated SPARK-12982:
-----------------------------------------
Description:
We have encountered very strange behavior of SparkSQL temporary table registration.
What identifiers for temporary table should be valid?
Alphanumerical + '_' with at least one non-digit?
Valid identifiers:
df
674123a
674123_
a0e97c59_4445_479d_a7ef_d770e3874123
1ae97c59_4445_479d_a7ef_d770e3874123
Invalid identifier:
10e97c59_4445_479d_a7ef_d770e3874123
Stack trace:
{code:xml}
[error] java.lang.RuntimeException: [1.1] failure: identifier expected
[error]
[error] 10e97c59_4445_479d_a7ef_d770e3874123
[error] ^
[error] at scala.sys.package$.error(package.scala:27)
[error] at org.apache.spark.sql.catalyst.SqlParser$.parseTableIdentifier(SqlParser.scala:58)
[error] at org.apache.spark.sql.SQLContext.table(SQLContext.scala:827)
[error] at org.apache.spark.sql.SQLContext.dropTempTable(SQLContext.scala:763)
[error] at io.deepsense.SparkSqlContextTempTableIdentifier$.identifierCheck(SparkSqlContextTempTableIdentifier.scala:27)
[error] at io.deepsense.SparkSqlContextTempTableIdentifier$.main(SparkSqlContextTempTableIdentifier.scala:58)
[error] at io.deepsense.SparkSqlContextTempTableIdentifier.main(SparkSqlContextTempTableIdentifier.scala)
{code}
Code to reproduce this bug:
https://github.com/grzegorz-chilkiewicz/SparkSqlContextTempTableIdentifier
was:
We have encountered very strange behavior of SparkSQL temporary table registration.
What identifiers for temporary table should be valid?
Alphanumerical + '_' with at least one non-digit?
Valid identifiers:
df
674123a
674123_
a0e97c59_4445_479d_a7ef_d770e3874123
1ae97c59_4445_479d_a7ef_d770e3874123
Invalid identifier:
10e97c59_4445_479d_a7ef_d770e3874123
Stack trace:
[error] java.lang.RuntimeException: [1.1] failure: identifier expected
[error]
[error] 10e97c59_4445_479d_a7ef_d770e3874123
[error] ^
[error] at scala.sys.package$.error(package.scala:27)
[error] at org.apache.spark.sql.catalyst.SqlParser$.parseTableIdentifier(SqlParser.scala:58)
[error] at org.apache.spark.sql.SQLContext.table(SQLContext.scala:827)
[error] at org.apache.spark.sql.SQLContext.dropTempTable(SQLContext.scala:763)
[error] at io.deepsense.SparkSqlContextTempTableIdentifier$.identifierCheck(SparkSqlContextTempTableIdentifier.scala:27)
[error] at io.deepsense.SparkSqlContextTempTableIdentifier$.main(SparkSqlContextTempTableIdentifier.scala:58)
[error] at io.deepsense.SparkSqlContextTempTableIdentifier.main(SparkSqlContextTempTableIdentifier.scala)
Code to reproduce bug:
https://github.com/grzegorz-chilkiewicz/SparkSqlContextTempTableIdentifier
> SQLContext: temporary table registration does not accept valid identifier
> -------------------------------------------------------------------------
>
> Key: SPARK-12982
> URL: https://issues.apache.org/jira/browse/SPARK-12982
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.0
> Reporter: Grzegorz Chilkiewicz
> Priority: Minor
> Labels: sql
>
> We have encountered very strange behavior of SparkSQL temporary table registration.
> What identifiers for temporary table should be valid?
> Alphanumerical + '_' with at least one non-digit?
> Valid identifiers:
> df
> 674123a
> 674123_
> a0e97c59_4445_479d_a7ef_d770e3874123
> 1ae97c59_4445_479d_a7ef_d770e3874123
> Invalid identifier:
> 10e97c59_4445_479d_a7ef_d770e3874123
> Stack trace:
> {code:xml}
> [error] java.lang.RuntimeException: [1.1] failure: identifier expected
> [error]
> [error] 10e97c59_4445_479d_a7ef_d770e3874123
> [error] ^
> [error] at scala.sys.package$.error(package.scala:27)
> [error] at org.apache.spark.sql.catalyst.SqlParser$.parseTableIdentifier(SqlParser.scala:58)
> [error] at org.apache.spark.sql.SQLContext.table(SQLContext.scala:827)
> [error] at org.apache.spark.sql.SQLContext.dropTempTable(SQLContext.scala:763)
> [error] at io.deepsense.SparkSqlContextTempTableIdentifier$.identifierCheck(SparkSqlContextTempTableIdentifier.scala:27)
> [error] at io.deepsense.SparkSqlContextTempTableIdentifier$.main(SparkSqlContextTempTableIdentifier.scala:58)
> [error] at io.deepsense.SparkSqlContextTempTableIdentifier.main(SparkSqlContextTempTableIdentifier.scala)
> {code}
> Code to reproduce this bug:
> https://github.com/grzegorz-chilkiewicz/SparkSqlContextTempTableIdentifier
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org