You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gergely Svigruha (JIRA)" <ji...@apache.org> on 2015/06/25 10:59:04 UTC
[jira] [Updated] (SPARK-8616) SQLContext doesn't handle tricky
column names when loading from JDBC
[ https://issues.apache.org/jira/browse/SPARK-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gergely Svigruha updated SPARK-8616:
------------------------------------
Description:
Reproduce:
- create a table in a relational database (in my case sqlite) with a column name containing a space:
CREATE TABLE my_table (id INTEGER, "tricky column" TEXT);
- try to create a DataFrame using that table:
sqlContext.read.format("jdbc").options(Map(
"url" -> "jdbs:sqlite:...",
"dbtable" -> "my_table")).load()
java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database (no such column: tricky)
According to the SQL spec this should be valid:
http://savage.net.au/SQL/sql-99.bnf.html#delimited%20identifier
was:
Reproduce:
- create a table in a relational database (in my case sqlite) with a column name containing a space:
CREATE TABLE my_table (id INTEGER, "tricky column" TEXT);
- try to create a DataFrame using that table:
rc.sqlContext.read.format("jdbc").options(Map(
"url" -> "jdbs:sqlite:...",
"dbtable" -> "my_table")).load()
java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database (no such column: tricky)
According to the SQL spec this should be valid:
http://savage.net.au/SQL/sql-99.bnf.html#delimited%20identifier
> SQLContext doesn't handle tricky column names when loading from JDBC
> --------------------------------------------------------------------
>
> Key: SPARK-8616
> URL: https://issues.apache.org/jira/browse/SPARK-8616
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.4.0
> Environment: Ubuntu 14.04, Sqlite 3.8.7, Spark 1.4.0
> Reporter: Gergely Svigruha
>
> Reproduce:
> - create a table in a relational database (in my case sqlite) with a column name containing a space:
> CREATE TABLE my_table (id INTEGER, "tricky column" TEXT);
> - try to create a DataFrame using that table:
> sqlContext.read.format("jdbc").options(Map(
> "url" -> "jdbs:sqlite:...",
> "dbtable" -> "my_table")).load()
> java.sql.SQLException: [SQLITE_ERROR] SQL error or missing database (no such column: tricky)
> According to the SQL spec this should be valid:
> http://savage.net.au/SQL/sql-99.bnf.html#delimited%20identifier
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org