You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Peter Rudenko (JIRA)" <ji...@apache.org> on 2015/07/18 11:41:04 UTC
[jira] [Updated] (SPARK-9170) ORC data source creates a schema with
lowercase table names
[ https://issues.apache.org/jira/browse/SPARK-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Rudenko updated SPARK-9170:
---------------------------------
Description:
Steps to reproduce:
{code}
sqlContext.range(0, 10).select('id as "Acol").write.format("orc").save("/tmp/foo")
sqlContext.read.format("orc").load("/tmp/foo").schema("Acol")
//java.lang.IllegalArgumentException: Field "Acol" does not exist.
sqlContext.read.format("orc").load("/tmp/foo").schema("acol")
//org.apache.spark.sql.types.StructField = StructField(acol,LongType,true)
sqlContext.read.format("orc").load("/tmp/foo").select("Acol").show()
//+----+
|Acol|
+----+
| 1|
| 5|
| 3|
| 4|
| 7|
| 2|
| 6|
| 8|
| 9|
| 0|
+----+
{code}
was:
Steps to reproduce:
{code}
sqlContext.range(0, 10).select('id as "Acol").write.format("orc").save("/tmp/foo")
sqlContext.read.format("orc").load("/tmp/foo").schema("Acol")
//java.lang.IllegalArgumentException: Field "Acol" does not exist.
sqlContext.read.format("orc").load("/tmp/foo").schema("acol")
//org.apache.spark.sql.types.StructField = StructField(acol,LongType,true)
sqlContext.read.format("orc").load("/tmp/foo").select("Acol").show()
//+----+
|Acol|
+----+
| 1|
| 5|
| 3|
| 4|
| 7|
| 2|
| 6|
| 8|
| 9|
| 0|
+----+
{code}
> ORC data source creates a schema with lowercase table names
> -----------------------------------------------------------
>
> Key: SPARK-9170
> URL: https://issues.apache.org/jira/browse/SPARK-9170
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.4.1
> Reporter: Peter Rudenko
>
> Steps to reproduce:
> {code}
> sqlContext.range(0, 10).select('id as "Acol").write.format("orc").save("/tmp/foo")
> sqlContext.read.format("orc").load("/tmp/foo").schema("Acol")
> //java.lang.IllegalArgumentException: Field "Acol" does not exist.
> sqlContext.read.format("orc").load("/tmp/foo").schema("acol")
> //org.apache.spark.sql.types.StructField = StructField(acol,LongType,true)
> sqlContext.read.format("orc").load("/tmp/foo").select("Acol").show()
> //+----+
> |Acol|
> +----+
> | 1|
> | 5|
> | 3|
> | 4|
> | 7|
> | 2|
> | 6|
> | 8|
> | 9|
> | 0|
> +----+
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org