You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2018/04/02 19:56:00 UTC

[jira] [Commented] (SPARK-21363) Prevent column name duplication in temporary view

    [ https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423048#comment-16423048 ] 

Reynold Xin commented on SPARK-21363:
-------------------------------------

How can user drop the fields or rename them after joins?

 

> Prevent column name duplication in temporary view
> -------------------------------------------------
>
>                 Key: SPARK-21363
>                 URL: https://issues.apache.org/jira/browse/SPARK-21363
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.1.1
>            Reporter: Takeshi Yamamuro
>            Priority: Minor
>
> In SPARK-20460, we refactored some existing checks for column name duplication. The master currently allows name duplication for temporary views like an example below though, IMO we better prevent it along with permanent views (the master prevents the case for the permanent views).
> {code}
> scala> Seq((1, 1)).toDF("a", "a").createOrReplaceTempView("t")
> scala> sql("SELECT * FROM t").show
> +---+---+
> |  a|  a|
> +---+---+
> |  1|  1|
> +---+---+
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org