You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/06/01 17:42:59 UTC

[jira] [Commented] (SPARK-15706) Wrong Answer when using IF NOT EXISTS in INSERT OVERWRITE for DYNAMIC PARTITION

    [ https://issues.apache.org/jira/browse/SPARK-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15310734#comment-15310734 ] 

Apache Spark commented on SPARK-15706:
--------------------------------------

User 'gatorsmile' has created a pull request for this issue:
https://github.com/apache/spark/pull/13447

> Wrong Answer when using IF NOT EXISTS in INSERT OVERWRITE for DYNAMIC PARTITION
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-15706
>                 URL: https://issues.apache.org/jira/browse/SPARK-15706
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Xiao Li
>
> IF NOT EXISTS in INSERT OVERWRITE should not support dynamic partitions. However, we returns a wrong answer. 
> {noformat}
> CREATE TABLE table_with_partition(c1 string)
> PARTITIONED by (p1 string,p2 string)
> INSERT OVERWRITE TABLE table_with_partition
> partition (p1='a',p2='b')
> SELECT 'blarr2'
> INSERT OVERWRITE TABLE table_with_partition
> partition (p1='a',p2) IF NOT EXISTS
> SELECT 'blarr3'
> {noformat}
> {noformat}
> !== Correct Answer - 1 ==   == Spark Answer - 2 ==
>  [blarr2,a,b]               [blarr2,a,b]
> !                           [blarr3,a,blarr3]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org