You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2016/12/12 17:47:58 UTC

[jira] [Commented] (SPARK-17409) Query in CTAS is Optimized Twice

    [ https://issues.apache.org/jira/browse/SPARK-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742577#comment-15742577 ] 

Josh Rosen commented on SPARK-17409:
------------------------------------

This was actually fixed in branch-2.x as well, via SPARK-17892.

> Query in CTAS is Optimized Twice
> --------------------------------
>
>                 Key: SPARK-17409
>                 URL: https://issues.apache.org/jira/browse/SPARK-17409
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.1.0
>            Reporter: Xiao Li
>            Assignee: Xiao Li
>            Priority: Critical
>              Labels: correctness
>             Fix For: 2.1.0
>
>
> The query in CTAS is optimized twice, as reported in the PR: https://github.com/apache/spark/pull/14797
> {quote}
> Some analyzer rules have assumptions on logical plans, optimizer may break these assumption, we should not pass an optimized query plan into QueryExecution (will be analyzed again), otherwise we may some weird bugs.
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org