You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2017/08/14 18:07:01 UTC

[jira] [Commented] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

    [ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126115#comment-16126115 ] 

Reynold Xin commented on SPARK-21726:
-------------------------------------

cc [~viirya] would you be interested in doing this?


> Check for structural integrity of the plan in QO in test mode
> -------------------------------------------------------------
>
>                 Key: SPARK-21726
>                 URL: https://issues.apache.org/jira/browse/SPARK-21726
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 2.2.0
>            Reporter: Reynold Xin
>
> Right now we don't have any checks in the optimizer to check for the structural integrity of the plan (e.g. resolved). It would be great if in test mode, we can check whether a plan is still resolved after the execution of each rule, so we can catch rules that return invalid plans.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org