You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2016/12/12 04:04:58 UTC

[jira] [Created] (SPARK-18824) Add optimizer rule to reorder expensive Filter predicates like ScalaUDF

Liang-Chi Hsieh created SPARK-18824:
---------------------------------------

             Summary: Add optimizer rule to reorder expensive Filter predicates like ScalaUDF
                 Key: SPARK-18824
                 URL: https://issues.apache.org/jira/browse/SPARK-18824
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Liang-Chi Hsieh


During evaluation of predicates in Filter, we can reorder the expressions in order to evaluate the more expensive expressions like ScalaUDF later. So if other expressions are evaluated to false, we can avoid evaluation of these UDFs.

We can add an optimizer rule to do this optimization.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org