You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xinyi Yu (Jira)" <ji...@apache.org> on 2024/08/29 04:06:00 UTC

[jira] [Created] (SPARK-49454) Avoid double normalization in the cache process

Xinyi Yu created SPARK-49454:
--------------------------------

             Summary: Avoid double normalization in the cache process
                 Key: SPARK-49454
                 URL: https://issues.apache.org/jira/browse/SPARK-49454
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 4.0.0
            Reporter: Xinyi Yu


There is an issue introduced in [#46465|https://github.com/apache/spark/pull/46465], which is that normalization is applied twice during the cache process. Some normalization rules may not be idempotent, so applying them repeatedly may break the plan shape and cause an unexpected cache miss.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org