You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Gengliang Wang (Jira)" <ji...@apache.org> on 2024/08/29 21:44:00 UTC

[jira] [Assigned] (SPARK-49454) Avoid double normalization in the cache process

     [ https://issues.apache.org/jira/browse/SPARK-49454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gengliang Wang reassigned SPARK-49454:
--------------------------------------

    Assignee: Xinyi Yu

> Avoid double normalization in the cache process
> -----------------------------------------------
>
>                 Key: SPARK-49454
>                 URL: https://issues.apache.org/jira/browse/SPARK-49454
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 4.0.0
>            Reporter: Xinyi Yu
>            Assignee: Xinyi Yu
>            Priority: Major
>              Labels: pull-request-available
>
> There is an issue introduced in [#46465|https://github.com/apache/spark/pull/46465], which is that normalization is applied twice during the cache process. Some normalization rules may not be idempotent, so applying them repeatedly may break the plan shape and cause an unexpected cache miss.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org