You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xinyi Yu (Jira)" <ji...@apache.org> on 2024/08/29 04:06:00 UTC
[jira] [Created] (SPARK-49454) Avoid double normalization in the cache process
Xinyi Yu created SPARK-49454:
--------------------------------
Summary: Avoid double normalization in the cache process
Key: SPARK-49454
URL: https://issues.apache.org/jira/browse/SPARK-49454
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 4.0.0
Reporter: Xinyi Yu
There is an issue introduced in [#46465|https://github.com/apache/spark/pull/46465], which is that normalization is applied twice during the cache process. Some normalization rules may not be idempotent, so applying them repeatedly may break the plan shape and cause an unexpected cache miss.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org