You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2026/07/09 01:13:00 UTC

[jira] [Resolved] (SPARK-56993) Allow dataframe caching in the DSv2 Transaction API

     [ https://issues.apache.org/jira/browse/SPARK-56993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-56993.
----------------------------------
    Resolution: Duplicate

Duplicate of SPARK-56992 (identical summary and description, filed by the same reporter within the same minute). Consolidating discussion on SPARK-56992.

> Allow dataframe caching in the DSv2 Transaction API
> ---------------------------------------------------
>
>                 Key: SPARK-56993
>                 URL: https://issues.apache.org/jira/browse/SPARK-56993
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 4.2.0
>            Reporter: Andreas Chatzistergiou
>            Priority: Major
>
> Currently, the DSv2 Transaction API skips dataframe caching. This can cause significant performance regression to existing workloads. Dataframes cached prior to the transaction should be allowed to be reused within the transaction. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org