You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Andreas Chatzistergiou (Jira)" <ji...@apache.org> on 2026/05/21 18:53:00 UTC

[jira] [Created] (SPARK-56995) Allow dataframe caching in the DSv2 Transaction API

Andreas Chatzistergiou created SPARK-56995:
----------------------------------------------

             Summary: Allow dataframe caching in the DSv2 Transaction API
                 Key: SPARK-56995
                 URL: https://issues.apache.org/jira/browse/SPARK-56995
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 4.2.0
            Reporter: Andreas Chatzistergiou


Currently, the DSv2 Transaction API skips dataframe caching. This can cause significant performance regression to existing workloads. Dataframes cached prior to the transaction should be allowed to be reused within the transaction. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org