You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2026/05/26 15:07:00 UTC

[jira] [Updated] (SPARK-56995) Allow dataframe caching in the DSv2 Transaction API

     [ https://issues.apache.org/jira/browse/SPARK-56995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-56995:
-----------------------------------
    Labels: pull-request-available  (was: )

> Allow dataframe caching in the DSv2 Transaction API
> ---------------------------------------------------
>
>                 Key: SPARK-56995
>                 URL: https://issues.apache.org/jira/browse/SPARK-56995
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 4.2.0
>            Reporter: Andreas Chatzistergiou
>            Priority: Major
>              Labels: pull-request-available
>
> Currently, the DSv2 Transaction API skips dataframe caching. This can cause significant performance regression to existing workloads. Dataframes cached prior to the transaction should be allowed to be reused within the transaction. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org