You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ziqi Liu (Jira)" <ji...@apache.org> on 2025/08/29 05:01:00 UTC

[jira] [Created] (SPARK-53435) race condition in CachedRDDBuilder

Ziqi Liu created SPARK-53435:
--------------------------------

             Summary: race condition in CachedRDDBuilder
                 Key: SPARK-53435
                 URL: https://issues.apache.org/jira/browse/SPARK-53435
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 4.0.0
            Reporter: Ziqi Liu


There is race condition between `CachedRDDBuilder.cachedColumnBuffers` and `CachedRDDBuilder.clearCache`: when they interleave each other, `cachedColumnBuffers` might return a `nullptr`.

This looks like a day-1 bug introduced from  https://github.com/apache/spark/commit/20ca208bcda6f22fe7d9fb54144de435b4237536#diff-4068fce361a50e3d32af2ba2d4231905f500e7b2da9f46d5ddd99b758c30fd43 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org