You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Andreas Neumann (Jira)" <ji...@apache.org> on 2026/06/10 16:46:00 UTC

[jira] [Created] (SPARK-57375) AutoCdcScd1FullRefreshSuite is flaky

Andreas Neumann created SPARK-57375:
---------------------------------------

             Summary: AutoCdcScd1FullRefreshSuite is flaky
                 Key: SPARK-57375
                 URL: https://issues.apache.org/jira/browse/SPARK-57375
             Project: Spark
          Issue Type: Bug
          Components: Declarative Pipelines
    Affects Versions: 4.2.0, 4.3.0
            Reporter: Andreas Neumann


This test suite sometimes fails in CI. 

Root cause: All AutoCDC test suites share the same static SharedTablesInMemoryRowLevelOperationTableCatalog.sharedTables map and use identical namespace ns1. When SBT runs suites in parallel (same JVM, parallelExecution = true), one suite's operations can impact other suites' queries, and afterEach calling reset() (which clears the entire map) can destroy tables that another concurrent suite is using.

The fix is to make each suite use a unique namespace, and clearing only that namespace in afterEach(). 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org