[jira] [Resolved] (SPARK-57375) AutoCdcScd1FullRefreshSuite is flaky

["Andreas Neumann (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-57375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andreas Neumann resolved SPARK-57375.
-------------------------------------
    Resolution: Cannot Reproduce

> AutoCdcScd1FullRefreshSuite is flaky
> ------------------------------------
>
>                 Key: SPARK-57375
>                 URL: https://issues.apache.org/jira/browse/SPARK-57375
>             Project: Spark
>          Issue Type: Bug
>          Components: Declarative Pipelines
>    Affects Versions: 4.2.0, 4.3.0
>            Reporter: Andreas Neumann
>            Priority: Major
>              Labels: pull-request-available
>
> This test suite sometimes fails in CI. 
> Root cause: All AutoCDC test suites share the same static SharedTablesInMemoryRowLevelOperationTableCatalog.sharedTables map and use identical namespace ns1. When SBT runs suites in parallel (same JVM, parallelExecution = true), one suite's operations can impact other suites' queries, and afterEach calling reset() (which clears the entire map) can destroy tables that another concurrent suite is using.
> The fix is to make each suite use a unique namespace, and clearing only that namespace in afterEach(). 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org