You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "wangxinyu (Jira)" <ji...@apache.org> on 2025/12/12 11:41:00 UTC

[jira] [Created] (SPARK-54694) Fail app on ConfigMap size over limit

wangxinyu created SPARK-54694:
---------------------------------

             Summary: Fail app on ConfigMap size over limit
                 Key: SPARK-54694
                 URL: https://issues.apache.org/jira/browse/SPARK-54694
             Project: Spark
          Issue Type: Bug
          Components: Kubernetes
    Affects Versions: 4.2.0
            Reporter: wangxinyu


Currently, when the combined size of configuration files exceeds the Kubernetes ConfigMap size limit, Spark silently skips loading some files. This behavior is problematic because it can lead to unexpected missing configurations, potentially causing application failures or incorrect runtime behavior.

Furthermore, the current validation logic is incomplete and inconsistent:
 # Only the size of driver conf map will be validated against the Kubernetes limit.
 # The size of the spark.properties file is NOT included in the size calculation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org