You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "liangyouze (Jira)" <ji...@apache.org> on 2024/03/28 03:42:00 UTC
[jira] [Commented] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue
[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831611#comment-17831611 ]
liangyouze commented on SPARK-44050:
------------------------------------
I've encountered the same issue. I'd like to create a PR to try fixing this issue
> Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue
> ------------------------------------------------------------------
>
> Key: SPARK-44050
> URL: https://issues.apache.org/jira/browse/SPARK-44050
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes, Spark Submit
> Affects Versions: 3.3.1
> Reporter: Harshwardhan Singh Dodiya
> Priority: Critical
> Attachments: image-2023-06-14-11-07-36-960.png
>
>
> Dear Spark community,
> I am facing an issue related to mounting a ConfigMap in the driver pod of my Spark application. Upon investigation, I realized that the problem is caused by the ConfigMap not being created successfully.
> *Problem Description:*
> When attempting to mount the ConfigMap in the driver pod, I encounter consistent failures and my pod stays in containerCreating state. Upon further investigation, I discovered that the ConfigMap does not exist in the Kubernetes cluster, which results in the driver pod's inability to access the required configuration data.
> *Additional Information:*
> I would like to highlight that this issue is not a frequent occurrence. It has been observed randomly, affecting the mounting of the ConfigMap in the driver pod only approximately 5% of the time. This intermittent behavior adds complexity to the troubleshooting process, as it is challenging to reproduce consistently.
> *Error Message:*
> when describing driver pod (kubectl describe pod pod_name) get the below error.
> "ConfigMap '<configmap-name>' not found."
> *To Reproduce:*
> 1. Download spark 3.3.1 from [https://spark.apache.org/downloads.html]
> 2. create an image with "bin/docker-image-tool.sh"
> 3. Submit on spark-client via bash command by passing all the details and configurations.
> 4. Randomly in some of the driver pod we can observe this issue.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org