Spark Kubernetes 3.0.1 | podcreationTimeout not working

[Ranju Jain <Ra...@ericsson.com.INVALID>]

Hi,

I submitted the spark job and pods goes in Pending state because of insufficient resources.
But they are not getting deleted after this timeout of 60 sec. Please help me in understanding.

Regards
Ranju

Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working

[Attila Zsolt Piros <pi...@gmail.com>]

I believe this problem led to opening SPARK-34389 where the problem is
discussed further.

[1] https://issues.apache.org/jira/browse/SPARK-34389



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org

Re: Spark Kubernetes 3.0.1 | podcreationTimeout not working

[Jacek Laskowski <ja...@japila.pl>]

Hi Ranju,

Can you show the pods and their state? Does the situation happen at the
very beginning of spark-submit or some time later (once you've got a couple
of executors)? My understanding allows me to think of the driver not
starting up due to lack of resources or executors. In either case they're
not deleted as they simply wait forever. I might be mistaken here though.

What property is this for "this timeout of 60 sec."?

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
"The Internals Of" Online Books <https://books.japila.pl/>
Follow me on https://twitter.com/jaceklaskowski

<https://twitter.com/jaceklaskowski>


On Wed, Feb 10, 2021 at 2:03 PM Ranju Jain <Ra...@ericsson.com.invalid>
wrote:

> Hi,
>
>
>
> I submitted the spark job and pods goes in Pending state because of
> insufficient resources.
>
> But they are not getting deleted after this timeout of 60 sec. Please help
> me in understanding.
>
>
>
> Regards
>
> Ranju
>