You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "zhao yufei (Jira)" <ji...@apache.org> on 2020/09/25 00:46:00 UTC
[jira] [Updated] (SPARK-32993) pyspark on yarn executor hang after
some time
[ https://issues.apache.org/jira/browse/SPARK-32993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhao yufei updated SPARK-32993:
-------------------------------
Description:
same pyspark program, previously it works ok,
but these few days it always keep hang after running some time. the task is simple, fetch images from url and use PIL image library to process images finally write to tensorflow tfrecords file
was:same pyspark program, previously it works ok, but these few days it alwayes keep hang after running some time. the task is simple, fetch images from url and use PIL image libary to process images finally write to tensorflow tfrecords file
> pyspark on yarn executor hang after some time
> ----------------------------------------------
>
> Key: SPARK-32993
> URL: https://issues.apache.org/jira/browse/SPARK-32993
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: zhao yufei
> Priority: Minor
>
> same pyspark program, previously it works ok,
> but these few days it always keep hang after running some time. the task is simple, fetch images from url and use PIL image library to process images finally write to tensorflow tfrecords file
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org