You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "zhao yufei (Jira)" <ji...@apache.org> on 2020/09/25 00:45:00 UTC

[jira] [Created] (SPARK-32993) pyspark on yarn executor hang after some time

zhao yufei created SPARK-32993:
----------------------------------

             Summary: pyspark on yarn  executor hang after some time
                 Key: SPARK-32993
                 URL: https://issues.apache.org/jira/browse/SPARK-32993
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: zhao yufei


same pyspark program,  previously it works ok, but these few days it alwayes keep hang after running some time.  the task is simple, fetch images from url and use PIL image libary to process images finally write to tensorflow tfrecords file



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org