[jira] [Assigned] (SPARK-52055) Suppress the exception in ExecutePlanResponseReattachableIterator.__del__

["Dongjoon Hyun (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-52055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun reassigned SPARK-52055:
-------------------------------------

    Assignee: Hyukjin Kwon

> Suppress the exception in ExecutePlanResponseReattachableIterator.__del__
> -------------------------------------------------------------------------
>
>                 Key: SPARK-52055
>                 URL: https://issues.apache.org/jira/browse/SPARK-52055
>             Project: Spark
>          Issue Type: Improvement
>          Components: Connect, PySpark
>    Affects Versions: 4.0.0
>            Reporter: Hyukjin Kwon
>            Assignee: Hyukjin Kwon
>            Priority: Major
>              Labels: pull-request-available
>
> {code}
> ./bin/pyspark --remote local
> {code}
> and exit(0) directly will show a warning as below.
> {code}
> Exception ignored in: <function ExecutePlanResponseReattachableIterator.__del__ at 0x12229f7e0>
> Traceback (most recent call last):
>   File "/.../python/pyspark/sql/connect/client/reattach.py", line 347, in __del__
>     return self.close()
>            ^^^^^^^^^^^^
>   File "/.../python/pyspark/sql/connect/client/reattach.py", line 343, in close
>     self._release_all()
>   File "/.../python/pyspark/sql/connect/client/reattach.py", line 245, in _release_all
>     thread_pool.submit(target)
>   File "/opt/miniconda3/envs/python3.11/lib/python3.11/concurrent/futures/thread.py", line 169, in submit
>     raise RuntimeError('cannot schedule new futures after '
> RuntimeError: cannot schedule new futures after interpreter shutdown
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org