[jira] [Assigned] (SPARK-35271) After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue run or launch new spark jobs

["Weichen Xu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-35271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Weichen Xu reassigned SPARK-35271:
----------------------------------

    Assignee: Weichen Xu

> After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue run or launch new spark jobs
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-35271
>                 URL: https://issues.apache.org/jira/browse/SPARK-35271
>             Project: Spark
>          Issue Type: Bug
>          Components: ML
>    Affects Versions: 3.0.1, 3.1.1
>            Reporter: Weichen Xu
>            Assignee: Weichen Xu
>            Priority: Major
>
> CrossValidator/TrainValidationSplit fit will spawn many threads to run trial tasks.
> if one of the trial tasks failed, the CrossValidator/TrainValidationSplit fit will raise error and break the main thread, but other backgroud threads running other trial tasks will continue to run, and trial tasks which are pending to run in thread queue will also continue to launch.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org