You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Weichen Xu (Jira)" <ji...@apache.org> on 2021/04/29 10:07:00 UTC

[jira] [Created] (SPARK-35271) After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue run or launch new spark jobs

Weichen Xu created SPARK-35271:
----------------------------------

             Summary: After CrossValidator/TrainValidationSplit fit raised error, some backgroud threads may still continue run or launch new spark jobs
                 Key: SPARK-35271
                 URL: https://issues.apache.org/jira/browse/SPARK-35271
             Project: Spark
          Issue Type: Bug
          Components: ML
    Affects Versions: 3.1.1, 3.0.1
            Reporter: Weichen Xu


CrossValidator/TrainValidationSplit fit will spawn many threads to run trial tasks.
if one of the trial tasks failed, the CrossValidator/TrainValidationSplit fit will raise error and break the main thread, but other backgroud threads running other trial tasks will continue to run, and trial tasks which are pending to run in thread queue will also continue to launch.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org