[jira] [Created] (SPARK-40021) `Cancel workflow` can not cancel some jobs

["Ruifeng Zheng (Jira)" <ji...@apache.org>]

Ruifeng Zheng created SPARK-40021:
-------------------------------------

             Summary: `Cancel workflow` can not cancel some jobs
                 Key: SPARK-40021
                 URL: https://issues.apache.org/jira/browse/SPARK-40021
             Project: Spark
          Issue Type: Test
          Components: Project Infra, Tests
    Affects Versions: 3.4.0
            Reporter: Ruifeng Zheng


I have been observing this behavior for a long time:

sometime I want to cancel the workflow to release resource for other workflows, so I click the {{*{color:red}Cancel workflow{color}*}} button, most jobs in current workflow will be canceled in several minutes, but some jobs can never be killed, including:

* Run / Build modules: pyspark-sql, pyspark-mllib, pyspark-resource 
* Run / Build modules: pyspark-core, pyspark-streaming, pyspark-ml 
* Run / Build modules: pyspark-pandas 
* Run / Build modules: pyspark-pandas-slow 
* Run / Linters, licenses, dependencies and documentation generation





--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org