You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2025/11/21 00:36:00 UTC

[jira] [Assigned] (SPARK-54441) Enable coverage data on workers

     [ https://issues.apache.org/jira/browse/SPARK-54441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon reassigned SPARK-54441:
------------------------------------

    Assignee: Tian Gao

> Enable coverage data on workers
> -------------------------------
>
>                 Key: SPARK-54441
>                 URL: https://issues.apache.org/jira/browse/SPARK-54441
>             Project: Spark
>          Issue Type: Test
>          Components: PySpark
>    Affects Versions: 4.2.0
>            Reporter: Tian Gao
>            Assignee: Tian Gao
>            Priority: Minor
>              Labels: pull-request-available
>
> A big chunk of coverage data that we are missing is from workers. The workers.py itself has 1400+ missing lines, more than 2%+ of our total code. There are other functions that are executed by the worker which do not have coverage data either.
> We have plenty of tests that uses those function, we just miss coverage data, because the worker process is always brutally killed. We can hook the worker process in coverage run so it dumps the data before it's too late.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org