[jira] [Commented] (SPARK-3431) Parallelize execution of tests

["Nicholas Chammas (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219999#comment-14219999 ] 

Nicholas Chammas commented on SPARK-3431:
-----------------------------------------

[~joshrosen] - Per [this comment | https://issues.apache.org/jira/browse/SPARK-3431?focusedCommentId=14168038&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14168038], are you saying we have a way to parallelize tests and the only problem is the interleaved output? How quickly do tests run in that mode?

I thought another problem we had with parallelizing tests was that certain tests fought over the same ports or something. Is that not the case?

> Parallelize execution of tests
> ------------------------------
>
>                 Key: SPARK-3431
>                 URL: https://issues.apache.org/jira/browse/SPARK-3431
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>            Reporter: Nicholas Chammas
>
> Running all the tests in {{dev/run-tests}} takes up to 2 hours. A common strategy to cut test time down is to parallelize the execution of the tests. Doing that may in turn require some prerequisite changes to be made to how certain tests run.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org