You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Thomas Graves (Jira)" <ji...@apache.org> on 2020/01/23 16:13:00 UTC

[jira] [Created] (SPARK-30623) Spark external shuffle allow disable of separate event loop group

Thomas Graves created SPARK-30623:
-------------------------------------

             Summary: Spark external shuffle allow disable of separate event loop group
                 Key: SPARK-30623
                 URL: https://issues.apache.org/jira/browse/SPARK-30623
             Project: Spark
          Issue Type: Bug
          Components: Shuffle
    Affects Versions: 2.4.4, 3.0.0
            Reporter: Thomas Graves


In SPARK-24355 changes were made to add a separate event loop group for processing ChunkFetchRequests , this  allow fors the other threads to handle regular connection requests when the configuration value is set. This however seems to have added some latency (see pr 22173 comments at the end).

To help with this we could make sure the secondary event loop group isn't used when the configuration of spark.shuffle.server.chunkFetchHandlerThreadsPercent isn't explicitly set. This should result in getting the same behavior as before.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org