You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/03/26 05:21:00 UTC
[jira] [Assigned] (SPARK-30623) Spark external shuffle allow
disable of separate event loop group
[ https://issues.apache.org/jira/browse/SPARK-30623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun reassigned SPARK-30623:
-------------------------------------
Assignee: Yuanjian Li
> Spark external shuffle allow disable of separate event loop group
> -----------------------------------------------------------------
>
> Key: SPARK-30623
> URL: https://issues.apache.org/jira/browse/SPARK-30623
> Project: Spark
> Issue Type: Bug
> Components: Shuffle
> Affects Versions: 3.0.0
> Reporter: Thomas Graves
> Assignee: Yuanjian Li
> Priority: Major
> Fix For: 3.0.0
>
>
> In SPARK-24355 changes were made to add a separate event loop group for processing ChunkFetchRequests , this allow fors the other threads to handle regular connection requests when the configuration value is set. This however seems to have added some latency (see pr 22173 comments at the end).
> To help with this we could make sure the secondary event loop group isn't used when the configuration of spark.shuffle.server.chunkFetchHandlerThreadsPercent isn't explicitly set. This should result in getting the same behavior as before.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org