You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Chandni Singh (Jira)" <ji...@apache.org> on 2022/06/14 20:48:00 UTC

[jira] [Created] (SPARK-39471) ExternalShuffleService port is extracted from the confs everytime a block manager gets registered

Chandni Singh created SPARK-39471:
-------------------------------------

             Summary: ExternalShuffleService port is extracted from the confs everytime a block manager gets registered
                 Key: SPARK-39471
                 URL: https://issues.apache.org/jira/browse/SPARK-39471
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.2.0
            Reporter: Chandni Singh


We are extracting the shuffle service port from the spark and hadoop configuration with every blockmanager registeration. This could be avoided by using the cached external service port. 

Also, we should avoid calling addMerger when push-based shuffle is disabled. 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org