You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/10/20 14:46:00 UTC

[jira] [Updated] (SPARK-50045) Spark supports executor HostNetwork on k8s mode

     [ https://issues.apache.org/jira/browse/SPARK-50045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-50045:
-----------------------------------
    Labels: pull-request-available  (was: )

> Spark supports executor HostNetwork on k8s mode
> -----------------------------------------------
>
>                 Key: SPARK-50045
>                 URL: https://issues.apache.org/jira/browse/SPARK-50045
>             Project: Spark
>          Issue Type: New Feature
>          Components: k8s
>    Affects Versions: 4.0.0
>            Reporter: zzzzming95
>            Priority: Major
>              Labels: pull-request-available
>
> In k8s mode, when the executor executes the host network mode, it means that the executor shares the same IP address with the host. To support this mode in Spark, spark need to allow the Executor to be launched using a random BlockManager port. And prohibit shuffle local read, as this will cause the shuffle to be read failed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org