[jira] [Resolved] (SPARK-44078) Add support for classloader/resource isolation

["Herman van Hövell (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-44078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Herman van Hövell resolved SPARK-44078.
---------------------------------------
    Fix Version/s: 3.5.0
         Assignee: Venkata Sai Akhil Gudesa
       Resolution: Fixed

> Add support for classloader/resource isolation
> ----------------------------------------------
>
>                 Key: SPARK-44078
>                 URL: https://issues.apache.org/jira/browse/SPARK-44078
>             Project: Spark
>          Issue Type: New Feature
>          Components: Connect, Spark Core
>    Affects Versions: 3.5.0
>            Reporter: Venkata Sai Akhil Gudesa
>            Assignee: Venkata Sai Akhil Gudesa
>            Priority: Major
>             Fix For: 3.5.0
>
>
> A current limitation of Scala UDFs is that a Spark cluster would only be able to support a single REPL at a time due to the fact that classloaders of different Spark Sessions (and therefore, Spark Connect sessions) aren't isolated from each other. Without isolation, REPL-generated classfiles as well as user-added JARs may conflict if there are multiple users of the cluster.
> Thus, we need a mechanism to support isolated sessions (i.e isolated resources/classloader) so that each REPL user does not conflict with other users on the same cluster.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org