You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2019/01/16 23:24:00 UTC

[jira] [Resolved] (SPARK-26633) Add ExecutorClassLoader.getResourceAsStream

     [ https://issues.apache.org/jira/browse/SPARK-26633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiao Li resolved SPARK-26633.
-----------------------------
       Resolution: Fixed
         Assignee: Kris Mok
    Fix Version/s: 3.0.0
                   2.4.1

> Add ExecutorClassLoader.getResourceAsStream
> -------------------------------------------
>
>                 Key: SPARK-26633
>                 URL: https://issues.apache.org/jira/browse/SPARK-26633
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Shell
>    Affects Versions: 3.0.0
>            Reporter: Kris Mok
>            Assignee: Kris Mok
>            Priority: Major
>             Fix For: 2.4.1, 3.0.0
>
>
> {{ExecutorClassLoader}} is capable of loading dynamically generated classes from the REPL via either RPC or HDFS, but right now it always delegates resource loading to the parent class loader. That makes the dynamically generated classes unavailable to uses other than class loading.
> Such need may arise, for example, when json4s wants to parse the Class file to extract parameter name information. Internally it'd call the class loader's {{getResourceAsStream}} to obtain the Class file content as an {{InputStream}}.
> This ticket tracks an improvement to the {{ExecutorClassLoader}} to allow fetching dynamically generated Class files from the REPL as resource streams.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org