You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2019/01/16 06:51:00 UTC

[jira] [Assigned] (SPARK-26633) Add ExecutorClassLoader.getResourceAsStream

     [ https://issues.apache.org/jira/browse/SPARK-26633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-26633:
------------------------------------

    Assignee: Apache Spark

> Add ExecutorClassLoader.getResourceAsStream
> -------------------------------------------
>
>                 Key: SPARK-26633
>                 URL: https://issues.apache.org/jira/browse/SPARK-26633
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Shell
>    Affects Versions: 3.0.0
>            Reporter: Kris Mok
>            Assignee: Apache Spark
>            Priority: Major
>
> {{ExecutorClassLoader}} is capable of loading dynamically generated classes from the REPL via either RPC or HDFS, but right now it always delegates resource loading to the parent class loader. That makes the dynamically generated classes unavailable to uses other than class loading.
> Such need may arise, for example, when json4s wants to parse the Class file to extract parameter name information. Internally it'd call the class loader's {{getResourceAsStream}} to obtain the Class file content as an {{InputStream}}.
> This ticket tracks an improvement to the {{ExecutorClassLoader}} to allow fetching dynamically generated Class files from the REPL as resource streams.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org