You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kris Mok (JIRA)" <ji...@apache.org> on 2019/01/16 06:48:00 UTC

[jira] [Created] (SPARK-26633) Add ExecutorClassLoader.getResourceAsStream

Kris Mok created SPARK-26633:
--------------------------------

             Summary: Add ExecutorClassLoader.getResourceAsStream
                 Key: SPARK-26633
                 URL: https://issues.apache.org/jira/browse/SPARK-26633
             Project: Spark
          Issue Type: Improvement
          Components: Spark Shell
    Affects Versions: 3.0.0
            Reporter: Kris Mok


{{ExecutorClassLoader}} is capable of loading dynamically generated classes from the REPL via either RPC or HDFS, but right now it always delegates resource loading to the parent class loader. That makes the dynamically generated classes unavailable to uses other than class loading.

Such need may arise, for example, when json4s wants to parse the Class file to extract parameter name information. Internally it'd call the class loader's {{getResourceAsStream}} to obtain the Class file content as an {{InputStream}}.

This ticket tracks an improvement to the {{ExecutorClassLoader}} to allow fetching dynamically generated Class files from the REPL as resource streams.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org