You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2020/05/27 15:53:00 UTC

[jira] [Updated] (BEAM-10109) Fix context classloader in Spark portable runner

     [ https://issues.apache.org/jira/browse/BEAM-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-10109:
-----------------------------------
    Status: Open  (was: Triage Needed)

> Fix context classloader in Spark portable runner
> ------------------------------------------------
>
>                 Key: BEAM-10109
>                 URL: https://issues.apache.org/jira/browse/BEAM-10109
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-spark
>            Reporter: Kyle Weaver
>            Assignee: Kyle Weaver
>            Priority: P2
>              Labels: portability-spark
>
> Spark is setting the context class loader to support dynamic class loading, leading to unpredictable behavior with duplicate jars being found on the class path. We need to see if there is a way to disable this behavior so we can use the context class loader deterministically.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)