You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Danny McCormick (Jira)" <ji...@apache.org> on 2022/06/04 15:42:00 UTC

[jira] [Commented] (BEAM-10109) Fix context classloader in Spark portable runner

    [ https://issues.apache.org/jira/browse/BEAM-10109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548561#comment-17548561 ] 

Danny McCormick commented on BEAM-10109:
----------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/20192

> Fix context classloader in Spark portable runner
> ------------------------------------------------
>
>                 Key: BEAM-10109
>                 URL: https://issues.apache.org/jira/browse/BEAM-10109
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-spark
>            Reporter: Kyle Weaver
>            Priority: P3
>              Labels: portability-spark
>
> Spark is setting the context class loader to support dynamic class loading, leading to unpredictable behavior with duplicate jars being found on the class path. We need to see if there is a way to disable this behavior so we can use the context class loader deterministically.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)