You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2024/10/02 23:59:00 UTC

[jira] [Created] (GOBBLIN-2162) Ensure that YARN cache only loads in jars that were uploaded by the prior App Launcher

William Lo created GOBBLIN-2162:
-----------------------------------

             Summary: Ensure that YARN cache only loads in jars that were uploaded by the prior App Launcher
                 Key: GOBBLIN-2162
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-2162
             Project: Apache Gobblin
          Issue Type: Bug
            Reporter: William Lo


When Gobblin launches a YARN app, if the cache is enabled it will load all the jars stored in the cache into the classpath.

This can be problematic as jars that persisted from older versions of jars or other executions may clobber the classpath, adding jars that are not needed or jars that interfere with the current jars.

We want to ensure that only the jars that were intended to be uploaded by the GobblinYarnAppLauncher are the only jars that are loaded into the classpath from the shared cache.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)