[jira] [Created] (OOZIE-3146) Enhance local sharelib

["Attila Sasvari (JIRA)" <ji...@apache.org>]

Attila Sasvari created OOZIE-3146:
-------------------------------------

             Summary: Enhance local sharelib
                 Key: OOZIE-3146
                 URL: https://issues.apache.org/jira/browse/OOZIE-3146
             Project: Oozie
          Issue Type: Improvement
          Components: core
    Affects Versions: 5.0.0
            Reporter: Attila Sasvari


OOZIE-2601 made it possible to use local paths for the Oozie Sharelib.

Right now, ShareLibService checks the existence of files either on HDFS or local filesystem (symlinks followed too).  It is actually checking the files or resolving symlinks in the Oozie server, while the actual files are in the task nodes. 

The implementation could be improved. For example: we could introduce "a separate datastructure for local files and adding a new getShareLibJarsLocal(String actiontype) method,which will return the local files path as is (if it is a file with extension) or return both the path and /* appended to the path (/* works only for jars. The original directory path is required if there are config files under the directory). That can be then added directly to yarn.application.classpath setting."



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)