You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Satish Subhashrao Saley (JIRA)" <ji...@apache.org> on 2016/04/21 19:55:25 UTC

[jira] [Created] (OOZIE-2512) ShareLibservice returns incorrect path for jar

Satish Subhashrao Saley created OOZIE-2512:
----------------------------------------------

             Summary: ShareLibservice returns incorrect path for jar
                 Key: OOZIE-2512
                 URL: https://issues.apache.org/jira/browse/OOZIE-2512
             Project: Oozie
          Issue Type: Bug
            Reporter: Satish Subhashrao Saley
            Assignee: Satish Subhashrao Saley


If we have {{oozie.service.ShareLibService.mapping.file}} setting pointing to a metafile, then ShareLibServe loads paths from that file.

We can mention path to a directory or path to a direct file.

When path to a directory is mentioned, the paths are populated correctly, but not when we mentioned direct path for a file.

Consider following paths:
* /sharelib/pig/
** pig.jar
** some.jar
* /sharelib/spark
** spark-assembly.jar


In metafile, we have
{code}
oozie.pig=/sharelib/pig/
oozie.spark=/sharelib/spark/spark-assembly.jar
{code}

Now, the SharelibService calculates the paths as
pig - hdfs://clustername.com:8020/sharelib/pig/pig.jar,hdfs://clustername.com:8020/sharelib/pig/some.jar
spark - /sharelib/spark/spark-assembly.jar

The spark path does not have hdfs prefixed. 

Later on, when we run a spark action, it fails with 

{code}
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, File file:/sharelib/spark/spark-assembly.jar does not exist
java.io.FileNotFoundException: File file:/sharelib/spark/spark-assembly.jar does not exist
{code}

Remember, if we already mentioned hdfs prefixed paths in metafile, then it works fine.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)