[jira] [Created] (BIGTOP-3317) Oozie sharedlib create command fails when uploading to HDFS

["Luca Toscano (Jira)" <ji...@apache.org>]

Luca Toscano created BIGTOP-3317:
------------------------------------

             Summary: Oozie sharedlib create command fails when uploading to HDFS
                 Key: BIGTOP-3317
                 URL: https://issues.apache.org/jira/browse/BIGTOP-3317
             Project: Bigtop
          Issue Type: Bug
    Affects Versions: 1.4.0
            Reporter: Luca Toscano


Hi!

I am testing oozie on BigTop 1.4, and when I execute the sharedlib create command I get the following error:
{code:java}
/usr/bin/oozie-setup sharelib create -fs hdfs://analytics-test-hadoop -locallib /usr/lib/oozie/oozie-sharelib.tar.gz

[..]

the destination path for sharelib is: /user/oozie/share/lib/lib_20200228153329
Error: No FileSystem for scheme: hdfs
Stack trace for the error was (for debug purposes):--------------------------------------java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2799) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2810) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2849) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2831) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:389) at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:172) at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:67)
{code}
After some debugging I found the following broken symlink:
{code:java}
file /usr/lib/oozie/lib/hadoop-hdfs.jar
/usr/lib/oozie/lib/hadoop-hdfs.jar: broken symbolic link to ../../hadoop/client/hadoop-hdfs.jar
{code}
The above is created by the oozie package, but the hadoop-hdfs.jar seems not present. I removed it and added the following in /usr/lib/oozie/lib:
{code:java}
ln -s ../../hadoop/client/hadoop-hdfs-client.jar hadoop-hdfs-client.jar
{code}
And now sharedlib upgrade seems working. It should be an easy fix in the deb packaging of oozie if what I wrote is correct (I can send a pull request in case).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)