You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Jun He (Jira)" <ji...@apache.org> on 2020/02/29 13:14:00 UTC

[jira] [Commented] (BIGTOP-3317) Oozie sharedlib create command fails when uploading to HDFS

    [ https://issues.apache.org/jira/browse/BIGTOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048301#comment-17048301 ] 

Jun He commented on BIGTOP-3317:
--------------------------------

LGTM, +1

> Oozie sharedlib create command fails when uploading to HDFS
> -----------------------------------------------------------
>
>                 Key: BIGTOP-3317
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3317
>             Project: Bigtop
>          Issue Type: Bug
>    Affects Versions: 1.4.0
>            Reporter: Luca Toscano
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Hi!
> I am testing oozie on BigTop 1.4, and when I execute the sharedlib create command I get the following error:
> {code:java}
> /usr/bin/oozie-setup sharelib create -fs hdfs://analytics-test-hadoop -locallib /usr/lib/oozie/oozie-sharelib.tar.gz
> [..]
> the destination path for sharelib is: /user/oozie/share/lib/lib_20200228153329
> Error: No FileSystem for scheme: hdfs
> Stack trace for the error was (for debug purposes):--------------------------------------java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2799) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2810) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2849) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2831) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:389) at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:172) at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:67)
> {code}
> After some debugging I found the following broken symlink:
> {code:java}
> file /usr/lib/oozie/lib/hadoop-hdfs.jar
> /usr/lib/oozie/lib/hadoop-hdfs.jar: broken symbolic link to ../../hadoop/client/hadoop-hdfs.jar
> {code}
> The above is created by the oozie package, but the hadoop-hdfs.jar seems not present. I removed it and added the following in /usr/lib/oozie/lib:
> {code:java}
> ln -s ../../hadoop/client/hadoop-hdfs-client.jar hadoop-hdfs-client.jar
> {code}
> And now sharedlib upgrade seems working. It should be an easy fix in the deb packaging of oozie if what I wrote is correct (I can send a pull request in case).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)