You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Jun He (Jira)" <ji...@apache.org> on 2020/02/29 13:14:00 UTC
[jira] [Commented] (BIGTOP-3317) Oozie sharedlib create command
fails when uploading to HDFS
[ https://issues.apache.org/jira/browse/BIGTOP-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048301#comment-17048301 ]
Jun He commented on BIGTOP-3317:
--------------------------------
LGTM, +1
> Oozie sharedlib create command fails when uploading to HDFS
> -----------------------------------------------------------
>
> Key: BIGTOP-3317
> URL: https://issues.apache.org/jira/browse/BIGTOP-3317
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 1.4.0
> Reporter: Luca Toscano
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hi!
> I am testing oozie on BigTop 1.4, and when I execute the sharedlib create command I get the following error:
> {code:java}
> /usr/bin/oozie-setup sharelib create -fs hdfs://analytics-test-hadoop -locallib /usr/lib/oozie/oozie-sharelib.tar.gz
> [..]
> the destination path for sharelib is: /user/oozie/share/lib/lib_20200228153329
> Error: No FileSystem for scheme: hdfs
> Stack trace for the error was (for debug purposes):--------------------------------------java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2799) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2810) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2849) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2831) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:389) at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:172) at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:67)
> {code}
> After some debugging I found the following broken symlink:
> {code:java}
> file /usr/lib/oozie/lib/hadoop-hdfs.jar
> /usr/lib/oozie/lib/hadoop-hdfs.jar: broken symbolic link to ../../hadoop/client/hadoop-hdfs.jar
> {code}
> The above is created by the oozie package, but the hadoop-hdfs.jar seems not present. I removed it and added the following in /usr/lib/oozie/lib:
> {code:java}
> ln -s ../../hadoop/client/hadoop-hdfs-client.jar hadoop-hdfs-client.jar
> {code}
> And now sharedlib upgrade seems working. It should be an easy fix in the deb packaging of oozie if what I wrote is correct (I can send a pull request in case).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)