[jira] [Created] (BIGTOP-3439) Oozie's smoke test fails on CentOS and Debian

["Kengo Seki (Jira)" <ji...@apache.org>]

Kengo Seki created BIGTOP-3439:
----------------------------------

             Summary: Oozie's smoke test fails on CentOS and Debian
                 Key: BIGTOP-3439
                 URL: https://issues.apache.org/jira/browse/BIGTOP-3439
             Project: Bigtop
          Issue Type: Bug
          Components: tests
            Reporter: Kengo Seki


It's a follow-up issue of BIGTOP-3406. With that change, Oozie's smoke test got to pass on Debian and Ubuntu, but it still fails on CentOS and Fedora with the following error.

{code}
===== START TO RUN SMOKE TESTS: oozie =====

+ su -s /bin/bash hdfs -c 'JAVA_LIBRARY_PATH=/usr/lib/qfs hadoop fs -chmod 777 /user/vagrant'
+ su -s /bin/bash hdfs -c 'JAVA_LIBRARY_PATH=/usr/lib/qfs hadoop fs -chmod 777 /user/root'
+ su -s /bin/bash hdfs -c 'JAVA_LIBRARY_PATH=/usr/lib/qfs hadoop fs -chown yarn:yarn /user/yarn'
+ [[ oozie == *\q\f\s* ]]
+ [[ oozie == *\a\l\l\u\x\i\o* ]]
+ [[ oozie == *\o\o\z\i\e* ]]
+ su -s /bin/bash hdfs -c 'hadoop fs -mkdir -p /user/oozie/share/lib'
+ su -s /bin/bash hdfs -c 'hadoop fs -chown -R oozie:oozie /user/oozie'
++ hostname -f
+ oozie-setup sharelib create -fs hdfs://247b00365170.bigtop.apache.org:8020/
  setting OOZIE_DATA=/var/lib/oozie
  setting OOZIE_CATALINA_HOME=/usr/lib/bigtop-tomcat
  setting CATALINA_TMPDIR=/var/lib/oozie
  setting CATALINA_PID=/var/run/oozie/oozie.pid
  setting CATALINA_BASE=/var/lib/oozie/tomcat-deployment
  setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
  setting OOZIE_CONFIG=/etc/oozie/conf
  setting OOZIE_LOG=/var/log/oozie
  setting OOZIE_DATA=/var/lib/oozie
  setting OOZIE_CATALINA_HOME=/usr/lib/bigtop-tomcat
  setting CATALINA_TMPDIR=/var/lib/oozie
  setting CATALINA_PID=/var/run/oozie/oozie.pid
  setting CATALINA_BASE=/var/lib/oozie/tomcat-deployment
  setting CATALINA_OPTS="$CATALINA_OPTS -Xmx1024m"
  setting OOZIE_CONFIG=/etc/oozie/conf
  setting OOZIE_LOG=/var/log/oozie
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/cli/ParseException
	at java.lang.Class.getDeclaredMethods0(Native Method)
	at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
	at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
	at java.lang.Class.getMethod0(Class.java:3018)
	at java.lang.Class.getMethod(Class.java:1784)
	at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
	at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.cli.ParseException
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	... 7 more
+ oozie admin -sharelibupdate
Error: Could not find or load main class org.apache.oozie.cli.OozieCLI

(snip)
{code}

As [~elukey] [pointed out|https://github.com/apache/bigtop/pull/676#issuecomment-715899945], the required jar files don't seem to be contained in the generated rpm files, but I've not digged into its reason yet.

{code}
$ rpm -ql output/oozie/noarch/oozie-4.3.0-1.el8.noarch.rpm | grep /usr/lib/oozie/lib
/usr/lib/oozie/lib
/usr/lib/oozie/lib/hadoop-annotations.jar
/usr/lib/oozie/lib/hadoop-auth.jar
/usr/lib/oozie/lib/hadoop-common.jar
/usr/lib/oozie/lib/hadoop-hdfs-client.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-app.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-common.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-core.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-jobclient.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-shuffle.jar
/usr/lib/oozie/lib/hadoop-yarn-api.jar
/usr/lib/oozie/lib/hadoop-yarn-client.jar
/usr/lib/oozie/lib/hadoop-yarn-common.jar
/usr/lib/oozie/lib/hadoop-yarn-server-common.jar
/usr/lib/oozie/libext
/usr/lib/oozie/libtools
/usr/lib/oozie/libtools/gson-2.7.jar
/usr/lib/oozie/libtools/oozie-tools-4.3.0.jar
$ rpm -ql output/oozie/noarch/oozie-client-4.3.0-1.el8.noarch.rpm | grep /usr/lib/oozie/lib
/usr/lib/oozie/lib
/usr/lib/oozie/lib/hadoop-annotations.jar
/usr/lib/oozie/lib/hadoop-auth.jar
/usr/lib/oozie/lib/hadoop-common.jar
/usr/lib/oozie/lib/hadoop-hdfs-client.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-app.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-common.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-core.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-jobclient.jar
/usr/lib/oozie/lib/hadoop-mapreduce-client-shuffle.jar
/usr/lib/oozie/lib/hadoop-yarn-api.jar
/usr/lib/oozie/lib/hadoop-yarn-client.jar
/usr/lib/oozie/lib/hadoop-yarn-common.jar
/usr/lib/oozie/lib/hadoop-yarn-server-common.jar
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)