[jira] [Created] (HADOOP-16788) Hadoop resource manager jdk 8 dependency

["Asher Lawson (Jira)" <ji...@apache.org>]

Asher Lawson created HADOOP-16788:
-------------------------------------

             Summary: Hadoop resource manager jdk 8 dependency
                 Key: HADOOP-16788
                 URL: https://issues.apache.org/jira/browse/HADOOP-16788
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 2.10.0
         Environment: Mac OS Catalina 10.15.2

Java(TM) SE Runtime Environment (build 13.0.1+9)

Java HotSpot(TM) 64-Bit Server VM (build 13.0.1+9, mixed mode, sharing)
            Reporter: Asher Lawson
         Attachments: hadoop-matthewasherlawson-resourcemanager-Matthews-MBP copy.log

When I am trying to create a single cluster Hadoop environment, I cannot load the Node Manager or Resource Manager. From the log I get the error:

Caused by: java.lang.ClassNotFoundException: javax.activation.DataSourceCaused by: java.lang.ClassNotFoundException: javax.activation.DataSource at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:602) at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178) at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)

... 83 more

I gather this is from a dependency on javax.activation from JDK8. The only online solution I could find involved changing these two lines in the yarn-env.sh file in the usr/local/Cellar/hadoop/\{version}/libexec/etc/hadoop folder:

export YARN_RESOURCEMANAGER_OPTS="--add-modules=ALL-SYSTEM"

export YARN_NODEMANAGER_OPTS="--add-modules=ALL-SYSTEM"

This did not work and I continue to get the same error in the log when trying to run the YARN manager. Can anyone advise as to how to get around this dependency?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org