You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Akira Ajisaka (Jira)" <ji...@apache.org> on 2019/10/15 02:39:00 UTC
[jira] [Comment Edited] (HDFS-14907) [Dynamometer] DataNode can't
find junit jar when using Hadoop-3 binary
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16951500#comment-16951500 ]
Akira Ajisaka edited comment on HDFS-14907 at 10/15/19 2:38 AM:
----------------------------------------------------------------
It seems that the {{script_pwd}} in the following script is not expected.
{code:title=start-dynamometer-cluster.sh}
script_pwd="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)/.."
{code}
should be
{code}
script_pwd="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)/../../.."
{code}
to specify {{share/hadoop/tools/}} to include the libraries to hadoop-tools.
In addition, {{dynamometer-infra-\*.jar}} should be {{hadoop-dynamometer-infra-\*.jar}}.
was (Author: ajisakaa):
It seems that the {{script_pwd}} in the following script is not expected.
{code:title=start-dynamometer-cluster.sh}
script_pwd="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)/.."
{code}
should be
{code}
script_pwd="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)/../../.."
{code}
to specify {{share/hadoop/tools/}} to include the libraries to hadoop-tools.
In addition, {{dynamometer-infra-*.jar}} should be {{hadoop-dynamometer-infra-*.jar}}.
> [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary
> ----------------------------------------------------------------------
>
> Key: HDFS-14907
> URL: https://issues.apache.org/jira/browse/HDFS-14907
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Takanobu Asanuma
> Priority: Major
>
> When executing {{start-dynamometer-cluster.sh}} with Hadoop-3 binary, datanodes fail to run with the following log and {{start-dynamometer-cluster.sh}} fails.
> {noformat}
> LogType:stderr
> LogLastModifiedTime:Wed Oct 09 15:03:09 +0900 2019
> LogLength:1386
> LogContents:
> Exception in thread "main" java.lang.NoClassDefFoundError: org/junit/Assert
> at org.apache.hadoop.test.GenericTestUtils.assertExists(GenericTestUtils.java:299)
> at org.apache.hadoop.test.GenericTestUtils.getTestDir(GenericTestUtils.java:243)
> at org.apache.hadoop.test.GenericTestUtils.getTestDir(GenericTestUtils.java:252)
> at org.apache.hadoop.hdfs.MiniDFSCluster.getBaseDirectory(MiniDFSCluster.java:2982)
> at org.apache.hadoop.hdfs.MiniDFSCluster.determineDfsBaseDir(MiniDFSCluster.java:2972)
> at org.apache.hadoop.hdfs.MiniDFSCluster.formatDataNodeDirs(MiniDFSCluster.java:2834)
> at org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:123)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
> at org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
> Caused by: java.lang.ClassNotFoundException: org.junit.Assert
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 9 more
> ./start-component.sh: line 317: kill: (2261) - No such process
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org