You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Elek, Marton (JIRA)" <ji...@apache.org> on 2018/05/23 06:28:00 UTC
[jira] [Comment Edited] (HDDS-44) Ozone: start-ozone.sh fail to
start datanode because of incomplete classpaths
[ https://issues.apache.org/jira/browse/HDDS-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480379#comment-16480379 ]
Elek, Marton edited comment on HDDS-44 at 5/23/18 6:27 AM:
-----------------------------------------------------------
+1
I tested the latest patch and works well. The classpath is set because datanode is started with ozone command instead of hdfs command:
{code}
/opt/hadoop/bin/ozone --workers --config /opt/hadoop/etc/hadoop --daemon start datanode
{code}
I can see the plugin activation in the datanode output.
Note: I tried to create a docker-compose file for testing start-all continuously, unfortunatelly the home directory of hadoop user is /opt/hadoop which is mounted from outside so I can't provide .ssh config from the original image as it will be overwritten by the mounted volume. We may need to modify the base image... (This is not related to the issue, but I just shared it as it it could be useful in the future to create an acceptance test)
was (Author: elek):
+1
I tested the latest patch and works well. The classpath is set because datanode is started with ozone command instead of hdfs command:
{code}
/opt/hadoop/bin/ozone --workers --config /opt/hadoop/etc/hadoop --daemon start datanode
{code}
I can see the plugin activation in the datanode output.
Note: I tried to create a docker-compose file for testing start-all continuously, unfortunatelly the home directory of hadoop user is /opt/hadoop which is mounted from outside so I can't provide .ssh config from the original image as it will be overwritten by the mounted volume. We may need to modify the base image...
> Ozone: start-ozone.sh fail to start datanode because of incomplete classpaths
> -----------------------------------------------------------------------------
>
> Key: HDDS-44
> URL: https://issues.apache.org/jira/browse/HDDS-44
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Tools
> Affects Versions: 0.2.1
> Reporter: Mukul Kumar Singh
> Assignee: Mukul Kumar Singh
> Priority: Major
> Fix For: 0.2.1
>
> Attachments: HDDS-44.003.patch, HDDS-44.004.patch, HDFS-13383-HDFS-7240.001.patch, HDFS-13383-HDFS-7240.002.patch
>
>
> start-ozone.sh calls start-dfs.sh to start the NN and DN in a ozone cluster. Starting of datanode fails because of incomplete classpaths as datanode is unable to load all the plugins.
> Setting the class path to the following values does resolve the issue:
> {code}
> export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/ozone/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/hdsl/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/ozone/lib/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/hdsl/lib/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/cblock/*:/opt/hadoop/hadoop-3.2.0-SNAPSHOT/share/hadoop/cblock/lib/*
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org