You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Elek, Marton (JIRA)" <ji...@apache.org> on 2018/07/25 09:50:00 UTC
[jira] [Comment Edited] (HDDS-291) Initialize hadoop metrics system
in standalon hdds datanodes
[ https://issues.apache.org/jira/browse/HDDS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555456#comment-16555456 ]
Elek, Marton edited comment on HDDS-291 at 7/25/18 9:49 AM:
------------------------------------------------------------
Standalone HDDS datanodes have no web page with the jmx endpoint, to check the behaviour we need to connect with jconsole/visualvm:
1. Please add the following line to the hadoop-dist/target/compose/ozone/docker-config:
{code}
HADOOP_OPTS=-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9010 -Dcom.sun.management.jmxremote.local.only=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false
{code}
2. After the docker-compose up, you need to find the docker ip of the container.
{code}
docker inspect -f '{{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' ozone_datanode_1
{code}
3. You can connect to the RM server from jconsole with the ip and port 9010
*Note:* These instructions are for linux as in linux the docker containers can be accessed from local with the internal ips. For docker machine / docker linux It may not work. In that case as second step, you need to add a port mapping to the hadoop-dist/target/compose/ozone/docker-compose.yaml:
{code}
datanode:
image: apache/hadoop-runner
volumes:
- ../../ozone:/opt/hadoop
ports:
- 9864
- 9010:9010
command: ["/opt/hadoop/bin/ozone","datanode"]
env_file:
- ./docker-config
{code}
And connect to the localhost:9010 port with jconsole.
was (Author: elek):
Standalone HDDS datanodes have no web page with the jmx endpoint, to check the behaviour we need to connect with jconsole/visualvm:
1. Please add the following line to the hadoop-dist/target/compose/ozone/docker-config:
{code}
HADOOP_OPTS=-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9010 -Dcom.sun.management.jmxremote.local.only=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false
{code}
2. After the docker-compose up, you need to find the docker ip of the container.
{code}
docker inspect -f '{{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' ozone_datanode_1
{code}
3. You can connect to the RM server from jconsole with the ip and port 9010
*Note:* These instructions are for linux as in linux the docker containers can be accessed from local with the internal ips. For docker machine / docker linux It may not work. In that case as second step, you need to add a port mapping to the hadoop-dist/target/compose/ozone/docker-compose.yaml:
{code}
datanode:
image: apache/hadoop-runner
volumes:
- ../../ozone:/opt/hadoop
ports:
- 9864
- 9010:9010
command: ["/opt/hadoop/bin/ozone","datanode"]
env_file:
- ./docker-config
{code}
And connect to the 9010 port.
> Initialize hadoop metrics system in standalon hdds datanodes
> ------------------------------------------------------------
>
> Key: HDDS-291
> URL: https://issues.apache.org/jira/browse/HDDS-291
> Project: Hadoop Distributed Data Store
> Issue Type: Bug
> Components: Ozone Datanode
> Reporter: Elek, Marton
> Assignee: Elek, Marton
> Priority: Minor
> Fix For: 0.2.1
>
>
> Since HDDS-94 we can start a standalone HDDS datanode process without HDFS datanode parts.
> But to see the hadoop metrics over the jmx interface we need to initialize the hadoop metrics system (we have existing metrics by the storage io layer).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org