You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2021/03/03 15:32:04 UTC
[GitHub] [bigtop] iwasakims opened a new pull request #748: BIGTOP-3513. Update deb resources for hadoop-yarn-router and hadoop-hdfs-dfsrouter.
iwasakims opened a new pull request #748:
URL: https://github.com/apache/bigtop/pull/748
https://issues.apache.org/jira/browse/BIGTOP-3513
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #748: BIGTOP-3513. Update deb resources for hadoop-yarn-router and hadoop-hdfs-dfsrouter.
Posted by GitBox <gi...@apache.org>.
sekikn commented on pull request #748:
URL: https://github.com/apache/bigtop/pull/748#issuecomment-791978062
+1, also tested on Debian 10 and Ubuntu 20.04. Thanks @iwasakims!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] sekikn merged pull request #748: BIGTOP-3513. Update deb resources for hadoop-yarn-router and hadoop-hdfs-dfsrouter.
Posted by GitBox <gi...@apache.org>.
sekikn merged pull request #748:
URL: https://github.com/apache/bigtop/pull/748
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #748: BIGTOP-3513. Update deb resources for hadoop-yarn-router and hadoop-hdfs-dfsrouter.
Posted by GitBox <gi...@apache.org>.
iwasakims commented on pull request #748:
URL: https://github.com/apache/bigtop/pull/748#issuecomment-789801340
I manually tested this on ubuntu-18.04.
* I does not defect existing smoke-tests of hdfs,mapreduce,yarn.
* `apt install hadoop-hdfs-dfsrouter hadoop-yarn-router` works.
* `systemctl start/status/stop hadoop-hdfs-dfsrouter hadoop-yarn-router` works.
* pid files and log files are created on expected location.
```
$ ./docker-hadoop.sh \
--create 3 \
--image bigtop/puppet:trunk-ubuntu-18.04 \
--memory 8g \
--repo file:///bigtop-home/output/apt \
--disable-gpg-check \
--stack hdfs,mapreduce,yarn \
--smoke-tests hdfs,mapreduce,yarn
$ ./docker-hadoop.sh --exec 1 /bin/bash
root@65a4735b7fda:/# apt install hadoop-hdfs-dfsrouter hadoop-yarn-router
root@65a4735b7fda:/# systemctl start hadoop-hdfs-dfsrouter hadoop-yarn-router
root@65a4735b7fda:/# ls -l /var/run/hadoop-hdfs
total 12
-rw-r--r-- 1 hdfs hdfs 5 Mar 3 09:49 hadoop-hdfs-datanode.pid
-rw-r--r-- 1 hdfs hdfs 6 Mar 3 10:04 hadoop-hdfs-dfsrouter.pid
-rw-r--r-- 1 hdfs hdfs 5 Mar 3 09:48 hadoop-hdfs-namenode.pid
root@65a4735b7fda:/# ls -l /var/run/hadoop-yarn
total 16
-rw-r--r-- 1 yarn yarn 5 Mar 3 09:49 hadoop-yarn-nodemanager.pid
-rw-r--r-- 1 yarn yarn 5 Mar 3 09:49 hadoop-yarn-proxyserver.pid
-rw-r--r-- 1 yarn yarn 5 Mar 3 09:48 hadoop-yarn-resourcemanager.pid
-rw-r--r-- 1 yarn yarn 6 Mar 3 10:04 hadoop-yarn-router.pid
root@65a4735b7fda:/# ls -l /var/log/hadoop-hdfs
total 676
-rw-r--r-- 1 hdfs hdfs 417475 Mar 3 10:04 hadoop-hdfs-datanode-65a4735b7fda.log
-rw-r--r-- 1 hdfs hdfs 705 Mar 3 09:49 hadoop-hdfs-datanode-65a4735b7fda.out
-rw-r--r-- 1 hdfs hdfs 41560 Mar 3 10:04 hadoop-hdfs-dfsrouter-65a4735b7fda.log
-rw-r--r-- 1 hdfs hdfs 705 Mar 3 10:04 hadoop-hdfs-dfsrouter-65a4735b7fda.out
-rw-r--r-- 1 hdfs hdfs 207098 Mar 3 10:04 hadoop-hdfs-namenode-65a4735b7fda.log
-rw-r--r-- 1 hdfs hdfs 705 Mar 3 09:48 hadoop-hdfs-namenode-65a4735b7fda.out
-rw-r--r-- 1 hdfs hdfs 841 Mar 3 09:57 metasave_test
root@65a4735b7fda:/# ls -l /var/log/hadoop-yarn
total 500
drwxr-xr-x 2 yarn yarn 4096 Mar 3 10:01 containers
-rw-r--r-- 1 yarn yarn 194996 Mar 3 10:01 hadoop-yarn-nodemanager-65a4735b7fda.log
-rw-r--r-- 1 yarn yarn 2214 Mar 3 09:49 hadoop-yarn-nodemanager-65a4735b7fda.out
-rw-r--r-- 1 yarn yarn 18493 Mar 3 09:49 hadoop-yarn-proxyserver-65a4735b7fda.log
-rw-r--r-- 1 yarn yarn 705 Mar 3 09:49 hadoop-yarn-proxyserver-65a4735b7fda.out
-rw-r--r-- 1 yarn yarn 239468 Mar 3 10:01 hadoop-yarn-resourcemanager-65a4735b7fda.log
-rw-r--r-- 1 yarn yarn 2230 Mar 3 09:48 hadoop-yarn-resourcemanager-65a4735b7fda.out
-rw-r--r-- 1 yarn yarn 21708 Mar 3 10:04 hadoop-yarn-router-65a4735b7fda.log
-rw-r--r-- 1 yarn yarn 2227 Mar 3 10:04 hadoop-yarn-router-65a4735b7fda.out
root@65a4735b7fda:/# sudo systemctl status hadoop-hdfs-dfsrouter hadoop-yarn-router
root@65a4735b7fda:/# sudo systemctl stop hadoop-hdfs-dfsrouter hadoop-yarn-router
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org