[GitHub] [bigtop] sekikn commented on pull request #634: BIGTOP-3343. Add Debian 10 and Ubuntu 18.04 support to the Docker provisioner.

[GitBox <gi...@apache.org>]

sekikn commented on pull request #634:
URL: https://github.com/apache/bigtop/pull/634#issuecomment-620336224


   I confirmed that this PR worked with Debian 10 and Ubuntu 18.04, as follows.
   (In the following steps, I temporarily rewrote the repository URL in the config files to avoid failure caused by non-existent one)
   
   ```
   $ git status 
   On branch master
   Your branch is up to date with 'origin/master'.
   
   nothing to commit, working tree clean
   $ curl -sL https://github.com/apache/bigtop/pull/634.patch | git apply -
   $ git status 
   On branch master
   Your branch is up to date with 'origin/master'.
   
   Changes not staged for commit:
     (use "git add <file>..." to update what will be committed)
     (use "git checkout -- <file>..." to discard changes in working directory)
   
   	modified:   bigtop-deploy/puppet/manifests/bigtop_repo.pp
   	modified:   bigtop-deploy/puppet/manifests/jdk.pp
   	modified:   bigtop-packages/src/common/bigtop-utils/bigtop-detect-javahome
   	modified:   bigtop_toolchain/bin/puppetize.sh
   
   Untracked files:
     (use "git add <file>..." to include in what will be committed)
   
   	provisioner/docker/config_debian-10.yaml
   	provisioner/docker/config_ubuntu-18.04.yaml
   
   no changes added to commit (use "git add" and/or "git commit -a")
   $ vi provisioner/docker/config_debian-10.yaml
   $ vi provisioner/docker/config_ubuntu-18.04.yaml
   $ cat provisioner/docker/config_debian-10.yaml
   
   (snip)
   
   docker:
           memory_limit: "4g"
           image: "bigtop/puppet:trunk-debian-10"
   
   repo: "http://repos.bigtop.apache.org/releases/1.4.0/debian/9/$(ARCH)"
   distro: debian
   components: [hdfs, yarn, mapreduce]
   enable_local_repo: true
   smoke_test_components: [hdfs, yarn, mapreduce]
   $ cat provisioner/docker/config_ubuntu-18.04.yaml
   
   (snip)
   
   docker:
           memory_limit: "4g"
           image:  "bigtop/puppet:trunk-ubuntu-18.04"
   
   repo: "http://repos.bigtop.apache.org/releases/1.4.0/ubuntu/16.04/$(ARCH)"
   distro: debian
   components: [hdfs, yarn, mapreduce]
   enable_local_repo: true
   smoke_test_components: [hdfs, yarn, mapreduce]
   $ ./build.sh trunk-debian-10
   
   (snip)
   
   Successfully built 86e144cd84e5
   Successfully tagged bigtop/puppet:trunk-debian-10
   ++ rm -f Dockerfile puppetize.sh
   $ ./build.sh trunk-ubuntu-18.04
   
   (snip)
   
   Successfully built aee3ab6549bc
   Successfully tagged bigtop/puppet:trunk-ubuntu-18.04
   ++ rm -f Dockerfile puppetize.sh
   $ cd -
   /home/sekikn/repos/bigtop
   $ cd provisioner/docker
   $ ./docker-hadoop.sh -d; ./docker-hadoop.sh -c 1 -C config_debian-10.yaml 
   
   (snip)
   
   $ docker exec -it 20200428105855r15042_bigtop_1 cat /etc/issue
   Debian GNU/Linux 10 \n \l
   
   $ docker exec -it 20200428105855r15042_bigtop_1 java -version
   openjdk version "1.8.0_252"
   OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_252-b09)
   OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.252-b09, mixed mode)
   $ docker exec -it 20200428105855r15042_bigtop_1 jps
   4960 Jps
   3456 ResourceManager
   4433 DataNode
   3921 JobHistoryServer
   4754 NodeManager
   3016 NameNode
   4154 WebAppProxyServer
   $ ./docker-hadoop.sh -d; ./docker-hadoop.sh -c 1 -C config_ubuntu-18.04.yaml 
   
   (snip)
   
   $ docker exec -it 20200428110523r10746_bigtop_1 cat /etc/issue
   Ubuntu 18.04.3 LTS \n \l
   
   $ docker exec -it 20200428110523r10746_bigtop_1 java -version
   openjdk version "1.8.0_252"
   OpenJDK Runtime Environment (build 1.8.0_252-8u252-b09-1~18.04-b09)
   OpenJDK 64-Bit Server VM (build 25.252-b09, mixed mode)
   $ docker exec -it 20200428110523r10746_bigtop_1 jps
   6260 NodeManager
   5080 ResourceManager
   4668 NameNode
   5517 JobHistoryServer
   6446 Jps
   5726 WebAppProxyServer
   5983 DataNode
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org