You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Evans Ye (JIRA)" <ji...@apache.org> on 2018/12/28 15:59:00 UTC

[jira] [Updated] (BIGTOP-3121) [Provisioner] Can't recreate Bigtop cluster using Docker Provisioner

     [ https://issues.apache.org/jira/browse/BIGTOP-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Evans Ye updated BIGTOP-3121:
-----------------------------
    Description: 
To reproduce the issue:
* Step 0: get an amazon linux. The one I used for test (Bigtop CI node slave02)
 ** Amazon Linux AMI release 2018.03
 ** Docker version 18.06.1-ce, build e68fc7a215d7133c34aa18e3b72b4a21fd0c6136
 ** docker-compose version 1.23.1, build b02f1306
 ** Bigtop master cobebase
* Step 1: cd bigtop/provisioner/docker
* Step 2: ./docker-hadoop -c 1
* Step 3: ./docker-hadoop -d
* Step 4: ./docker-hadoop -c 1
{code}
[jenkins@ip-172-31-8-79 docker]$ ./docker-hadoop.sh -c 1
Environment check...
Check docker:
Docker version 18.06.1-ce, build e68fc7a215d7133c34aa18e3b72b4a21fd0c6136
Check docker-compose:
docker-compose version 1.23.1, build b02f1306
Check ruby:
ruby 2.0.0p648 (2015-12-16) [x86_64-linux]
Creating 20181228_155211_r21927_bigtop_1_8d56e66d2866 ... error

ERROR: for 20181228_155211_r21927_bigtop_1_8d56e66d2866  Cannot start service bigtop: b'cgroups: cannot find cgroup mount destination: unknown'

ERROR: for bigtop  Cannot start service bigtop: b'cgroups: cannot find cgroup mount destination: unknown'
ERROR: Encountered errors while bringing up the project.

[LOG] Docker container(s) startup failed!
{code}

Actually the docker service is now completely broken on the host:
{code}
[jenkins@ip-172-31-8-79 ~]$ docker run -ti --rm bigtop/puppet:trunk-centos-7 bash
docker: Error response from daemon: cgroups: cannot find cgroup mount destination: unknown.
{code}

Restart docker service seems to be no help. The only way I know to recover is to reboot the host.

  was:
To reproduce the issue:
* Step 0: get an amazon linux. The one I used for test (Bigtop CI node slave02)
 * Amazon Linux AMI release 2018.03
 * Docker version 18.06.1-ce, build e68fc7a215d7133c34aa18e3b72b4a21fd0c6136
 * docker-compose version 1.23.1, build b02f1306
 * Bigtop master cobebase
* Step 1: cd bigtop/provisioner/docker
* Step 2: ./docker-hadoop -c 1
* Step 3: ./docker-hadoop -d
* Step 4: ./docker-hadoop -c 1
{code}
[jenkins@ip-172-31-8-79 docker]$ ./docker-hadoop.sh -c 1
Environment check...
Check docker:
Docker version 18.06.1-ce, build e68fc7a215d7133c34aa18e3b72b4a21fd0c6136
Check docker-compose:
docker-compose version 1.23.1, build b02f1306
Check ruby:
ruby 2.0.0p648 (2015-12-16) [x86_64-linux]
Creating 20181228_155211_r21927_bigtop_1_8d56e66d2866 ... error

ERROR: for 20181228_155211_r21927_bigtop_1_8d56e66d2866  Cannot start service bigtop: b'cgroups: cannot find cgroup mount destination: unknown'

ERROR: for bigtop  Cannot start service bigtop: b'cgroups: cannot find cgroup mount destination: unknown'
ERROR: Encountered errors while bringing up the project.

[LOG] Docker container(s) startup failed!
{code}

Actually the docker service is now completely broken on the host:
{code}
[jenkins@ip-172-31-8-79 ~]$ docker run -ti --rm bigtop/puppet:trunk-centos-7 bash
docker: Error response from daemon: cgroups: cannot find cgroup mount destination: unknown.
{code}

Restart docker service seems to be no help. The only way I know to recover is to reboot the host.


> [Provisioner] Can't recreate Bigtop cluster using Docker Provisioner
> --------------------------------------------------------------------
>
>                 Key: BIGTOP-3121
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3121
>             Project: Bigtop
>          Issue Type: Sub-task
>          Components: provisioner
>    Affects Versions: 1.3.0
>            Reporter: Evans Ye
>            Priority: Major
>
> To reproduce the issue:
> * Step 0: get an amazon linux. The one I used for test (Bigtop CI node slave02)
>  ** Amazon Linux AMI release 2018.03
>  ** Docker version 18.06.1-ce, build e68fc7a215d7133c34aa18e3b72b4a21fd0c6136
>  ** docker-compose version 1.23.1, build b02f1306
>  ** Bigtop master cobebase
> * Step 1: cd bigtop/provisioner/docker
> * Step 2: ./docker-hadoop -c 1
> * Step 3: ./docker-hadoop -d
> * Step 4: ./docker-hadoop -c 1
> {code}
> [jenkins@ip-172-31-8-79 docker]$ ./docker-hadoop.sh -c 1
> Environment check...
> Check docker:
> Docker version 18.06.1-ce, build e68fc7a215d7133c34aa18e3b72b4a21fd0c6136
> Check docker-compose:
> docker-compose version 1.23.1, build b02f1306
> Check ruby:
> ruby 2.0.0p648 (2015-12-16) [x86_64-linux]
> Creating 20181228_155211_r21927_bigtop_1_8d56e66d2866 ... error
> ERROR: for 20181228_155211_r21927_bigtop_1_8d56e66d2866  Cannot start service bigtop: b'cgroups: cannot find cgroup mount destination: unknown'
> ERROR: for bigtop  Cannot start service bigtop: b'cgroups: cannot find cgroup mount destination: unknown'
> ERROR: Encountered errors while bringing up the project.
> [LOG] Docker container(s) startup failed!
> {code}
> Actually the docker service is now completely broken on the host:
> {code}
> [jenkins@ip-172-31-8-79 ~]$ docker run -ti --rm bigtop/puppet:trunk-centos-7 bash
> docker: Error response from daemon: cgroups: cannot find cgroup mount destination: unknown.
> {code}
> Restart docker service seems to be no help. The only way I know to recover is to reboot the host.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)