You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Evans Ye (JIRA)" <ji...@apache.org> on 2018/12/28 16:30:00 UTC
[jira] [Comment Edited] (BIGTOP-3111) [Provisioner] docker
provisioner does not honor memory_limit setting
[ https://issues.apache.org/jira/browse/BIGTOP-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730359#comment-16730359 ]
Evans Ye edited comment on BIGTOP-3111 at 12/28/18 4:29 PM:
------------------------------------------------------------
Hi [~jun.he] actually this is straight forward. But sorry I did not attach a description at the very beginning. The issue is the memory for a container created by Docker Provisioner is still all it can get from the host. See what we got from a container created by Docker Provisioner on Amazon Linux:
{code}
$ cat config.yaml
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
docker:
memory_limit: "3g"
image: "bigtop/puppet:trunk-centos-7"
repo: "http://repos.bigtop.apache.org/releases/1.3.0/centos/7/$basearch"
distro: centos
components: [hdfs]
enable_local_repo: false
smoke_test_components: [hdfs, yarn, mapreduce]
$ ./docker-hadoop.sh -e 1 bash
WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
[root@60dba6fac112 /]# free -m
total used free shared buff/cache available
Mem: 14741 434 13083 8 1224 14117
Swap: 0 0 0
{code}
It should be 3GB instead.
was (Author: evans_ye):
Hi [~jun.he] actually this is straight forward. But sorry I did not attach a description at the very beginning. The issue is the memory for a container created by Docker Provisioner is still all it can get from the host. See what we got from a container created by Docker Provisioner on Amazon Linux:
{code}
$ cat config.yaml
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
docker:
memory_limit: "3g"
image: "bigtop/puppet:trunk-centos-7"
repo: "http://repos.bigtop.apache.org/releases/1.3.0/centos/7/$basearch"
distro: centos
components: [hdfs]
enable_local_repo: false
smoke_test_components: [hdfs, yarn, mapreduce]
$ ./docker-hadoop.sh -e 1 bash
WARNING: The DOCKER_IMAGE variable is not set. Defaulting to a blank string.
WARNING: The MEM_LIMIT variable is not set. Defaulting to a blank string.
[root@60dba6fac112 /]# free -m
total used free shared buff/cache available
Mem: 14741 434 13083 8 1224 14117
Swap: 0 0 0
{code}
> [Provisioner] docker provisioner does not honor memory_limit setting
> --------------------------------------------------------------------
>
> Key: BIGTOP-3111
> URL: https://issues.apache.org/jira/browse/BIGTOP-3111
> Project: Bigtop
> Issue Type: Sub-task
> Components: provisioner
> Affects Versions: 1.3.0
> Environment: Docker on Mac, Amazon Linux
> Reporter: Evans Ye
> Assignee: Jun He
> Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)