You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mesos.apache.org by gi...@apache.org on 2018/10/08 17:43:39 UTC
[mesos] branch 1.7.x updated (1ecc3c6 -> 3e185f1)
This is an automated email from the ASF dual-hosted git repository.
gilbert pushed a change to branch 1.7.x
in repository https://gitbox.apache.org/repos/asf/mesos.git.
from 1ecc3c6 Added MESOS-9283 to the 1.7.x CHANGELOG.
new e9a2d1a Fixed the nested container launch failure on the agent upgrade case.
new 3e185f1 Added MESOS-9295 to 1.7.1 CHANGELOG.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGELOG | 1 +
.../mesos/isolators/cgroups/cgroups.cpp | 34 +++++++++++++++++-----
2 files changed, 27 insertions(+), 8 deletions(-)
[mesos] 01/02: Fixed the nested container launch failure on the
agent upgrade case.
Posted by gi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
gilbert pushed a commit to branch 1.7.x
in repository https://gitbox.apache.org/repos/asf/mesos.git
commit e9a2d1a7dbba1e7900417461a935b284243e79a4
Author: Gilbert Song <so...@gmail.com>
AuthorDate: Thu Oct 4 16:54:24 2018 -0700
Fixed the nested container launch failure on the agent upgrade case.
If there are new cgroup subsystems are added after the agent upgrad
or recovery, new nested container launched under old containers that
are launched before the recovery would fail, because it cannot assign
its pid to the non-existed cgroup hierarchy. We should skip those
new cgroup subsystems for nested containers under old containers.
Review: https://reviews.apache.org/r/68929
(cherry picked from commit 200a532d33b647cc26d9566bbc1765bc039e699d)
---
.../mesos/isolators/cgroups/cgroups.cpp | 34 +++++++++++++++++-----
1 file changed, 26 insertions(+), 8 deletions(-)
diff --git a/src/slave/containerizer/mesos/isolators/cgroups/cgroups.cpp b/src/slave/containerizer/mesos/isolators/cgroups/cgroups.cpp
index 11dfbab..fbb1b43 100644
--- a/src/slave/containerizer/mesos/isolators/cgroups/cgroups.cpp
+++ b/src/slave/containerizer/mesos/isolators/cgroups/cgroups.cpp
@@ -340,10 +340,13 @@ Future<Nothing> CgroupsIsolatorProcess::___recover(
// TODO(haosdent): Use foreachkey once MESOS-5037 is resolved.
foreach (const string& hierarchy, subsystems.keys()) {
if (!cgroups::exists(hierarchy, cgroup)) {
- // This may occur if the executor has exited and the isolator
- // has destroyed the cgroup but the agent dies before noticing
- // this. This will be detected when the containerizer tries to
- // monitor the executor's pid.
+ // This may occur in two cases:
+ // 1. If the executor has exited and the isolator has destroyed
+ // the cgroup but the agent dies before noticing this. This
+ // will be detected when the containerizer tries to monitor
+ // the executor's pid.
+ // 2. After the agent recovery/upgrade, new cgroup subsystems
+ // are added to the agent cgroup isolation configuration.
LOG(WARNING) << "Couldn't find the cgroup '" << cgroup << "' "
<< "in hierarchy '" << hierarchy << "' "
<< "for container " << containerId;
@@ -677,18 +680,33 @@ Future<Nothing> CgroupsIsolatorProcess::isolate(
return Failure("Failed to isolate the container: Unknown root container");
}
+ const string& cgroup = infos[rootContainerId]->cgroup;
+
// TODO(haosdent): Use foreachkey once MESOS-5037 is resolved.
foreach (const string& hierarchy, subsystems.keys()) {
+ // If new cgroup subsystems are added after the agent
+ // upgrade, the newly added cgroup subsystems do not
+ // exist on old container's cgroup hierarchy. So skip
+ // assigning the pid to this cgroup subsystem.
+ if (containerId.has_parent() && !cgroups::exists(hierarchy, cgroup)) {
+ LOG(INFO) << "Skipping assigning pid " << stringify(pid)
+ << " to cgroup at '" << path::join(hierarchy, cgroup)
+ << "' for container " << containerId
+ << " because its parent container " << containerId.parent()
+ << " does not have this cgroup hierarchy";
+ continue;
+ }
+
Try<Nothing> assign = cgroups::assign(
hierarchy,
- infos[rootContainerId]->cgroup,
+ cgroup,
pid);
if (assign.isError()) {
string message =
- "Failed to assign pid " + stringify(pid) + " to cgroup at "
- "'" + path::join(hierarchy, infos[rootContainerId]->cgroup) + "'"
- ": " + assign.error();
+ "Failed to assign container " + stringify(containerId) +
+ " pid " + stringify(pid) + " to cgroup at '" +
+ path::join(hierarchy, cgroup) + "': " + assign.error();
LOG(ERROR) << message;
[mesos] 02/02: Added MESOS-9295 to 1.7.1 CHANGELOG.
Posted by gi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
gilbert pushed a commit to branch 1.7.x
in repository https://gitbox.apache.org/repos/asf/mesos.git
commit 3e185f14075b827b8ea3b03a48ed2cd136ce8158
Author: Gilbert Song <so...@gmail.com>
AuthorDate: Mon Oct 8 10:34:27 2018 -0700
Added MESOS-9295 to 1.7.1 CHANGELOG.
(cherry picked from commit e135b7f2175c01fd67b71b22cdc325ac37853a9d)
---
CHANGELOG | 1 +
1 file changed, 1 insertion(+)
diff --git a/CHANGELOG b/CHANGELOG
index 2687777..75be171 100644
--- a/CHANGELOG
+++ b/CHANGELOG
@@ -15,6 +15,7 @@ Release Notes - Mesos - Version 1.7.1 (WIP)
* [MESOS-9274] - v1 JAVA scheduler library can drop TEARDOWN upon destruction.
* [MESOS-9279] - Docker Containerizer 'usage' call might be expensive if mount table is big.
* [MESOS-9283] - Docker containerizer actor can get backlogged with large number of containers.
+ * [MESOS-9295] - Nested container launch could fail if the agent upgrade with new cgroup subsystems.
** Improvement:
* [MESOS-6765] - Make the Resources wrapper "copy-on-write" to improve performance.