You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@aurora.apache.org by ma...@apache.org on 2015/09/22 00:37:02 UTC
aurora git commit: Adding oversubscription summary.
Repository: aurora
Updated Branches:
refs/heads/master 9d780262d -> 88a6f249e
Adding oversubscription summary.
Bugs closed: AURORA-1441
Reviewed at https://reviews.apache.org/r/38390/
Project: http://git-wip-us.apache.org/repos/asf/aurora/repo
Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/88a6f249
Tree: http://git-wip-us.apache.org/repos/asf/aurora/tree/88a6f249
Diff: http://git-wip-us.apache.org/repos/asf/aurora/diff/88a6f249
Branch: refs/heads/master
Commit: 88a6f249e31c31392cabf19c8691be1fd1c40cbb
Parents: 9d78026
Author: Maxim Khutornenko <ma...@apache.org>
Authored: Mon Sep 21 15:36:46 2015 -0700
Committer: Maxim Khutornenko <ma...@apache.org>
Committed: Mon Sep 21 15:36:46 2015 -0700
----------------------------------------------------------------------
docs/configuration-reference.md | 17 +++++++++++++++++
docs/deploying-aurora-scheduler.md | 16 ++++++++++++++++
2 files changed, 33 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/aurora/blob/88a6f249/docs/configuration-reference.md
----------------------------------------------------------------------
diff --git a/docs/configuration-reference.md b/docs/configuration-reference.md
index ad2701c..8d50c45 100644
--- a/docs/configuration-reference.md
+++ b/docs/configuration-reference.md
@@ -26,6 +26,7 @@ Aurora + Thermos Configuration Reference
- [Job Schema](#job-schema)
- [Job Objects](#job-objects)
- [Services](#services)
+ - [Revocable Jobs](#revocable-jobs)
- [UpdateConfig Objects](#updateconfig-objects)
- [HealthCheckConfig Objects](#healthcheckconfig-objects)
- [Announcer Objects](#announcer-objects)
@@ -328,6 +329,7 @@ Job Schema
```health_check_config``` | ```heath_check_config``` object | Parameters for controlling a task's health checks via HTTP. Only used if a health port was assigned with a command line wildcard.
```container``` | ```Container``` object | An optional container to run all processes inside of.
```lifecycle``` | ```LifecycleConfig``` object | An optional task lifecycle configuration that dictates commands to be executed on startup/teardown. HTTP lifecycle is enabled by default if the "health" port is requested. See [LifecycleConfig Objects](#lifecycleconfig-objects) for more information.
+ ```tier``` | String | Task tier type. When set to `revocable` requires the task to run with Mesos revocable resources. This is work [in progress](https://issues.apache.org/jira/browse/AURORA-1343) and is currently only supported for the revocable tasks. The ultimate goal is to simplify task configuration by hiding various configuration knobs behind a task tier definition. See AURORA-1343 and AURORA-1443 for more details.
### Services
@@ -339,6 +341,21 @@ Jobs without the service bit set only restart up to
`max_task_failures` times and only if they terminated unsuccessfully
either due to human error or machine failure.
+### Revocable Jobs
+
+**WARNING**: This feature is currently in alpha status. Do not use it in production clusters!
+
+Mesos [supports a concept of revocable tasks](http://mesos.apache.org/documentation/latest/oversubscription/)
+by oversubscribing machine resources by the amount deemed safe to not affect the existing
+non-revocable tasks. Aurora now supports revocable jobs via a `tier` setting set to `revocable`
+value.
+
+More implementation details in this [ticket](https://issues.apache.org/jira/browse/AURORA-1343).
+
+Scheduler must be [configured](deploying-aurora-scheduler.md#configuring-resource-oversubscription)
+to receive revocable offers from Mesos and accept revocable jobs. If not configured properly
+revocable tasks will never get assigned to hosts and will stay in PENDING.
+
### UpdateConfig Objects
Parameters for controlling the rate and policy of rolling updates.
http://git-wip-us.apache.org/repos/asf/aurora/blob/88a6f249/docs/deploying-aurora-scheduler.md
----------------------------------------------------------------------
diff --git a/docs/deploying-aurora-scheduler.md b/docs/deploying-aurora-scheduler.md
index 8db0e61..2a46d2f 100644
--- a/docs/deploying-aurora-scheduler.md
+++ b/docs/deploying-aurora-scheduler.md
@@ -14,6 +14,7 @@ machines. This guide helps you get the scheduler set up and troubleshoot some c
- [Network considerations](#network-considerations)
- [Considerations for running jobs in docker](#considerations-for-running-jobs-in-docker)
- [Security Considerations](#security-considerations)
+ - [Configuring Resource Oversubscription](#configuring-resource-oversubscription)
- [Running Aurora](#running-aurora)
- [Maintaining an Aurora Installation](#maintaining-an-aurora-installation)
- [Monitoring](#monitoring)
@@ -190,6 +191,21 @@ assuming you set `-http_port=8081`.
See [security.md](security.md).
+## Configuring Resource Oversubscription
+
+**WARNING**: This feature is currently in alpha status. Do not use it in production clusters!
+See [this document](configuration-reference.md#revocable-jobs) for more feature details.
+
+Set these scheduler flag to allow receiving revocable Mesos offers:
+
+ -receive_revocable_resources=true
+
+Specify a tier configuration file path:
+
+ -tier_config=path/to/tiers/config.json
+
+Example [tier configuration file](../src/test/resources/org/apache/aurora/scheduler/tiers-example.json).
+
### Maintaining an Aurora Installation
### Monitoring