[jira] [Updated] (YARN-2882) Introducing container types

["Konstantinos Karanasos (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Konstantinos Karanasos updated YARN-2882:
-----------------------------------------
    Attachment: YARN-2882-yarn-2877.001.patch

I am uploading a new version of the patch for the GUARANTEED/QUEUEABLE containers.

Based on offline discussions with [~asuresh], [~chris.douglas], [~curino], [~subru] and [~sriramsrao], we decided to not extend the ContainerType (used to differentiate between AM and plain tasks; see YARN-3116) to include the GUARANTEED/QUEUEABLE containers distinction.

Instead, we are introducing a new enum type, the *ExecutionType*, to denote whether a container will be GUARANTEED or QUEUEABLE.

The main reason behind this decision is that it allows us to characterize a container as GUARANTEED or QUEUEABLE, regardless of whether it is an AM container or a plain task. Thus, the ExecutionType is now orthogonal to the ContainerType of YARN-3116.
Moreover, this differentiation makes it easier to extend the system in the future by adding new Execution Types.

Note that ExecutionType is used in both the ResourceRequest (for the AM to specify the desired execution/scheduling type) and the ContainerTokenIdentifier (used to determine the way a container is actually executed in the NM).

> Introducing container types
> ---------------------------
>
>                 Key: YARN-2882
>                 URL: https://issues.apache.org/jira/browse/YARN-2882
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Konstantinos Karanasos
>            Assignee: Konstantinos Karanasos
>         Attachments: YARN-2882-yarn-2877.001.patch, yarn-2882.patch
>
>
> This JIRA introduces the notion of container types.
> We propose two initial types of containers: guaranteed-start and queueable containers.
> Guaranteed-start are the existing containers, which are allocated by the central RM and are instantaneously started, once allocated.
> Queueable is a new type of container, which allows containers to be queued in the NM, thus their execution may be arbitrarily delayed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)