[jira] [Commented] (YARN-6041) Opportunistic containers : Combined patch for branch-2

["Wangda Tan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15786416#comment-15786416 ] 

Wangda Tan commented on YARN-6041:
----------------------------------

Removed 2.9.0 from fixVersion, it should be target version.

Just do a very quick scan of the patch, it looks changes are isolated to distributed scheduling logic inside RM, should be relatively safe. But I hope to get someone more familiar with the overall opportunistic scheduling logic to make sure it has less impact to existing logics (especially NM). ([~kasha]?)

Two minor comments for compatibility:
1) ContainerState.java: Mark SCHEDULED to unstable?
2) All new configurations to YarnConfigration.java should be @Unstable. 

And not sure if there's incomplete changes to public (regardless of stablebility) APIs / configs, we should not merge any API-only changes to branch-2.

> Opportunistic containers : Combined patch for branch-2 
> -------------------------------------------------------
>
>                 Key: YARN-6041
>                 URL: https://issues.apache.org/jira/browse/YARN-6041
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Arun Suresh
>            Assignee: Arun Suresh
>         Attachments: YARN-6041-branch-2.001.patch
>
>
> This is a combined patch targeting branch-2 of the following JIRAs which have already been committed to trunk :
> YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes
> YARN-5646. Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers.
> YARN-5982. Simplify opportunistic container parameters and metrics.
> YARN-5918. Handle Opportunistic scheduling allocate request failure when NM is lost.
> YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle.
> YARN-5823. Update NMTokens in case of requests with only opportunistic containers.
> YARN-5377. Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers.
> YARN-2995. Enhance UI to show cluster resource utilization of various container Execution types.
> YARN-5799. Fix Opportunistic Allocation to set the correct value of Node Http Address.
> YARN-5486. Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org