[jira] [Commented] (FLINK-7077) Implement task release to support dynamic scaling

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16131597#comment-16131597 ] 

ASF GitHub Bot commented on FLINK-7077:
---------------------------------------

GitHub user EronWright opened a pull request:

    https://github.com/apache/flink/pull/4560

    Flink 7077

    ## Description
    
    _This PR extends #4555 - please disregard commits from Aug 16, 2017._ 
    
    [FLINK-7077] [mesos] Implement task release to support dynamic scaling
        
        - SlotManager: fix for idleness tracking (`markIdle` shouldn't reset `idleSince` on every call)
        - ResourceManager: change `stopWorker` method to use `ResourceID`
        - ResourceManager: schedule callbacks from `ResourceManagerActions` onto main thread
        - MesosResourceManager: implement `stopWorker`
        - MesosResourceManager: fix for message routing from child actors to RM
    
    This change added tests and can be verified as follows:
    - `MesosResourceManagerTest::testStopWorker`
    
    ## Does this pull request potentially affect one of the following parts:
    
      - Dependencies (does it add or upgrade a dependency): **no**
      - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: **no**
      - The serializers: **no**
      - The runtime per-record code paths (performance sensitive): **no**
      - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: **no**
    
    ## Documentation
    
      - Does this pull request introduce a new feature? **no**


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/EronWright/flink FLINK-7077

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/4560.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #4560
    
----
commit 7d257db84f4b9bf2a02d1375a04ff64516266186
Author: Wright, Eron <er...@emc.com>
Date:   2017-08-16T21:30:24Z

    [FLINK-6630] Implement FLIP-6 MesosAppMasterRunner
    [FLINK-6631] Implement FLIP-6 MesosTaskExecutorRunner
    
    - bin: new entrypoints scripts for flip-6
    - ClusterEntrypoint: Refactor the shutdown method
    - ClusterEntrypoint: Install default FileSystem (for parity with legacy entrypoints)
    - ClusterEntrypoint: new MesosJobClusterEntrypoint, MesosSessionClusterEntrypoint, MesosEntrypointUtils, MesosTaskExecutorRunner
    - MesosServices: enhanced with artifactServer, localActorSystem
    - MesosResourceManager: Fallback to old TM params when UNKNOWN resource profile is provided
    - MesosResourceManager: config setting for taskmanager startup script (mesos.resourcemanager.tasks.taskmanager-cmd)
    - test: added a 'noop' job graph for testing purposes

commit 4cbcde3095774f4ea6484a4cfd07df613fe08d30
Author: Wright, Eron <er...@emc.com>
Date:   2017-08-16T22:40:47Z

    [FLINK-6630] [Mesos] Implement FLIP-6 MesosAppMasterRunner
    
    - removed `streaming-noop-3.graph` since it can be generated using `StreamingNoop` program.

commit 691d04efb0d1a44db8b0ef11a504355e6e3d49aa
Author: Wright, Eron <er...@emc.com>
Date:   2017-08-18T01:22:55Z

    [FLINK-7077] [mesos] Implement task release to support dynamic scaling
    
    - SlotManager: fix for idleness tracking (`markIdle` shouldn't reset `idleSince` on every call)
    - ResourceManager: change `stopWorker` method to use `ResourceID`
    - ResourceManager: schedule callbacks from `ResourceManagerActions` onto main thread
    - MesosResourceManager: implement `stopWorker`
    - MesosResourceManager: fix for message routing from child actors to RM

----


> Implement task release to support dynamic scaling
> -------------------------------------------------
>
>                 Key: FLINK-7077
>                 URL: https://issues.apache.org/jira/browse/FLINK-7077
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Mesos, ResourceManager
>            Reporter: Till Rohrmann
>
> In order to support dynamic scaling, the {{MesosResourceManager}} has to be able to release Mesos tasks. We have to implement {{MesosResourceManager#stopWorker}} for that.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)