You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by KurtYoung <gi...@git.apache.org> on 2016/09/14 07:42:05 UTC
[GitHub] flink pull request #2497: [FLINK-4339][cluster management] Implement Slot Po...
GitHub user KurtYoung opened a pull request:
https://github.com/apache/flink/pull/2497
[FLINK-4339][cluster management] Implement Slot Pool core on JobManager
Introduce __SlotDescriptor__ to hold static information of a __Slot__. __Slot__ is used as runtime objects and contains dynamic information such as status and running tasks.
Introduce __SlotPool__:
* The slot pool serves slot request issued by Scheduler or ExecutionGraph. It will will attempt to acquire new slots from the ResourceManager when it cannot serve a slot request. If no ResourceManager is currently available, or it gets a decline from the ResourceManager, or a request times out, it fails the slot request.
* The slot pool also holds all the slots that were offered to it and accepted, and can thus provides registered free slots even if the ResourceManager is down.
* The slots will only be released when they are useless, e.g. when the job is fully running but we still have some free slots.
* All the allocation or the slot offering will be identified by self generated AllocationID, we will use it to eliminate ambiguities.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/KurtYoung/flink flink-4339
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2497.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2497
----
commit a958b6205e55762effe5c3692154d92c617c781c
Author: Kurt Young <yk...@gmail.com>
Date: 2016-09-08T10:04:31Z
[FLINK-4339][cluster management] Implement Slot Pool core on JobManager side
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink issue #2497: [FLINK-4339][cluster management] Implement Slot Pool core...
Posted by KurtYoung <gi...@git.apache.org>.
Github user KurtYoung commented on the issue:
https://github.com/apache/flink/pull/2497
rebased to the latest flip-6 and use flink's own Future instead of scala's Future
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink issue #2497: [FLINK-4339][cluster management] Implement Slot Pool core...
Posted by KurtYoung <gi...@git.apache.org>.
Github user KurtYoung commented on the issue:
https://github.com/apache/flink/pull/2497
This PR now bases on #2588 , only the last commit is related.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink issue #2497: [FLINK-4339][cluster management] Implement Slot Pool core...
Posted by StephanEwen <gi...@git.apache.org>.
Github user StephanEwen commented on the issue:
https://github.com/apache/flink/pull/2497
Merged into the `flip-6` feature branch in 48c936eeda7b265f32bbf9f14d15f78eae15c06f
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink pull request #2497: [FLINK-4339][cluster management] Implement Slot Po...
Posted by KurtYoung <gi...@git.apache.org>.
Github user KurtYoung closed the pull request at:
https://github.com/apache/flink/pull/2497
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---