You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by tillrohrmann <gi...@git.apache.org> on 2017/07/31 16:53:30 UTC
[GitHub] flink pull request #4435: [FLINK-7320] [futures] Replace Flink's futures wit...
GitHub user tillrohrmann opened a pull request:
https://github.com/apache/flink/pull/4435
[FLINK-7320] [futures] Replace Flink's futures with Java 8's CompletableFuture in Scheduler
## What is the purpose of the change
Replace Flink's futures with Java 8's CompletableFuture in Scheduler.
This PR is based on #4433.
## Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (no)
- The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (no)
- Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)
## Documentation
- Does this pull request introduce a new feature? (no)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tillrohrmann/flink rfScheduler
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4435.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4435
----
commit afe1d171132bb3724e672a1c4ce74a3f7c185908
Author: Till Rohrmann <tr...@apache.org>
Date: 2017-07-31T13:07:18Z
[FLINK-7313] [futures] Add Flink future and Scala future to Java 8 CompletableFuture conversion
Add DirectExecutionContext
Add Scala Future to Java 8 CompletableFuture utility to FutureUtils
Add Flink future to Java 8's CompletableFuture conversion utility to FutureUtils
Add base class for Flink's unchecked future exceptions
commit 84dbf47a47e3f73bcf52db112efc36cb47f43180
Author: Till Rohrmann <tr...@apache.org>
Date: 2017-07-31T15:55:06Z
[FLINK-7318] [futures] Replace Flink's futures in StackTraceSampleCoordinator with Java 8 CompletableFuture
commit 2fa9a9ebe5c669b6b9b20ec427d3faf10ffe5712
Author: Till Rohrmann <tr...@apache.org>
Date: 2017-07-31T13:53:48Z
[FLINK-7314] [futures] Replace Flink's futures with CompletableFuture in TaskManagerLogHandler
commit f0344e4b554f440f966cd481ac245941d8a465ad
Author: Till Rohrmann <tr...@apache.org>
Date: 2017-07-31T16:06:20Z
[FLINK-7319] [futures] Replace Flink's Futures with Java 8 CompletableFuture in MesosResourceManager
commit d37fc6bd262d57324ee5f5b6e163b7450de9e286
Author: Till Rohrmann <tr...@apache.org>
Date: 2017-07-31T14:33:21Z
[FLINK-7317] [futures] Replace Flink's futures with Java 8's CompletableFuture in ExecutionGraph
Change FutureUtils.retry to work with CompletableFutures
Let ConjunctFutures extends CompletableFuture
Remove Flink's futures from ExecutionGraph
commit 62e01ca2cfd6f41fbdbd0640e52a81f92f3baeae
Author: Till Rohrmann <tr...@apache.org>
Date: 2017-07-31T16:37:00Z
[FLINK-7320] [futures] Replace Flink's futures with Java 8's CompletableFuture in Scheduler
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink pull request #4435: [FLINK-7320] [futures] Replace Flink's futures wit...
Posted by zentol <gi...@git.apache.org>.
Github user zentol commented on a diff in the pull request:
https://github.com/apache/flink/pull/4435#discussion_r130428135
--- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/scheduler/Scheduler.java ---
@@ -152,12 +150,14 @@ else if (ret instanceof Future) {
}
}
catch (NoResourceAvailableException e) {
- return FlinkCompletableFuture.completedExceptionally(e);
+ CompletableFuture<SimpleSlot> notEnoughResources = new CompletableFuture<>();
--- End diff --
How about introducing a utility method to create an exceptionally completed `CompletableFuture` in one line?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink pull request #4435: [FLINK-7320] [futures] Replace Flink's futures wit...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/flink/pull/4435
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink issue #4435: [FLINK-7320] [futures] Replace Flink's futures with Java ...
Posted by tillrohrmann <gi...@git.apache.org>.
Github user tillrohrmann commented on the issue:
https://github.com/apache/flink/pull/4435
Thanks for the review @zentol. Merging this PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] flink pull request #4435: [FLINK-7320] [futures] Replace Flink's futures wit...
Posted by tillrohrmann <gi...@git.apache.org>.
Github user tillrohrmann commented on a diff in the pull request:
https://github.com/apache/flink/pull/4435#discussion_r130591837
--- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/scheduler/Scheduler.java ---
@@ -152,12 +150,14 @@ else if (ret instanceof Future) {
}
}
catch (NoResourceAvailableException e) {
- return FlinkCompletableFuture.completedExceptionally(e);
+ CompletableFuture<SimpleSlot> notEnoughResources = new CompletableFuture<>();
--- End diff --
I actually did in one of the other up PRs. I'll try to merge this one first and then adapt the code here.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---