You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/08/01 05:09:20 UTC
[jira] [Commented] (FLINK-1984) Integrate Flink with Apache Mesos
[ https://issues.apache.org/jira/browse/FLINK-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15401532#comment-15401532 ]
ASF GitHub Bot commented on FLINK-1984:
---------------------------------------
GitHub user EronWright opened a pull request:
https://github.com/apache/flink/pull/2315
[FLINK-1984] Integrate Flink with Apache Mesos (T1)
Part one ("T1") of Flink on Mesos.
Implemented Mesos AppMaster including:
- runners for AppMaster and TaskManager
- MesosFlinkResourceManager as a Mesos framework
- ZK persistent storage for Mesos tasks
- reusable scheduler actors for:
- offer handling using Netflix Fenzo (LaunchCoordinator)
- reconciliation (ReconciliationCoordinator)
- task monitoring (TaskMonitor)
- connection monitoring (ConnectionMonitor)
- lightweight HTTP server to serve artifacts to the Mesos fetcher (ArtifactServer)
- scenario-based logging for:
- connectivity issues
- offer handling (receive, process, decline, rescind, accept)
- incorporated FLINK-4152, FLINK-3904, FLINK-4141, FLINK-3675, FLINK-4166
Docs aren't yet provided; to be provided when client changes come in.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/EronWright/flink feature-FLINK-1984-T1
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2315.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2315
----
commit 942bf02e28d44a5907b0c8d86f5eb94dfedb423b
Author: wrighe3 <er...@emc.com>
Date: 2016-07-14T07:12:49Z
[FLINK-1984] Mesos ResourceManager - T1 milestone
Implemented Mesos AppMaster including:
- runners for AppMaster and TaskManager
- MesosFlinkResourceManager as a Mesos framework
- ZK persistent storage for Mesos tasks
- reusable scheduler actors for:
- offer handling using Netflix Fenzo (LaunchCoordinator)
- reconciliation (ReconciliationCoordinator)
- task monitoring (TaskMonitor)
- connection monitoring (ConnectionMonitor)
- lightweight HTTP server to serve artifacts to the Mesos fetcher (ArtifactServer)
- scenario-based logging for:
- connectivity issues
- offer handling (receive, process, decline, rescind, accept)
- incorporated FLINK-4152, FLINK-3904, FLINK-4141, FLINK-3675, FLINK-4166
----
> Integrate Flink with Apache Mesos
> ---------------------------------
>
> Key: FLINK-1984
> URL: https://issues.apache.org/jira/browse/FLINK-1984
> Project: Flink
> Issue Type: New Feature
> Components: Cluster Management
> Reporter: Robert Metzger
> Assignee: Eron Wright
> Priority: Minor
> Attachments: 251.patch
>
>
> There are some users asking for an integration of Flink into Mesos.
> -There also is a pending pull request for adding Mesos support for Flink-: https://github.com/apache/flink/pull/251
> Update (May '16): a new effort is now underway, building on the recent ResourceManager work.
> Design document: ([google doc|https://docs.google.com/document/d/1WItafBmGbjlaBbP8Of5PAFOH9GUJQxf5S4hjEuPchuU/edit?usp=sharing])
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)