You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/11/30 08:41:58 UTC
[jira] [Commented] (FLINK-5091) Formalize the AppMaster environment
for docker compability
[ https://issues.apache.org/jira/browse/FLINK-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707963#comment-15707963 ]
ASF GitHub Bot commented on FLINK-5091:
---------------------------------------
GitHub user EronWright opened a pull request:
https://github.com/apache/flink/pull/2904
[FLINK-5091] Formalize the Mesos AppMaster environment for docker compatibility
Fixes FLINK-5091 and FLINK-4826.
- introduced ContainerSpecification.
- reworked how the TM container environment is constructed; eliminated
special-case environment variables, file layout.
- added dynamic configuration support to GlobalConfiguration.
- integrated the SecurityContext into AM/TM runners.
- added config setting for Mesos framework user.
- support DCOS side-channel authentication.
- set the FS default scheme.
- made the artifact server more generic (no assumption about existence
of dispatcher, Path-based).
- moved some test code related to overriding the JVM’s env.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/EronWright/flink feature-FLINK-5091
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2904.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2904
----
commit 82342491b2996f5086fd17f3b24ca588e783b8d4
Author: wrighe3 <er...@emc.com>
Date: 2016-11-17T19:33:40Z
[FLINK-4921] Upgrade to Mesos 1.0.1
Updated the Mesos dependency, to unlock some new features (notably the
ability to fetch into sandbox sub-directories).
Shaded the protobuf dependency because the new Mesos library depends on
a newer version than does akka-remoting.
commit abaf2b4b3eb7c9978bdbcdc4d8c59617b86be664
Author: wrighe3 <er...@emc.com>
Date: 2016-11-30T08:34:58Z
[FLINK-5091] Formalize the Mesos AppMaster environment for docker compability
Fixes FLINK-5091 and FLINK-4826.
- introduced ContainerSpecification.
- reworked how the TM container environment is constructed; eliminated
special-case environment variables, file layout.
- added dynamic configuration support to GlobalConfiguration.
- integrated the SecurityContext into AM/TM runners.
- added config setting for Mesos framework user.
- support DCOS side-channel authentication.
- set the FS default scheme.
- made the artifact server more generic (no assumption about existence
of dispatcher, Path-based).
- moved some test code related to overriding the JVM’s env.
----
> Formalize the AppMaster environment for docker compability
> ----------------------------------------------------------
>
> Key: FLINK-5091
> URL: https://issues.apache.org/jira/browse/FLINK-5091
> Project: Flink
> Issue Type: Sub-task
> Components: Cluster Management, Mesos
> Reporter: Eron Wright
> Assignee: Eron Wright
> Fix For: 1.2.0
>
>
> For scenarios where the AppMaster is launched from a docker image, it would be ideal to use the installed Flink rather than rely on a special file layout in the sandbox directory.
> This is related to DCOS integration, which (in 1.2) will launch the AppMaster via Marathon (as a top-level DCOS service). The existing code assumed that only the dispatcher (coming in 1.3) would launch the AppMaster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)