You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "Chandni Singh (JIRA)" <ji...@apache.org> on 2018/07/24 01:42:00 UTC
[jira] [Comment Edited] (APEXCORE-796) Docker based deployment
[ https://issues.apache.org/jira/browse/APEXCORE-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553655#comment-16553655 ]
Chandni Singh edited comment on APEXCORE-796 at 7/24/18 1:41 AM:
-----------------------------------------------------------------
{quote}I thought the goal is to not have to depend on YARN in the first place.
{quote}
Don't see that mention anywhere in this Jira.
APEX is very tightly coupled to YARN. It is a YARN application that uses the YARN abstractions. Decoupling from YARN will be a substantial effort for APEX.
The description says
{quote}This will be particularly helpful when applications depend on native, non-JVM packages like Python and R, that otherwise need to be installed separately.
{quote}
YARN supports running docker containers, which is via YARN-3611, it will be helpful for running dockerized APEX operators. This, in my opinion, is easier and faster to accomplish.
was (Author: csingh):
{quote}I thought the goal is to not have to depend on YARN in the first place.
{quote}
Don't see that mention anywhere in this Jira.
APEX is very tightly coupled to YARN. It is a YARN client that uses the YARN abstractions. Decoupling from YARN will be a substantial effort for APEX.
The description says
{quote}This will be particularly helpful when applications depend on native, non-JVM packages like Python and R, that otherwise need to be installed separately.
{quote}
YARN supports running docker containers, which is via YARN-3611, it will be helpful for running dockerized APEX operators. This, in my opinion, is easier and faster to accomplish.
> Docker based deployment
> -----------------------
>
> Key: APEXCORE-796
> URL: https://issues.apache.org/jira/browse/APEXCORE-796
> Project: Apache Apex Core
> Issue Type: New Feature
> Reporter: Thomas Weise
> Priority: Major
> Labels: roadmap
>
> Apex should support deployment using Docker as alternative to application packages. Docker images provide a simple and standard way to package dependencies and solve isolation from the host environment. This will be particularly helpful when applications depend on native, non-JVM packages like Python and R, that otherwise need to be installed separately. Docker support will also be a step towards supporting other cluster managers like Kubernetes, Mesos and Swarm.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)