[jira] [Commented] (AIRFLOW-382) YarnExecutor

["Ruslan Dautkhanov (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930868#comment-15930868 ] 

Ruslan Dautkhanov commented on AIRFLOW-382:
-------------------------------------------

+1

[~maxime.beauchemin@apache.org],  
{noformat}
While we're [decreasingly] comfortable installing all sorts of packages (R packages, Python libs, related apt packages, ...) 
on Airflow workers, we clearly don't want any of that on the Yarn boxes directly.{noformat}

It could be easier to implement once Docker on YARN infrastructure is complete? 
YARN-3611, YARN-4793 

https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html


> YarnExecutor
> ------------
>
>                 Key: AIRFLOW-382
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-382
>             Project: Apache Airflow
>          Issue Type: New Feature
>          Components: executor
>            Reporter: Steve Morin
>            Priority: Critical
>
> I am looking for YarnExecutor support.  I wanted to see what support there is for this and if it's on the roadmap.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)