You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "John Cheng (JIRA)" <ji...@apache.org> on 2018/08/19 12:16:00 UTC

[jira] [Commented] (AIRFLOW-1314) Airflow kubernetes integration

    [ https://issues.apache.org/jira/browse/AIRFLOW-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585135#comment-16585135 ] 

John Cheng commented on AIRFLOW-1314:
-------------------------------------

Is it able to support additional volume mount on the worker?
I would like to mount plugins, nfs and secrets when the worker is launched. The mount specification can be in airflow.cfg or executor_config. 
Right now the workaround for me is put those stuffs in dag pv or log pv which is not a good practice.

> Airflow kubernetes integration
> ------------------------------
>
>                 Key: AIRFLOW-1314
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1314
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib
>    Affects Versions: 1.10.0
>            Reporter: Daniel Imberman
>            Assignee: Daniel Imberman
>            Priority: Major
>              Labels: features
>             Fix For: 1.10.0
>
>
> Kubernetes is a container-based cluster management system designed by google for easy application deployment. Companies such as Airbnb, Bloomberg, Palantir, and Google use kubernetes for a variety of large-scale solutions including data science, ETL, and app deployment. Integrating airflow into Kubernetes would increase viable use cases for airflow, promote airflow as a de facto workflow scheduler for Kubernetes, and create possibilities for improved security and robustness within airflow. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)