You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "John Cheng (JIRA)" <ji...@apache.org> on 2018/08/19 12:16:00 UTC
[jira] [Commented] (AIRFLOW-1314) Airflow kubernetes integration
[ https://issues.apache.org/jira/browse/AIRFLOW-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585135#comment-16585135 ]
John Cheng commented on AIRFLOW-1314:
-------------------------------------
Is it able to support additional volume mount on the worker?
I would like to mount plugins, nfs and secrets when the worker is launched. The mount specification can be in airflow.cfg or executor_config.
Right now the workaround for me is put those stuffs in dag pv or log pv which is not a good practice.
> Airflow kubernetes integration
> ------------------------------
>
> Key: AIRFLOW-1314
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1314
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib
> Affects Versions: 1.10.0
> Reporter: Daniel Imberman
> Assignee: Daniel Imberman
> Priority: Major
> Labels: features
> Fix For: 1.10.0
>
>
> Kubernetes is a container-based cluster management system designed by google for easy application deployment. Companies such as Airbnb, Bloomberg, Palantir, and Google use kubernetes for a variety of large-scale solutions including data science, ETL, and app deployment. Integrating airflow into Kubernetes would increase viable use cases for airflow, promote airflow as a de facto workflow scheduler for Kubernetes, and create possibilities for improved security and robustness within airflow.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)