You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ash Berlin-Taylor (JIRA)" <ji...@apache.org> on 2019/06/06 10:45:00 UTC

[jira] [Closed] (AIRFLOW-4722) Add third PV mount to worker node to share data

     [ https://issues.apache.org/jira/browse/AIRFLOW-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ash Berlin-Taylor closed AIRFLOW-4722.
--------------------------------------
    Resolution: Won't Fix

With AIRFLOW-4585 (slated for 1.10.4) this is possible on a per-site basis without changes to airflow core.

> Add third PV mount to worker node to share data
> -----------------------------------------------
>
>                 Key: AIRFLOW-4722
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4722
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: configuration, scheduler, worker
>    Affects Versions: 1.10.2, 1.10.3
>            Reporter: Marcel Rummens
>            Priority: Major
>   Original Estimate: 2m
>  Remaining Estimate: 2m
>
> For many use cases it is neccessary to write data from a worker back to a PV to share it between other workers (e.g. for TFX). Therefore a new (third) PVC should be optionaly mounted into the worker nodes (as well as the webserver). The PVC has to be provided by the user (similiar to DAG and log PV). It has to be mounted with the ReadOnly flag off. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)