You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/02 18:07:02 UTC
[jira] [Assigned] (AIRFLOW-1381) DockerOperator does not allow
specification of temporary directory on host
[ https://issues.apache.org/jira/browse/AIRFLOW-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned AIRFLOW-1381:
-------------------------------------
Assignee: Holden Karau's magical unicorn
> DockerOperator does not allow specification of temporary directory on host
> --------------------------------------------------------------------------
>
> Key: AIRFLOW-1381
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1381
> Project: Apache Airflow
> Issue Type: Improvement
> Components: docker, operators
> Affects Versions: 1.9.0
> Environment: Causes failure under default conditions in OS X
> Reporter: Benjamin Sims
> Assignee: Holden Karau's magical unicorn
> Priority: Minor
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> The Docker uses the standard TemporaryDirectory mechanism to add a volume to the container which is mapped to a temporary directory on the host.
> By default, TemporaryDirectory places this in a location such as /var/folders/xxx/xxxxx/T/airflowtmpyi9pnn6w.
> However, Docker on OS X only allows certain folders to be shared into a container. /var/folders is not shared on OS X (and cannot be shared) and the operator will therefore fail with a 'Mounts denied' message.
> This can be solved by setting the environment variable TMPDIR to a path which Docker is able to share. However a solution to set this in the Operator itself would also be useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)