You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Kaxil Naik (Jira)" <ji...@apache.org> on 2020/03/13 21:37:00 UTC

[jira] [Assigned] (AIRFLOW-5177) scheduler_job command passes scheduler dag location

     [ https://issues.apache.org/jira/browse/AIRFLOW-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kaxil Naik reassigned AIRFLOW-5177:
-----------------------------------

    Assignee: Kaxil Naik

> scheduler_job command passes scheduler dag location
> ---------------------------------------------------
>
>                 Key: AIRFLOW-5177
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5177
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.10.3, 1.10.4
>            Reporter: James Coder
>            Assignee: Kaxil Naik
>            Priority: Major
>
> There seems to be somewhere or inconsistency in one of these items. In my airflow set up the DAG location is not consistent across the scheduler and the workers. Meaning DAGS in the scheduler reside in /home/usr/airflow/... where as on my workers the DAGS may exist in /home/user/123... The issue I'm seeing is that when scheduler job call generate_commad, it uses SimpleDag, which only has full_filepath, and sends the command out with the -sd param as /home/usr/airflow..., then when the worker picks it up, it fails because the dag actually exists somewhere else (AIRFLOW_HOME is set as env variable). 
> It looks like it should replace /home/usr/airflow with DAGS_FOLDER/, or some other handling. 
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)