You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (Jira)" <ji...@apache.org> on 2019/09/30 17:27:00 UTC
[jira] [Commented] (AIRFLOW-3539) Error Importing sub-dag
(Webserver module load fail, scheduler works fine)
[ https://issues.apache.org/jira/browse/AIRFLOW-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941163#comment-16941163 ]
jack commented on AIRFLOW-3539:
-------------------------------
Is this a bug in Airflow core or in docker-airflow [https://github.com/puckel/docker-airflow/issues/287] ?
> Error Importing sub-dag (Webserver module load fail, scheduler works fine)
> --------------------------------------------------------------------------
>
> Key: AIRFLOW-3539
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3539
> Project: Apache Airflow
> Issue Type: Bug
> Components: DAG, scheduler, webserver
> Affects Versions: 1.10.1
> Reporter: Leonardo Zanell
> Assignee: Alex Lumpov
> Priority: Critical
> Labels: docker, import
> Fix For: 1.10.1
>
> Attachments: Seleção_011.png
>
>
> Hi, I'm deploying the airflow in a VM instance in google cloud plataform, using the docker image of puckel/docker-airflow, and using the docker-compose-Celery-Executor.yaml. When I run the dags locally the imports seens fine. but when I deploy on this docker-compose the import seems wrong to the webserver, the scheduler runs the dag fine, no problems at sight, when I turn on the dag in the UI the dag runs in the scheduler/ worker. but on the webserver the import gives me this error:
> {code:java}
> [2018-12-18 13:06:15,273] {{__init__.py:51}} INFO - Using executor CeleryExecutor
> [2018-12-18 13:06:15,762] {{models.py:271}} INFO - Filling up the DagBag from /usr/local/airflow/dags
> [2018-12-18 13:06:16,290] {{models.py:380}} ERROR - Failed to import: /usr/local/airflow/dags/dags/daily_etl.py
> Traceback (most recent call last):
> File "/usr/local/lib/python3.6/site-packages/airflow/models.py", line 377, in process_file
> m = imp.load_source(mod_name, filepath)
> File "/usr/local/lib/python3.6/imp.py", line 172, in load_source
> module = _load(spec)
> File "<frozen importlib._bootstrap>", line 684, in _load
> File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
> File "<frozen importlib._bootstrap_external>", line 678, in exec_module
> File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
> File "/usr/local/airflow/dags/dags/daily_etl.py", line 4, in <module>
> from dags.daily_extract import dag as dag_extract
> ModuleNotFoundError: No module named 'dags.daily_extract'
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)