You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/01/10 18:17:54 UTC

[GitHub] [airflow] bparhy opened a new issue #20790: Airflow UI DAG Import Errors

bparhy opened a new issue #20790:
URL: https://github.com/apache/airflow/issues/20790


   ### Apache Airflow version
   
   2.1.3
   
   ### What happened
   
   We are using airflow in k8s. Webserver and scheduler are running without any errors in their logs.
   
   Below is the snippet of a DAG.
   
   from airflow import DAG
   from airflow.operators.python_operator import PythonOperator
   from airflow.providers.snowflake.hooks.snowflake import SnowflakeHook
   from airflow.providers.snowflake.operators.snowflake import SnowflakeOperator
   from bi_plugin import SnowflakeMultiSqlStatmentOperator
   
   I am seeing the below error in the UI. But the dag is parsing perfect and I can see its code and I can run it with out any issue.
   
   Broken DAG: [/usr/local/airflow/dags/network/vbc_telemetry_feed_prod.py] Traceback (most recent call last):
     File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
     File "/usr/local/airflow/dags/network/vbc_telemetry_feed_prod.py", line 5, in <module>
       from bi_plugin import SnowflakeMultiSqlStatmentOperator
   ModuleNotFoundError: No module named 'bi_plugin'
   
   We used to have plugin code in this bi_plugin module with 2.1.3 migration we are still keeping the bi_plugin file in the plugins folder which is again inside the dags folder and our imports are changed to 
   
   from bi_plugin import SnowflakeMultiSqlStatmentOperator
   
   
   Please let me know. Any help in this direction is appreciated.
   
   
   ### What you expected to happen
   
   I was expecting no errors in the UI.
   
   ### How to reproduce
   
   _No response_
   
   ### Operating System
   
   linux
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Other 3rd-party Helm chart
   
   ### Deployment details
   
   This is a kubernetes deployment with two schedulers and one webserver.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org