You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "swapnilpatil0905 (via GitHub)" <gi...@apache.org> on 2024/12/30 04:53:53 UTC
[I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
swapnilpatil0905 opened a new issue, #45276:
URL: https://github.com/apache/airflow/issues/45276
### Apache Airflow version
2.10.4
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
When refreshing the Airflow UI, the displayed count of DAG import errors is inconsistent. The following issues are observed:
1. The number of DAG import errors changes with each refresh. For example, errors may fluctuate between 13, 14, and 17.
2. Some old import errors disappear after a refresh but reappear during subsequent refreshes.
Impact:
This inconsistency makes it difficult to accurately identify and address DAG import issues, leading to potential confusion and inefficiencies in debugging workflows.
### What you think should happen instead?
<img width="774" alt="Screenshot 2024-12-30 at 10 18 12 AM" src="https://github.com/user-attachments/assets/0320c487-17c5-4cca-8471-1ae1e2fce187" />
<img width="795" alt="Screenshot 2024-12-30 at 10 18 44 AM" src="https://github.com/user-attachments/assets/68deaf50-85a7-4b96-988a-e36622d7ffe9" />
Expected Behavior:
The count and details of DAG import errors should remain consistent across UI refreshes until the underlying errors are resolved.
### How to reproduce
Steps to Reproduce:
1. Open the Airflow UI.
2. Note the number of DAG import errors displayed.
3. Refresh the UI multiple times and observe the changes in the count of errors.
4. Compare the errors to verify if previously resolved issues reappear.
### Operating System
NAME="Red Hat Enterprise Linux" VERSION="9.4 (Plow)" ID="rhel" ID_LIKE="fedora" VERSION_ID="9.4" PLATFORM_ID="platform:el9" PRETTY_NAME="Red Hat Enterprise Linux 9.4 (Plow)" ANSI_COLOR="0;31" LOGO="fedora-logo-icon" CPE_NAME="cpe:/o:redhat:enterprise_linux:9::baseos" HOME_URL="https://www.redhat.com/" DOCUMENTATION_URL="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9" BUG_REPORT_URL="https://issues.redhat.com/" REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 9" REDHAT_BUGZILLA_PRODUCT_VERSION=9.4 REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" REDHAT_SUPPORT_PRODUCT_VERSION="9.4"
### Versions of Apache Airflow Providers
2.9.2
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #45276:
URL: https://github.com/apache/airflow/issues/45276#issuecomment-2565025086
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "swapnilpatil0905 (via GitHub)" <gi...@apache.org>.
swapnilpatil0905 commented on issue #45276:
URL: https://github.com/apache/airflow/issues/45276#issuecomment-2565128774
@tirkarthi Few are in dags folder whereas few are zipped. Note: We are running on multipod webserver mode.
<img width="1453" alt="Screenshot 2024-12-30 at 1 03 47 PM" src="https://github.com/user-attachments/assets/975c3285-25ac-42d7-8638-6c510a94d3ca" />
<img width="1463" alt="Screenshot 2024-12-30 at 1 05 26 PM" src="https://github.com/user-attachments/assets/2a1eacb6-7290-44ce-aa53-08bd052fd4a4" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #45276:
URL: https://github.com/apache/airflow/issues/45276#issuecomment-3094469726
> @ephraimbuddy How can one find whether this was due to an import timeout? The actually shown import error indicate real issues, not timeouts.
You need to look at the errors. It does not have to be timeouts, it can be **ANYTHING** that changes between one parsing and second parsing. This basically means that parsing of some of your Dags is simply **unstable** and sometimes works, sometimes does not.
You need to look at those import errors (also they should be logged by dag file processor I think, and for sure they are stored in the database of Airflow (see ERD schema on our docs) and you can compare the errors when they differ. The actual extra error you see when you have 13 of them is what you should figure out and find out why it might sometimes cause import error and sometimes not.
It can be anything and it 100% depends on how your Dags are written - so only you and your team can investigate the root causes and fix them. There might be many, many different reasons - depending on the environmental changes - database timeouts, reading external files that might impact what happens during parsing, or maybe even potentially inconsistent environment your dag file processor(s) run - maybe some of your environment does not have some libraries installed. Also a number of users (completely against our recommendations) dynamically install dependencies in their environment rather than for example bake all dependencies in their images or have a read-only non-modifiable virtual env, and due to racing conditions that might cause all kinds of weirdness when parsing done in one environment (with some deps) might result with different results than the one done in effectively different environment (for example when you install or remove dependencies dynamicall without redeplo
ying airflow in a "frozen" environment.
So .. all in your hands to analyse and find out what's wrong with *your* Dags and *your* environment rather than look for issue in Airflow.
I am converting that one to a discussion, would be nice to hear back what you find out after your investigations - that might help people who will have similar issues like you in the future when they see what mistakes could be avoided were done when deploying airflow or authoring Dags.
Also looking at "Best practices" in our docs might help - we explain there a number of things you should avoid when authoring Dags.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "rwitzel (via GitHub)" <gi...@apache.org>.
rwitzel commented on issue #45276:
URL: https://github.com/apache/airflow/issues/45276#issuecomment-3094397846
@ephraimbuddy How can one find whether this was due to an import timeout? The actually shown import error indicate real issues, not timeouts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "tirkarthi (via GitHub)" <gi...@apache.org>.
tirkarthi commented on issue #45276:
URL: https://github.com/apache/airflow/issues/45276#issuecomment-2565125753
Are the dag files in the dags folder python files or zip files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "ephraimbuddy (via GitHub)" <gi...@apache.org>.
ephraimbuddy commented on issue #45276:
URL: https://github.com/apache/airflow/issues/45276#issuecomment-2565117784
DAGs are constantly being parsed, and if some are due to import timeouts during parsing, then those DAGs could pass at times and fail at other times. I think that's what you are experiencing, and it's not a bug
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Inconsistent DAG Import Errors Display in Airflow UI [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #45276: Inconsistent DAG Import Errors Display in Airflow UI
URL: https://github.com/apache/airflow/issues/45276
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org