You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "omkar-foss (via GitHub)" <gi...@apache.org> on 2024/11/11 18:43:10 UTC
[I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
omkar-foss opened a new issue, #43892:
URL: https://github.com/apache/airflow/issues/43892
### Description
Create a basic guiding doc "How to Debug Your Airflow Deployment" that can guide users towards debugging their Airflow deployment. This doc can be based on general Airflow best practices + Agans' 9 rules of debugging:
1. Understand the system
2. Make it fail
3. Quit thinking and look
4. Divide and conquer
5. Change one thing at a time
6. Keep an audit trail
7. Check the plug
8. Get a fresh view
9. If you didn't fix it, it ain't fixed
The guide shall express above rules using Airflow examples, such that the users can read the guide and understand how to approach similar Airflow debugging scenarios.
### Use case/motivation
David A. Wheeler's Article (2004): https://dwheeler.com/essays/debugging-agans.html
### Related issues
Parent Issue: https://github.com/apache/airflow/issues/40975
### Are you willing to submit a PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "KoviAnusha (via GitHub)" <gi...@apache.org>.
KoviAnusha commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-3440297501
Thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "omkar-foss (via GitHub)" <gi...@apache.org>.
omkar-foss commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-4506816766
>'m not sure if we need this. We have https://github.com/apache/airflow/blob/main/contributing-docs/20_debugging_airflow_components.rst
Yes but currently the doc is breeze-specific, I suppose we could extend it further.
>I plan to write a doc on my perspective of debugging airflow components. But, that's going to take sometime as I want to do that myself and see if I can improve it and then document it.
@rawwar did you get a chance to continue it? If not let me know, I'll have a look.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "omkar-foss (via GitHub)" <gi...@apache.org>.
omkar-foss commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-2658734474
Didn't get a chance to actively look into this issue. I'll start looking into this one in the background and try to get a basic doc ready in the next couple of weeks or so.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "Dev-iL (via GitHub)" <gi...@apache.org>.
Dev-iL commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-2472960569
[Relevant discussion on Slack](https://apache-airflow.slack.com/archives/C07J87PK1BK/p1731346161804209) with some ideas on how the outputs of this should be structured and how to set the readers' expectations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "omkar-foss (via GitHub)" <gi...@apache.org>.
omkar-foss commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-3435701801
> [@omkar-foss](https://github.com/omkar-foss) are you still working on this? If not, can I work on this?
>
> cc: [@potiuk](https://github.com/potiuk)
Sure @KoviAnusha, please feel free to pick this up, I haven't found the time to work on this. Assigning this issue to you, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "rawwar (via GitHub)" <gi...@apache.org>.
rawwar commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-3471283568
I'm not sure if we need this. We have https://github.com/apache/airflow/blob/main/contributing-docs/20_debugging_airflow_components.rst
Maybe we can extend on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Create a basic guiding doc - How to Debug Your Airflow Deployment [airflow]
Posted by "KoviAnusha (via GitHub)" <gi...@apache.org>.
KoviAnusha commented on issue #43892:
URL: https://github.com/apache/airflow/issues/43892#issuecomment-3413738995
@omkar-foss are you still working on this? If not, can I work on this?
cc: @potiuk
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org