You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "bbovenzi (via GitHub)" <gi...@apache.org> on 2024/02/21 20:14:22 UTC
[PR] Datasets in dag graph [airflow]
bbovenzi opened a new pull request, #37604:
URL: https://github.com/apache/airflow/pull/37604
Add datasets as upstream and downstream nodes in the DAG graph.
Make it easier to visualize what a DAG is connected to. And provide a tooltip to jump over to that dataset to see what else it connects to. This makes it easier to jump back and forth between dag view and a dataset view.
<img width="872" alt="Screenshot 2024-02-21 at 3 10 42 PM" src="https://github.com/apache/airflow/assets/4600967/d5d09acb-1528-4332-b38c-cf25040c608e">
Zoomed out:
<img width="402" alt="Screenshot 2024-02-21 at 3 10 16 PM" src="https://github.com/apache/airflow/assets/4600967/98899109-d1d6-4fdc-b621-f499efac5239">
After this:
- we could add the relevant dataset events to a Dataset node too. Perhaps even in both the dataset and dag graphs and we can share the node components between the two graphs.
- We can add trigger rules to the tooltip for dataset-and-timetable or any/all conditions
---
**^ Add meaningful description above**
Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information.
In case of fundamental code changes, an Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals)) is needed.
In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x).
In case of backwards incompatible changes please leave a note in a newsfragment file, named `{pr_number}.significant.rst` or `{issue_number}.significant.rst`, in [newsfragments](https://github.com/apache/airflow/tree/main/newsfragments).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add datasets to dag graph [airflow]
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi merged PR #37604:
URL: https://github.com/apache/airflow/pull/37604
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Add datasets to dag graph [airflow]
Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi commented on PR #37604:
URL: https://github.com/apache/airflow/pull/37604#issuecomment-1958571357
> @bbovenzi Nice work. I believe this is for task view not dag view?
Nope. For the whole dag. The example dag had only a single task.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org