You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/06/03 17:07:08 UTC

[GitHub] [airflow] jjlyr opened a new issue #16249: Fully functional DAG Dependencies Graph view

jjlyr opened a new issue #16249:
URL: https://github.com/apache/airflow/issues/16249


   
   **Description**
   
   Fully functional DAG Dependencies Graph view to be able to monitor all the Dags with similar features and functions to the existing Dag Graph view 
   
   **Use case / motivation**
   
   The new feature in the UI, DAG Dependencies (https://github.com/apache/airflow/pull/13199), is very good but it does not add any value to monitor the Dags or to see the status of them
   
   ![image](https://user-images.githubusercontent.com/47416271/120683975-1fa55700-c496-11eb-9737-b1b3acad5c56.png)
   
   **Are you willing to submit a PR?**
   
   No
   
   **Related Issues**
   
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] ManiBharataraju commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
ManiBharataraju commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-1072990414


   @eladkal - Sure. I will try to work on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] bbovenzi commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
bbovenzi commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-854866173


   I totally agree we can make Dag Dependencies more useful. But could you list out what "fully functional" would be in your opinion? I don't think we want this to be a super graph view of all dags and tasks. That's a lot of nodes to render and to navigate around.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-854035631


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] bbovenzi commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
bbovenzi commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-856070445


   Got it.
   
   I think this makes most sense as adding dependency info to the Graph view to get all that detailed info per run. Dag Dependencies remains as an overview of all the dags with dependencies.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-854035631


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] eladkal commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-1069385083


   @ManiBharataraju do you have plans to add the functionality of your add-on to Airflow?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] jjlyr commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
jjlyr commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-854039781


   @ashb FYI


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] jjlyr commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
jjlyr commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-855213396


   @bbovenzi I had though in something like this, if we want to keep DAG Dependencies as it is, create a new view where we need to select the Dags we want to monitor(up to a limit) via drop down list, name-regex or even select the ones we want from DAG dependencies view, and then only those we have selected will be displayed there. Also we will need to add a date selector for this view, and I think this is the tricky bit as the selected Dags may have different schedule runs or the same. We could display the most recent status for the Dags selected for that date(if any).
   Later or at the same time, more functionality can be added, for example if we double click in the Dag we could jump into DAG Graph view for that date for that particular Dag.
   Please see below an example:
   
   ![image](https://user-images.githubusercontent.com/47416271/120887292-e251de00-c5e9-11eb-9a00-36b4ff1a1ff8.png)
   
   Please let me know how you see it and many thanks for your comment
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] ManiBharataraju commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
ManiBharataraju commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-860085917


   @bbovenzi - I created something exactly similar that the user is requesting in our org prior to an inbuilt version of dag_dependencies was available. You might want to take a look at 
   https://github.com/ManiBharataraju/DAG-dependencies
   Just as an FYI, before working on this project I never worked on javascript or UI coding. So obviously there might be a lot of redundancy or better ways to do things. I would love to contribute if you could guide me along. It's always fun to learn :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] jjlyr commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
jjlyr commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-854039781


   @ashb FYI


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] bbovenzi commented on issue #16249: Fully functional DAG Dependencies Graph view

Posted by GitBox <gi...@apache.org>.
bbovenzi commented on issue #16249:
URL: https://github.com/apache/airflow/issues/16249#issuecomment-860837020


   @ManiBharataraju That looks great! I am more than happy to help you out with javascript. Feel free to message me on the airflow slack channel to figure out how to get this moving.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org