You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/20 20:31:33 UTC

[GitHub] [airflow] zbrookle opened a new issue #10431: Metrics Documentation, dag_bag_size

zbrookle opened a new issue #10431:
URL: https://github.com/apache/airflow/issues/10431


   In the airflow documentation metrics section there is a field called dag_bag_size and the description is just "DAG bag size", this is fairly unhelpful for trying to gain insight into the metrics, so would it be possible for this description to either be improved, or linked to a more accurate description?
   
   In the docstring, the description of a dag bag is "a collection of dags, parsed out of a folder tree and has high level configuration settings", but it's unclear which dags are actually in this collection during runtime. For example, is this every dag displayed on the webserver UI, or is it just the dags that are turned on? (I'm fairly certain from monitoring that it's the latter)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] zappallot commented on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
zappallot commented on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-906231568


   +1 to this excellent request, I'm also trying to find out if I need this metric and what it can tell me.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-938203356


   @javatarz Assigned!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] javatarz commented on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
javatarz commented on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-938075198


   Does "Number of DAGs found when the scheduler ran a scan based on it's configuration" sound like a better description? 
   
   Based on the code, guages are updated by the scheduler loop which runs based on the scheduler configuration (n times or infinitely).
   
   _I'll send a PR updating `metrics.rst` once we agree on the language._


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] kaxil closed issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
kaxil closed issue #10431:
URL: https://github.com/apache/airflow/issues/10431


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] javatarz commented on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
javatarz commented on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-938075198


   Does "Number of DAGs found when the scheduler ran a scan based on it's configuration" sound like a better description? 
   
   Based on the code, guages are updated by the scheduler loop which runs based on the scheduler configuration (n times or infinitely).
   
   _I'll send a PR updating `metrics.rst` once we agree on the language._


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] javatarz edited a comment on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
javatarz edited a comment on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-938075198


   Does "Number of DAGs found when the scheduler ran a scan based on it's configuration" sound like a better description? 
   
   Based on the code, guages are updated by the scheduler loop which runs based on the scheduler configuration (n times or infinitely).
   
   _I'll send a PR updating `metrics.rst` once we agree on the language. Can someone assign this issue to me?_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-677888129


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-938203356


   @javatarz Assigned!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] javatarz edited a comment on issue #10431: Metrics Documentation, dag_bag_size

Posted by GitBox <gi...@apache.org>.
javatarz edited a comment on issue #10431:
URL: https://github.com/apache/airflow/issues/10431#issuecomment-938075198


   Does "Number of DAGs found when the scheduler ran a scan based on it's configuration" sound like a better description? 
   
   Based on the code, guages are updated by the scheduler loop which runs based on the scheduler configuration (n times or infinitely).
   
   _I'll send a PR updating `metrics.rst` once we agree on the language. Can someone assign this issue to me?_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org