You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/01/29 20:03:00 UTC
[jira] [Commented] (AIRFLOW-2023) Add debug information to help
determine lagging scheduler file processing
[ https://issues.apache.org/jira/browse/AIRFLOW-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16343937#comment-16343937 ]
ASF subversion and git services commented on AIRFLOW-2023:
----------------------------------------------------------
Commit 61ff29e578d1121ab4606fe122fb4e2db8f075b9 in incubator-airflow's branch refs/heads/master from [~aoen]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=61ff29e ]
[AIRFLOW-2023] Add debug logging around number of queued files
Add debug logging around number of queued files to
process in the
scheduler. This makes it easy to see when there
are bottlenecks due to parallelism and how long it
takes for all files to be processed.
Closes #2968 from aoen/ddavydov--
add_more_scheduler_metrics
> Add debug information to help determine lagging scheduler file processing
> -------------------------------------------------------------------------
>
> Key: AIRFLOW-2023
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2023
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Reporter: Dan Davydov
> Assignee: Dan Davydov
> Priority: Major
>
> Scheduling can get backed up if there are e.g. a lot of files that take a long time to process. Add debug information to help determine lagging scheduler file processing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)