[jira] [Created] (AIRFLOW-385) Scheduler logs should have a "latest" directory

["Dan Davydov (JIRA)" <ji...@apache.org>]

Dan Davydov created AIRFLOW-385:
-----------------------------------

             Summary: Scheduler logs should have a "latest" directory
                 Key: AIRFLOW-385
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-385
             Project: Apache Airflow
          Issue Type: Improvement
          Components: logging
            Reporter: Dan Davydov


Right now the scheduler logs for each parsed file look like /tmp/airflow/scheduler/logs/2016-07-17/some-dag/...
The problem is this makes it hard to find the latest logs which is the most frequent use case.

Ideally we would create and have the scheduler keep up to date a symlink to the latest date /tmp/airflow/scheduler/logs/latest which would point to e.g. /tmp/airflow/scheduler/logs/2016-07-17

We might also want to consider changing the structure to dag/date instead of date/dag too, but that can be done as a separate task if desired.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)