[jira] [Commented] (AIRFLOW-385) Scheduler logs should have a "latest" directory

["Ben Tallman (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15589859#comment-15589859 ] 

Ben Tallman commented on AIRFLOW-385:
-------------------------------------

Not sure I'm worried about the latest flag, but moving to dag_id/execution_date/task_id.log would be very helpful...

> Scheduler logs should have a "latest" directory
> -----------------------------------------------
>
>                 Key: AIRFLOW-385
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-385
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: logging
>            Reporter: Dan Davydov
>            Assignee: Vijay Bhat
>            Priority: Minor
>              Labels: beginner, logging
>
> Right now the scheduler logs for each parsed file look like /tmp/airflow/scheduler/logs/2016-07-17/some-dag/...
> The problem is this makes it hard to find the latest logs which is the most frequent use case.
> Ideally we would create and have the scheduler keep up to date a symlink to the latest date /tmp/airflow/scheduler/logs/latest which would point to e.g. /tmp/airflow/scheduler/logs/2016-07-17
> We might also want to consider changing the structure to dag/date instead of date/dag too, but that can be done as a separate task if desired.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)