You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Robert Kanter (JIRA)" <ji...@apache.org> on 2014/02/27 23:11:24 UTC

[jira] [Assigned] (OOZIE-1716) Add a way to stream the logs for only the last x hours

     [ https://issues.apache.org/jira/browse/OOZIE-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Kanter reassigned OOZIE-1716:
------------------------------------

    Assignee: Robert Kanter

> Add a way to stream the logs for only the last x hours
> ------------------------------------------------------
>
>                 Key: OOZIE-1716
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1716
>             Project: Oozie
>          Issue Type: New Feature
>    Affects Versions: trunk
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>
> When a user has a busy cluster and long running coordinator jobs, streaming the logs can be really slow.  In this situation, the user is typically only interested in the latest logs and doesn't care about logs from a while ago.  So, we can speed this up by adding a parameter or something to the log streaming API to only fetch the logs from the last x hours.  The log files roll over every hour, so this should be pretty straightforward.  We can also prepend a message to the logs streamed back mentioning that only the last x hours of logs are included.  The existing way of getting all of the logs should remain unaffected and still work.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)