You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by "Gour Saha (JIRA)" <ji...@apache.org> on 2014/09/12 17:56:34 UTC

[jira] [Comment Edited] (SLIDER-116) Log handling for long-lived applications

    [ https://issues.apache.org/jira/browse/SLIDER-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131681#comment-14131681 ] 

Gour Saha edited comment on SLIDER-116 at 9/12/14 3:56 PM:
-----------------------------------------------------------

Uploaded SLIDER-116-v1.patch. This patch provides capability for slider applications to set log include/exclude filters and intervals which will be honored by YARN log aggregation service. With this patch applications do not have to wait till it completes to fetch logs from YARN which is particularly desirable for long running applications.

This patch can be applied to slider code base only after YARN-2468 patch is available in builds.


was (Author: gsaha):
This patch provides capability for slider applications to set log include/exclude filters and intervals which will be honored by YARN log aggregation service. With this patch applications do not have to wait till it completes to fetch logs from YARN which is particularly desirable for long running applications.

This patch can be applied to slider code base only after YARN-2468 patch is available in builds.

> Log handling for long-lived applications
> ----------------------------------------
>
>                 Key: SLIDER-116
>                 URL: https://issues.apache.org/jira/browse/SLIDER-116
>             Project: Slider
>          Issue Type: Task
>          Components: agent-provider
>            Reporter: Sumit Mohanty
>            Assignee: Gour Saha
>         Attachments: SLIDER-116-v1.patch
>
>
> Slider needs a solution for handling logs for long lived applications. The log files themselves could be huge and may or may not be ideal for pushing into HDFS. However, that should be an option. Otherwise, application owner should have an option of accessing logs from the local disk on hosts where container is/was active. Can YARN be configured to retain logs on a per application basis? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)