You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Lohit Vijayarenu (JIRA)" <ji...@apache.org> on 2008/07/14 19:48:31 UTC

[jira] Commented: (HADOOP-3753) metrics: FileContext support overwrite mode

    [ https://issues.apache.org/jira/browse/HADOOP-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12613386#action_12613386 ] 

Lohit Vijayarenu commented on HADOOP-3753:
------------------------------------------

bq. In some scenarios, it would be useful to simply write the current statistics to the file once every period, then overwrite the file for the next period.
Right now FileContext writes metric values every 'period' defined by metricsName.period property. (eg. dfs.period). Your idea about overwriting would be very helpful. How about rollover to new file possibly appended with time stamp. Say, if we roll over every 15 minutes or an hour, then append time stamp. Even better if we could have property something like metricsName.fileRollover=<some value in minutes>. Overwriting will lose the data, cleanup could be done by external application. 

> metrics: FileContext support overwrite mode
> -------------------------------------------
>
>                 Key: HADOOP-3753
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3753
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Craig Macdonald
>            Priority: Minor
>
> FileContext currently continually appends to the metrics log file(s), generating an ever lengthening file.
> In some scenarios, it would be useful to simply write the current statistics to the file once every period, then overwrite the file for the next period.
> For instance, this could be useful if an external application parsed the metrics output - e.g. Cacti to create realtime graphs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.