You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2009/04/29 07:31:31 UTC

[jira] Resolved: (CHUKWA-76) Add automated data expiration for mr job data and mr task data

     [ https://issues.apache.org/jira/browse/CHUKWA-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang resolved CHUKWA-76.
-----------------------------

    Resolution: Fixed

This has been implemented in Chukwa 0.1.2 in the aggregation.sql.

> Add automated data expiration for mr job data and mr task data
> --------------------------------------------------------------
>
>                 Key: CHUKWA-76
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-76
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: Data Processors
>         Environment: Redhat 5.1, Java 6
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>
> Mapred job data and mapred task data collected to database table requires down sampling.  The data needs to be expired after a fixed time window.  There should be roll up and move data to different partition when necessary.  The current model is to expire every two time partition, and move the expired data to the larger partition.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.