You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2009/04/01 06:55:50 UTC
[jira] Created: (CHUKWA-76) Add automated data expiration for mr
job data and mr task data
Add automated data expiration for mr job data and mr task data
--------------------------------------------------------------
Key: CHUKWA-76
URL: https://issues.apache.org/jira/browse/CHUKWA-76
Project: Hadoop Chukwa
Issue Type: New Feature
Components: Data Processors
Environment: Redhat 5.1, Java 6
Reporter: Eric Yang
Assignee: Eric Yang
Mapred job data and mapred task data collected to database table requires down sampling. The data needs to be expired after a fixed time window. There should be roll up and move data to different partition when necessary. The current model is to expire every two time partition, and move the expired data to the larger partition.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (CHUKWA-76) Add automated data expiration for mr
job data and mr task data
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-76?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang resolved CHUKWA-76.
-----------------------------
Resolution: Fixed
This has been implemented in Chukwa 0.1.2 in the aggregation.sql.
> Add automated data expiration for mr job data and mr task data
> --------------------------------------------------------------
>
> Key: CHUKWA-76
> URL: https://issues.apache.org/jira/browse/CHUKWA-76
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors
> Environment: Redhat 5.1, Java 6
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Mapred job data and mapred task data collected to database table requires down sampling. The data needs to be expired after a fixed time window. There should be roll up and move data to different partition when necessary. The current model is to expire every two time partition, and move the expired data to the larger partition.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.