You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Eric Yang (JIRA)" <ji...@apache.org> on 2009/03/08 02:04:56 UTC

[jira] Resolved: (HADOOP-4710) Chukwa - Add duplicate detection, and implement virtual offset of the log file to checkpoint file

     [ https://issues.apache.org/jira/browse/HADOOP-4710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang resolved HADOOP-4710.
-------------------------------

    Resolution: Duplicate

This is integrated by patch for HADOOP-4709.

> Chukwa - Add duplicate detection, and implement virtual offset of the log file to checkpoint file
> -------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-4710
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4710
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/chukwa
>         Environment: Redhat EL 4.5, Java 1.6, Hadoop Trunk
>            Reporter: Eric Yang
>
> Each data stream has been sent to Chukwa with sequence id, and this sequence id is used as the guide line for tracking duplicate chunk data in Chukwa.  However, the check point file does not include the virtual offset.  This means when collector crashed, sequence id is reset to zero.  Chukwa Agent needs to keep track of the sequence id in the check point file in order to recover from a crash.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.