You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Jerome Boulon (JIRA)" <ji...@apache.org> on 2009/04/03 23:23:12 UTC
[jira] Created: (CHUKWA-91) Checkpoint contains offset != 0 even if
there's no collector
Checkpoint contains offset != 0 even if there's no collector
------------------------------------------------------------
Key: CHUKWA-91
URL: https://issues.apache.org/jira/browse/CHUKWA-91
Project: Hadoop Chukwa
Issue Type: Bug
Components: data collection
Reporter: Jerome Boulon
Priority: Critical
Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-91) Checkpoint contains offset != 0 even if
there's no collector
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-91:
-----------------------------
Priority: Blocker (was: Critical)
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Priority: Blocker
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-91) Checkpoint contains offset != 0 even
if there's no collector
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12702801#action_12702801 ]
Hudson commented on CHUKWA-91:
------------------------------
Integrated in Chukwa-trunk #8 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/8/])
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-91) Checkpoint contains offset != 0 even
if there's no collector
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12696740#action_12696740 ]
Eric Yang commented on CHUKWA-91:
---------------------------------
+1 on the test patch for sanity check.
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-91) Checkpoint contains offset != 0 even if
there's no collector
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-91:
-----------------------------
Attachment: CHUKWA-93test.patch
I can't confirm this bug. Here's a test case to help keep an eye on it.
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-91) Checkpoint contains offset != 0 even
if there's no collector
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716994#action_12716994 ]
Hudson commented on CHUKWA-91:
------------------------------
Integrated in Chukwa-trunk #45 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/45/])
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-91) Checkpoint contains offset != 0 even
if there's no collector
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701251#action_12701251 ]
Ari Rabkin commented on CHUKWA-91:
----------------------------------
Also committed that test case....sort of late. :(
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-91) Checkpoint contains offset != 0 even
if there's no collector
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695835#action_12695835 ]
Ari Rabkin commented on CHUKWA-91:
----------------------------------
This is really a bug, not a design problem. Can you specify the conditions when it happens?
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Priority: Critical
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-91) Checkpoint contains offset != 0 even if
there's no collector
Posted by "Cheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheng updated CHUKWA-91:
------------------------
Resolution: Cannot Reproduce
Status: Resolved (was: Patch Available)
I did some tests. When no collector is running, the offset will not change.
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-91) Checkpoint contains offset != 0 even if
there's no collector
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-91:
-----------------------------
Status: Patch Available (was: Open)
filename is wrong, but that's probably okay. It won't collide with anything.
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
> Attachments: CHUKWA-93test.patch
>
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CHUKWA-91) Checkpoint contains offset != 0 even
if there's no collector
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin reassigned CHUKWA-91:
--------------------------------
Assignee: Ari Rabkin
> Checkpoint contains offset != 0 even if there's no collector
> ------------------------------------------------------------
>
> Key: CHUKWA-91
> URL: https://issues.apache.org/jira/browse/CHUKWA-91
> Project: Hadoop Chukwa
> Issue Type: Bug
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Ari Rabkin
> Priority: Blocker
>
> Checkpoint files are used to recover from a crash/stop so the offset for a file should be the last offset that has been acknowledged by the sender.
> This is not the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.