You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Arvind Prabhakar (JIRA)" <ji...@apache.org> on 2012/06/26 04:08:43 UTC
[jira] [Created] (FLUME-1319) File Channel optimize replay of logs
when a checkpoint is present
Arvind Prabhakar created FLUME-1319:
---------------------------------------
Summary: File Channel optimize replay of logs when a checkpoint is present
Key: FLUME-1319
URL: https://issues.apache.org/jira/browse/FLUME-1319
Project: Flume
Issue Type: Bug
Reporter: Arvind Prabhakar
Assignee: Arvind Prabhakar
If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1319) File Channel optimize replay of logs
when a checkpoint is present
Posted by "Arvind Prabhakar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar updated FLUME-1319:
------------------------------------
Fix Version/s: v1.2.0
Status: Patch Available (was: Open)
Attached the first cut patch.
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
> Key: FLUME-1319
> URL: https://issues.apache.org/jira/browse/FLUME-1319
> Project: Flume
> Issue Type: Bug
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: v1.2.0
>
> Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1319) File Channel optimize replay of logs
when a checkpoint is present
Posted by "Arvind Prabhakar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar updated FLUME-1319:
------------------------------------
Attachment: FLUME-1319-1.patch
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
> Key: FLUME-1319
> URL: https://issues.apache.org/jira/browse/FLUME-1319
> Project: Flume
> Issue Type: Bug
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: v1.2.0
>
> Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (FLUME-1319) File Channel optimize replay of
logs when a checkpoint is present
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401251#comment-13401251 ]
Hudson commented on FLUME-1319:
-------------------------------
Integrated in flume-trunk #257 (See [https://builds.apache.org/job/flume-trunk/257/])
FLUME-1319. Log replay optimization.
(Arvind Prabhakar via Mike Percy) (Revision 1353848)
Result = UNSTABLE
mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848
Files :
* /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java
* /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
> Key: FLUME-1319
> URL: https://issues.apache.org/jira/browse/FLUME-1319
> Project: Flume
> Issue Type: Bug
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: v1.2.0
>
> Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (FLUME-1319) File Channel optimize replay of logs
when a checkpoint is present
Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Percy updated FLUME-1319:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Patch committed. Thanks Arvind!
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
> Key: FLUME-1319
> URL: https://issues.apache.org/jira/browse/FLUME-1319
> Project: Flume
> Issue Type: Bug
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: v1.2.0
>
> Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira