You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Arvind Prabhakar (JIRA)" <ji...@apache.org> on 2012/06/26 04:08:43 UTC

[jira] [Created] (FLUME-1319) File Channel optimize replay of logs when a checkpoint is present

Arvind Prabhakar created FLUME-1319:
---------------------------------------

             Summary: File Channel optimize replay of logs when a checkpoint is present
                 Key: FLUME-1319
                 URL: https://issues.apache.org/jira/browse/FLUME-1319
             Project: Flume
          Issue Type: Bug
            Reporter: Arvind Prabhakar
            Assignee: Arvind Prabhakar


If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (FLUME-1319) File Channel optimize replay of logs when a checkpoint is present

Posted by "Arvind Prabhakar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arvind Prabhakar updated FLUME-1319:
------------------------------------

    Fix Version/s: v1.2.0
           Status: Patch Available  (was: Open)

Attached the first cut patch.
                
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
>                 Key: FLUME-1319
>                 URL: https://issues.apache.org/jira/browse/FLUME-1319
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: v1.2.0
>
>         Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (FLUME-1319) File Channel optimize replay of logs when a checkpoint is present

Posted by "Arvind Prabhakar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arvind Prabhakar updated FLUME-1319:
------------------------------------

    Attachment: FLUME-1319-1.patch
    
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
>                 Key: FLUME-1319
>                 URL: https://issues.apache.org/jira/browse/FLUME-1319
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: v1.2.0
>
>         Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (FLUME-1319) File Channel optimize replay of logs when a checkpoint is present

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401251#comment-13401251 ] 

Hudson commented on FLUME-1319:
-------------------------------

Integrated in flume-trunk #257 (See [https://builds.apache.org/job/flume-trunk/257/])
    FLUME-1319. Log replay optimization.

(Arvind Prabhakar via Mike Percy) (Revision 1353848)

     Result = UNSTABLE
mpercy : http://svn.apache.org/viewvc/?view=rev&rev=1353848
Files : 
* /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java
* /incubator/flume/trunk/flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java

                
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
>                 Key: FLUME-1319
>                 URL: https://issues.apache.org/jira/browse/FLUME-1319
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: v1.2.0
>
>         Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (FLUME-1319) File Channel optimize replay of logs when a checkpoint is present

Posted by "Mike Percy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/FLUME-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mike Percy updated FLUME-1319:
------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Patch committed. Thanks Arvind!
                
> File Channel optimize replay of logs when a checkpoint is present
> -----------------------------------------------------------------
>
>                 Key: FLUME-1319
>                 URL: https://issues.apache.org/jira/browse/FLUME-1319
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Arvind Prabhakar
>            Assignee: Arvind Prabhakar
>             Fix For: v1.2.0
>
>         Attachments: FLUME-1319-1.patch
>
>
> If a checkpoint is present in the logs that is prior to the last recorded checkpoint of the event queue, the replay should begin from there instead of starting from the first event. This will speed up the restarts considerably.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira