You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Matt Massie (JIRA)" <ji...@apache.org> on 2010/02/22 23:22:27 UTC

[jira] Created: (AVRO-428) Improve file read performance by buffering data

Improve file read performance by buffering data
-----------------------------------------------

                 Key: AVRO-428
                 URL: https://issues.apache.org/jira/browse/AVRO-428
             Project: Avro
          Issue Type: Improvement
          Components: c
            Reporter: Matt Massie
            Assignee: Matt Massie




-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (AVRO-428) Improve file read performance by buffering data

Posted by "Matt Massie (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/AVRO-428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt Massie resolved AVRO-428.
------------------------------

    Resolution: Fixed

Committed to trunk

> Improve file read performance by buffering data
> -----------------------------------------------
>
>                 Key: AVRO-428
>                 URL: https://issues.apache.org/jira/browse/AVRO-428
>             Project: Avro
>          Issue Type: Improvement
>          Components: c
>            Reporter: Matt Massie
>            Assignee: Matt Massie
>         Attachments: AVRO-428.patch, AVRO-428.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (AVRO-428) Improve file read performance by buffering data

Posted by "Matt Massie (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/AVRO-428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt Massie updated AVRO-428:
-----------------------------

    Attachment: AVRO-428.patch

The last patch was incorrect because of a know issue with subversion 1.6.5 and 1.6.6 on MacOS X.

I'm attaching a new patch generated by git. 

> Improve file read performance by buffering data
> -----------------------------------------------
>
>                 Key: AVRO-428
>                 URL: https://issues.apache.org/jira/browse/AVRO-428
>             Project: Avro
>          Issue Type: Improvement
>          Components: c
>            Reporter: Matt Massie
>            Assignee: Matt Massie
>         Attachments: AVRO-428.patch, AVRO-428.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AVRO-428) Improve file read performance by buffering data

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/AVRO-428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12837007#action_12837007 ] 

Doug Cutting commented on AVRO-428:
-----------------------------------

This fails to apply with:

patch: **** missing line number at line 5: @@ -%ld,%ld +%ld,%ld @@


> Improve file read performance by buffering data
> -----------------------------------------------
>
>                 Key: AVRO-428
>                 URL: https://issues.apache.org/jira/browse/AVRO-428
>             Project: Avro
>          Issue Type: Improvement
>          Components: c
>            Reporter: Matt Massie
>            Assignee: Matt Massie
>         Attachments: AVRO-428.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (AVRO-428) Improve file read performance by buffering data

Posted by "Matt Massie (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/AVRO-428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt Massie updated AVRO-428:
-----------------------------

    Attachment: AVRO-428.patch

This patch add buffering for file reads.  My benchmarks shows a 2-3x improvement in read speed with this patch.

> Improve file read performance by buffering data
> -----------------------------------------------
>
>                 Key: AVRO-428
>                 URL: https://issues.apache.org/jira/browse/AVRO-428
>             Project: Avro
>          Issue Type: Improvement
>          Components: c
>            Reporter: Matt Massie
>            Assignee: Matt Massie
>         Attachments: AVRO-428.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.