You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Chris Douglas (JIRA)" <ji...@apache.org> on 2008/01/08 01:00:36 UTC

[jira] Commented: (HADOOP-2285) TextInputFormat is slow compared to reading files.

    [ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556775#action_12556775 ] 

Chris Douglas commented on HADOOP-2285:
---------------------------------------

+1 Looks good; I'm seeing better than a 3x speedup.

> TextInputFormat is slow compared to reading files.
> --------------------------------------------------
>
>                 Key: HADOOP-2285
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2285
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.15.0
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 0.16.0
>
>         Attachments: fast-line.patch
>
>
> The LineRecordReader reads from the source byte by byte, which seems to be half as fast as if the readLine method was defined on the memory buffer directly instead of as an InputStream.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.