You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Pete Wyckoff (JIRA)" <ji...@apache.org> on 2008/09/12 19:55:44 UTC

[jira] Created: (HADOOP-4166) Deserialize interface to support mechanism for supporting progress method in RecordReader

Deserialize interface to support mechanism for supporting progress method in RecordReader
-----------------------------------------------------------------------------------------

                 Key: HADOOP-4166
                 URL: https://issues.apache.org/jira/browse/HADOOP-4166
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
            Reporter: Pete Wyckoff


If the deserializer buffers the inputstream, there's no way for the record reader to support progress or even know when EOF is coming without directly catching EOFException from the deserialize() method.

so, theRecordReader.next(key,value) method could catch EOFException to return false when needed,but  the progress method cannot know where in the inputstream it is without an API from the deserializer in the case where the deserializer does buffering.

An example of this would be implementing LineRecordReader.LineReader as a deserializer since it reads data into its own buffer.



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.