You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Robert Goodman (JIRA)" <ji...@apache.org> on 2009/12/11 18:11:18 UTC
[jira] Created: (AVRO-252) Add a tell() method to
DataFileReader.java which returns the position in a file
Add a tell() method to DataFileReader.java which returns the position in a file
-------------------------------------------------------------------------------
Key: AVRO-252
URL: https://issues.apache.org/jira/browse/AVRO-252
Project: Avro
Issue Type: Improvement
Components: java
Reporter: Robert Goodman
Priority: Minor
A RecordReader needs to be able to get the current position in the file to determine when it has reached the end of a file split and to handle errors. This improvement will add a tell() method to DataFileReader.java which returns the position in a file. The position returned by the tell() method will only change when crossing a block boundary in a file. The position does not increment as DataFileReader.java processes data within a block.
This will allow a RecordReader to do a simple check for when the position returned by tell() is past the end of a file split to know when to stop reading. The RecordReader will also be able to recover from errors by calling sync(tell()) to sync to the next block and attempting to continue reading.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (AVRO-252) Add a tell() method to
DataFileReader.java which returns the position in a file
Posted by "Robert Goodman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Goodman resolved AVRO-252.
----------------------------------
Resolution: Invalid
Fix Version/s: 1.3.0
I'm marking this issue as Invalid because of the changes made to DataFilereader.java in the trunk. The intent of adding the tell() method was to allow a record reader to determine when it had reached the end of the file split and the pastSync(position) method now provides this functionality.
> Add a tell() method to DataFileReader.java which returns the position in a file
> -------------------------------------------------------------------------------
>
> Key: AVRO-252
> URL: https://issues.apache.org/jira/browse/AVRO-252
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Robert Goodman
> Priority: Minor
> Fix For: 1.3.0
>
>
> A RecordReader needs to be able to get the current position in the file to determine when it has reached the end of a file split and to handle errors. This improvement will add a tell() method to DataFileReader.java which returns the position in a file. The position returned by the tell() method will only change when crossing a block boundary in a file. The position does not increment as DataFileReader.java processes data within a block.
> This will allow a RecordReader to do a simple check for when the position returned by tell() is past the end of a file split to know when to stop reading. The RecordReader will also be able to recover from errors by calling sync(tell()) to sync to the next block and attempting to continue reading.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.