You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Howard Lee (JIRA)" <ji...@apache.org> on 2017/11/29 08:55:00 UTC

[jira] [Created] (HADOOP-15073) SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended

Howard Lee created HADOOP-15073:
-----------------------------------

             Summary: SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended
                 Key: HADOOP-15073
                 URL: https://issues.apache.org/jira/browse/HADOOP-15073
             Project: Hadoop Common
          Issue Type: Bug
          Components: common
    Affects Versions: 3.0.0-alpha3, 2.8.2, 2.7.4, 2.6.3
            Reporter: Howard Lee


The SequenceFile.Writer will insert SYNC into file every SYNC_INTERVAL.
In the case that SequenceFile ends with SYNC coincidentally, and another Writer open it with mode AppendIfExits, there meets the BUG.
For the AppendIfExits set _appendMode _ to _true_ , the init method will insert another SYNC. In such case, there will be two SYNC MAKR continuously.
In SequenceFile.Reader, the method readRecordLength will only test SYNC once, when there's two SYNC MARK, the _length_ will be -1(The begining of another SYNC), which means the end of file causing the next method quit unexpectedly.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org