You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Howard Lee (JIRA)" <ji...@apache.org> on 2017/11/29 08:55:00 UTC
[jira] [Created] (HADOOP-15073) SequenceFile.Reader will
unexpectedly quit next() iterator while the file ends with sync and
appended
Howard Lee created HADOOP-15073:
-----------------------------------
Summary: SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended
Key: HADOOP-15073
URL: https://issues.apache.org/jira/browse/HADOOP-15073
Project: Hadoop Common
Issue Type: Bug
Components: common
Affects Versions: 3.0.0-alpha3, 2.8.2, 2.7.4, 2.6.3
Reporter: Howard Lee
The SequenceFile.Writer will insert SYNC into file every SYNC_INTERVAL.
In the case that SequenceFile ends with SYNC coincidentally, and another Writer open it with mode AppendIfExits, there meets the BUG.
For the AppendIfExits set _appendMode _ to _true_ , the init method will insert another SYNC. In such case, there will be two SYNC MAKR continuously.
In SequenceFile.Reader, the method readRecordLength will only test SYNC once, when there's two SYNC MARK, the _length_ will be -1(The begining of another SYNC), which means the end of file causing the next method quit unexpectedly.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org