You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Howard Lee (JIRA)" <ji...@apache.org> on 2017/11/30 03:07:00 UTC
[jira] [Commented] (HADOOP-15073) SequenceFile.Reader will
unexpectedly quit next() iterator while the file ends with sync and
appended
[ https://issues.apache.org/jira/browse/HADOOP-15073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272090#comment-16272090 ]
Howard Lee commented on HADOOP-15073:
-------------------------------------
There could be several SYNC MARK continuously, when you open a SequenceFile in append mode, but write nothing before close.
> SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended
> -----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-15073
> URL: https://issues.apache.org/jira/browse/HADOOP-15073
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
> Affects Versions: 2.6.3, 2.7.4, 2.8.2, 3.0.0-alpha3
> Reporter: Howard Lee
>
> The SequenceFile.Writer will insert SYNC into file every SYNC_INTERVAL.
> In the case that SequenceFile ends with SYNC coincidentally, and another Writer open it with mode AppendIfExits, there meets the BUG.
> For the AppendIfExits set _appendMode _ to _true_ , the init method will insert another SYNC. In such case, there will be two SYNC MAKR continuously.
> In SequenceFile.Reader, the method readRecordLength will only test SYNC once, when there's two SYNC MARK, the _length_ will be -1(The begining of another SYNC), which means the end of file causing the next method quit unexpectedly.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org