You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mark Miller (JIRA)" <ji...@apache.org> on 2016/02/12 04:00:23 UTC
[jira] [Comment Edited] (SOLR-8575) Fix HDFSLogReader replay status
numbers and a performance bug where we can reopen FSDataInputStream too
often.
[ https://issues.apache.org/jira/browse/SOLR-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143938#comment-15143938 ]
Mark Miller edited comment on SOLR-8575 at 2/12/16 2:59 AM:
------------------------------------------------------------
Here is the patch I'm currently playing with.
On opening the the Log reader, when we first open the input stream reader, we now hflush before that. In all the fails I was seeing, the starting position was 0 and we were hitting EOF pretty much right away.
Still testing out, but I think I'm on the right path.
was (Author: markrmiller@gmail.com):
Here is the patch I'm currently playing with.
On opening the the Log reader, when we first open the input stream reader, we now hflush before that. In all the feels I was seeing, the starting position was 0 and we were hitting EOF pretty much right away.
Still testing out, but I think I'm on the right path.
> Fix HDFSLogReader replay status numbers and a performance bug where we can reopen FSDataInputStream too often.
> --------------------------------------------------------------------------------------------------------------
>
> Key: SOLR-8575
> URL: https://issues.apache.org/jira/browse/SOLR-8575
> Project: Solr
> Issue Type: Bug
> Reporter: Mark Miller
> Assignee: Mark Miller
> Fix For: master
>
> Attachments: SOLR-8575.patch, SOLR-8575.patch
>
>
> [~pdvorak@cloudera.com] noticed some funny transaction log replay status logging a while back:
> active=true starting pos=444978 current pos=2855956 current size=16262 % read=17562
> active=true starting pos=444978 current pos=5748869 current size=16262 % read=35352
> 17562% read? Current size does not change as expected in this case?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org