You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mark Miller (JIRA)" <ji...@apache.org> on 2013/08/16 19:38:48 UTC
[jira] [Comment Edited] (SOLR-5150) HdfsIndexInput may not fully
read requested bytes.
[ https://issues.apache.org/jira/browse/SOLR-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742433#comment-13742433 ]
Mark Miller edited comment on SOLR-5150 at 8/16/13 5:37 PM:
------------------------------------------------------------
[~phunt] was on vacation, but is now back and may have some thoughts on this issue as well.
was (Author: markrmiller@gmail.com):
@phunt was on vacation, but is now back and may have some thoughts on this issue as well.
> HdfsIndexInput may not fully read requested bytes.
> --------------------------------------------------
>
> Key: SOLR-5150
> URL: https://issues.apache.org/jira/browse/SOLR-5150
> Project: Solr
> Issue Type: Bug
> Affects Versions: 4.4
> Reporter: Mark Miller
> Assignee: Mark Miller
> Fix For: 4.5, 5.0
>
> Attachments: SOLR-5150.patch
>
>
> Patrick Hunt noticed that our HdfsDirectory code was a bit behind Blur here - the read call we are using may not read all of the requested bytes - it returns the number of bytes actually written - which we ignore.
> Blur moved to using a seek and then readFully call - synchronizing across the two calls to deal with clones.
> We have seen that really kills performance, and using the readFully call that lets you pass the position rather than first doing a seek, performs much better and does not require the synchronization.
> I also noticed that the seekInternal impl should not seek but be a no op since we are seeking on the read.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org