[jira] [Commented] (SOLR-6393) Improve transaction log replay speed on HDFS.

["Mark Miller (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103383#comment-14103383 ] 

Mark Miller commented on SOLR-6393:
-----------------------------------

The brings straight read speed from abysmal to something on par with the local filesystem implementation. That will be signifgant in the case the transaction log needs to be replayed on startup and updates are not coming in.

read/write speed will still hit ugly reader reopens, but should also be much faster as updates will be read in larger batches than one in most cases.

> Improve transaction log replay speed on HDFS.
> ---------------------------------------------
>
>                 Key: SOLR-6393
>                 URL: https://issues.apache.org/jira/browse/SOLR-6393
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 5.0, 4.10
>
>         Attachments: SOLR-6393.patch
>
>
> Replay speed is pretty slow on HDFS because we currently reopen a reader between reading each update.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org