[jira] [Commented] (LUCENE-9148) Move the BKD index to its own file.

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LUCENE-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198513#comment-17198513 ] 

ASF subversion and git services commented on LUCENE-9148:
---------------------------------------------------------

Commit 31ce699c51e546ecff1cf98ff6d447dde3b201c3 in lucene-solr's branch refs/heads/reference_impl_dev from Adrien Grand
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=31ce699 ]

LUCENE-9148: Move the BKD index to its own file. (#1475)

 Conflicts:
	lucene/backward-codecs/src/java/org/apache/lucene/codecs/lucene84/package-info.java
	lucene/backward-codecs/src/test/org/apache/lucene/codecs/lucene60/Lucene60RWPointsFormat.java
	solr/solrj/src/java/org/apache/solr/common/params/QoSParams.java


> Move the BKD index to its own file.
> -----------------------------------
>
>                 Key: LUCENE-9148
>                 URL: https://issues.apache.org/jira/browse/LUCENE-9148
>             Project: Lucene - Core
>          Issue Type: Task
>            Reporter: Adrien Grand
>            Priority: Minor
>             Fix For: 8.6
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Lucene60PointsWriter stores both inner nodes and leaf nodes in the same file, interleaved. For instance if you have two fields, you would have {{<leaf_nodes_A, inner_nodes_A, leaf_nodes_B, inner_nodes_B>}}. It's not ideal since leaves and inner nodes have quite different access patterns. Should we split this into two files? In the case when the BKD index is off-heap, this would also help force it into RAM with {{MMapDirectory#setPreload}}.
> Note that Lucene60PointsFormat already has a file that it calls "index" but it's really only about mapping fields to file pointers in the other file and not what I'm discussing here. But we could possibly store the BKD indices in this existing file if we want to avoid creating a new one.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org