DO NOT REPLY [Bug 27743] - [PATCH] Added support for segmented field data files and cached directories

[bu...@apache.org]

DO NOT REPLY TO THIS EMAIL, BUT PLEASE POST YOUR BUG 
RELATED COMMENTS THROUGH THE WEB INTERFACE AVAILABLE AT
<http://issues.apache.org/bugzilla/show_bug.cgi?id=27743>.
ANY REPLY MADE TO THIS MESSAGE WILL NOT BE COLLECTED AND 
INSERTED IN THE BUG DATABASE.

http://issues.apache.org/bugzilla/show_bug.cgi?id=27743

[PATCH] Added support for segmented field data files and cached directories

ck@rrzn.uni-hannover.de changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|[PATCH] Added support for   |[PATCH] Added support for
                   |segmented field data files  |segmented field data files
                   |                            |and cached directories



------- Additional Comments From ck@rrzn.uni-hannover.de  2004-03-18 12:09 -------
Another addition, which is especially useful in combination with this patch, 
but its use not limited to that. 
 
My "CachedDirectory" enables you to put specific files of a Directory into a  
RAMDirectory, whereas all the others are kept in an FSDirectory, for example.  
This speeds up access to certain, smaller files, whereas the bigger files 
remain on disk. 
  
The decision whether to cache a file or not may be made using a  
"FileFilter" (interface provided with this patch), or for all files (cache  
all).  
 
This makes using the Field-data-store patch very comfortable, as no 
system-specific symlinks have to be created (should now also work on Windows). 
To keep the ".fdt" file in RAM, you would only need a FileFilter that returns 
"true" for all files ending with ".fdt" and "false" otherwise. 
  
The CachedDirectory also works with compound indexes. 
 
The problem is that there is no public Directory implementation for them, only 
an internal "CompoundFileReader", which does not provide access to the 
"deletable" and "segment" files - they are kept outside the compound file. I 
have implemented a preliminary "CompoundDirectoryWrapper" which provides 
transparent access to a directory containing an arbitrary number of compound 
files as well as unpacked files like "deletable" and "segment". 
 
Although the CachedDirectory can be used quite independently from the 
multiple-field-data patch, I think it's ok to attach it here as well. 
 
I have also written a new method (read "stolen from RAMDirectory")  
"Directory.copyFrom(Directory source, String sourceName, String targetName)" 
to make copying files between two Directories easier. 
 
In addition to the documented classes, there are also two JUnit test cases, 
which could be used as a starting point. 
 
Just tell me what you think. 
 
 
Christian

---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org