You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Igor Shalyminov <is...@yandex-team.ru> on 2013/10/15 15:44:43 UTC
No .pst, .fld, .vec files in the result index
Hi!
I'm trying to look at index contents by setting SimpleTextCodec into IndexWriterConfig.
The problem is, after indexing there are only .cfs, .cfe, .si, segments.gen and segments_h files, and the only plaintext file is .si.
.pst, .fld, .vec files are written too, but eventually they are deleted. How to index with keeping these files?
--
Best Regards,
Igor
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: No .pst, .fld, .vec files in the result index
Posted by Michael McCandless <lu...@mikemccandless.com>.
Actually, the compound file setters on NoMergePolicy do nothing: since
no merges ever run, they will have no effect.
And, it makes no sense for NoMergePolicy to have the COMPOUND_FILES
and NO_COMPOUND_FILES variants ... I'll open an issue to provide only
one.
Mike McCandless
http://blog.mikemccandless.com
On Tue, Oct 15, 2013 at 11:32 AM, Igor Shalyminov
<is...@yandex-team.ru> wrote:
> Mike, thank you, it works!
>
> But isn't it weird that my setting "setMaxCFSSegmentSizeMB(1)" was ignored (.cfs file was 600 MB)?
>
> --
> Igor
>
> 15.10.2013, 19:05, "Michael McCandless" <lu...@mikemccandless.com>:
>> You should only need to call
>> IndexWriterConfig.setUseCompoundFile(false), regardless of which
>> MergePolicy you use.
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>> On Tue, Oct 15, 2013 at 10:58 AM, Igor Shalyminov
>> <is...@yandex-team.ru> wrote:
>>
>>> It's very strange: I use NoMergePolicy.NO_COMPOUND_FILES, set MaxCFSSegmentSizeMB(1) and it still creates cfs.
>>>
>>> There must be something wrong with the MergePolicy.
>>>
>>> --
>>> Igor
>>>
>>> 15.10.2013, 17:45, "Igor Shalyminov" <is...@yandex-team.ru>:
>>>> Hi!
>>>>
>>>> I'm trying to look at index contents by setting SimpleTextCodec into IndexWriterConfig.
>>>> The problem is, after indexing there are only .cfs, .cfe, .si, segments.gen and segments_h files, and the only plaintext file is .si.
>>>>
>>>> .pst, .fld, .vec files are written too, but eventually they are deleted. How to index with keeping these files?
>>>>
>>>> --
>>>> Best Regards,
>>>> Igor
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: No .pst, .fld, .vec files in the result index
Posted by Igor Shalyminov <is...@yandex-team.ru>.
Mike, thank you, it works!
But isn't it weird that my setting "setMaxCFSSegmentSizeMB(1)" was ignored (.cfs file was 600 MB)?
--
Igor
15.10.2013, 19:05, "Michael McCandless" <lu...@mikemccandless.com>:
> You should only need to call
> IndexWriterConfig.setUseCompoundFile(false), regardless of which
> MergePolicy you use.
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
> On Tue, Oct 15, 2013 at 10:58 AM, Igor Shalyminov
> <is...@yandex-team.ru> wrote:
>
>> It's very strange: I use NoMergePolicy.NO_COMPOUND_FILES, set MaxCFSSegmentSizeMB(1) and it still creates cfs.
>>
>> There must be something wrong with the MergePolicy.
>>
>> --
>> Igor
>>
>> 15.10.2013, 17:45, "Igor Shalyminov" <is...@yandex-team.ru>:
>>> Hi!
>>>
>>> I'm trying to look at index contents by setting SimpleTextCodec into IndexWriterConfig.
>>> The problem is, after indexing there are only .cfs, .cfe, .si, segments.gen and segments_h files, and the only plaintext file is .si.
>>>
>>> .pst, .fld, .vec files are written too, but eventually they are deleted. How to index with keeping these files?
>>>
>>> --
>>> Best Regards,
>>> Igor
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: java-user-help@lucene.apache.org
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: No .pst, .fld, .vec files in the result index
Posted by Michael McCandless <lu...@mikemccandless.com>.
You should only need to call
IndexWriterConfig.setUseCompoundFile(false), regardless of which
MergePolicy you use.
Mike McCandless
http://blog.mikemccandless.com
On Tue, Oct 15, 2013 at 10:58 AM, Igor Shalyminov
<is...@yandex-team.ru> wrote:
> It's very strange: I use NoMergePolicy.NO_COMPOUND_FILES, set MaxCFSSegmentSizeMB(1) and it still creates cfs.
>
> There must be something wrong with the MergePolicy.
>
> --
> Igor
>
> 15.10.2013, 17:45, "Igor Shalyminov" <is...@yandex-team.ru>:
>> Hi!
>>
>> I'm trying to look at index contents by setting SimpleTextCodec into IndexWriterConfig.
>> The problem is, after indexing there are only .cfs, .cfe, .si, segments.gen and segments_h files, and the only plaintext file is .si.
>>
>> .pst, .fld, .vec files are written too, but eventually they are deleted. How to index with keeping these files?
>>
>> --
>> Best Regards,
>> Igor
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: No .pst, .fld, .vec files in the result index
Posted by Igor Shalyminov <is...@yandex-team.ru>.
It's very strange: I use NoMergePolicy.NO_COMPOUND_FILES, set MaxCFSSegmentSizeMB(1) and it still creates cfs.
There must be something wrong with the MergePolicy.
--
Igor
15.10.2013, 17:45, "Igor Shalyminov" <is...@yandex-team.ru>:
> Hi!
>
> I'm trying to look at index contents by setting SimpleTextCodec into IndexWriterConfig.
> The problem is, after indexing there are only .cfs, .cfe, .si, segments.gen and segments_h files, and the only plaintext file is .si.
>
> .pst, .fld, .vec files are written too, but eventually they are deleted. How to index with keeping these files?
>
> --
> Best Regards,
> Igor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org