You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@lucene.apache.org by Praveen Nishchal <pr...@gmail.com> on 2021/07/30 08:40:22 UTC

Rationale behind different maxDocsPerChunk in Lucene90CompressingStoredFieldsFormat

Hello,

What is the rationale behind choosing different maxDocsPerChunk in
Lucene90CompressingStoredFieldsFormat? I found it to be 1024 in case of lz4
while 4096 in case of zlib. Is it an experimented value established from
benchmark or something to do with 60KB or 48KB block size ?

Thanks,
Praveen

Re: Rationale behind different maxDocsPerChunk in Lucene90CompressingStoredFieldsFormat

Posted by Adrien Grand <jp...@gmail.com>.

I left a comment on the other thread where you asked a similar question.

On Mon, Aug 9, 2021 at 6:14 PM Praveen Nishchal <pr...@gmail.com>
wrote:

> Any thoughts on  maxDocsPerChunk <-> chunkSize relation ?
>
> On Fri, Jul 30, 2021 at 2:10 PM Praveen Nishchal <pr...@gmail.com>
> wrote:
>
>> Hello,
>>
>> What is the rationale behind choosing different maxDocsPerChunk in
>> Lucene90CompressingStoredFieldsFormat? I found it to be 1024 in case of lz4
>> while 4096 in case of zlib. Is it an experimented value established from
>> benchmark or something to do with 60KB or 48KB block size ?
>>
>> Thanks,
>> Praveen
>>
>

-- 
Adrien

Re: Rationale behind different maxDocsPerChunk in Lucene90CompressingStoredFieldsFormat

Posted by Praveen Nishchal <pr...@gmail.com>.

Any thoughts on  maxDocsPerChunk <-> chunkSize relation ?

On Fri, Jul 30, 2021 at 2:10 PM Praveen Nishchal <pr...@gmail.com>
wrote:

> Hello,
>
> What is the rationale behind choosing different maxDocsPerChunk in
> Lucene90CompressingStoredFieldsFormat? I found it to be 1024 in case of lz4
> while 4096 in case of zlib. Is it an experimented value established from
> benchmark or something to do with 60KB or 48KB block size ?
>
> Thanks,
> Praveen
>