You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Zheng Lin Edwin Yeo <ed...@gmail.com> on 2015/12/07 12:06:10 UTC
FastVector Highlighter
Hi,
Would like to check, will using the FastVector Highlighter takes up more
indexing space (the index size) as compared to the Original Highlighter?
I'm using Solr 5.3.0
Regards,
Edwin
Re: FastVector Highlighter
Posted by Zheng Lin Edwin Yeo <ed...@gmail.com>.
Hi Emir,
Thanks for the clarification. If that improve the search performance then
it is worthwhile to have the bigger index size. Since for any search
engine, it is the search returning speed and accuracy that determines if
the search engine is a good one.
Regards,
Edwin
On 7 December 2015 at 23:40, Emir Arnautovic <em...@sematext.com>
wrote:
> Hi Edwin,
> It is expected since you are storing more info about document.
>
> Thanks,
> Emir
>
> p.s. one correction - I meant offsets, not frequencies.
>
>
> On 07.12.2015 15:47, Zheng Lin Edwin Yeo wrote:
>
>> Hi Emir,
>>
>> The term vector, positions and frequencies wasn't enabled, so I'm doing
>> the
>> re-indexing. That is where I found that the index size is bigger than
>> previously when I was using the Original Highlighter.
>>
>> Regards,
>> Edwin
>>
>>
>> On 7 December 2015 at 19:19, Emir Arnautovic <
>> emir.arnautovic@sematext.com>
>> wrote:
>>
>> Hi Edwin,
>>> FastVector Highlighter requires term vector, positions and frequencies,
>>> so
>>> if it is not enabled on fields that you want to highlight, it will
>>> increase
>>> index size. Since it is common to have those enabled for standard
>>> highlighter to speed up highlighting, those might already be enabled,
>>> otherwise reindexing is required as well.
>>>
>>> Regards,
>>> Emir
>>>
>>>
>>> On 07.12.2015 12:06, Zheng Lin Edwin Yeo wrote:
>>>
>>> Hi,
>>>>
>>>> Would like to check, will using the FastVector Highlighter takes up more
>>>> indexing space (the index size) as compared to the Original Highlighter?
>>>>
>>>> I'm using Solr 5.3.0
>>>>
>>>> Regards,
>>>> Edwin
>>>>
>>>>
>>>> --
>>> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>>> Solr & Elasticsearch Support * http://sematext.com/
>>>
>>>
>>>
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
Re: FastVector Highlighter
Posted by Emir Arnautovic <em...@sematext.com>.
Hi Edwin,
It is expected since you are storing more info about document.
Thanks,
Emir
p.s. one correction - I meant offsets, not frequencies.
On 07.12.2015 15:47, Zheng Lin Edwin Yeo wrote:
> Hi Emir,
>
> The term vector, positions and frequencies wasn't enabled, so I'm doing the
> re-indexing. That is where I found that the index size is bigger than
> previously when I was using the Original Highlighter.
>
> Regards,
> Edwin
>
>
> On 7 December 2015 at 19:19, Emir Arnautovic <em...@sematext.com>
> wrote:
>
>> Hi Edwin,
>> FastVector Highlighter requires term vector, positions and frequencies, so
>> if it is not enabled on fields that you want to highlight, it will increase
>> index size. Since it is common to have those enabled for standard
>> highlighter to speed up highlighting, those might already be enabled,
>> otherwise reindexing is required as well.
>>
>> Regards,
>> Emir
>>
>>
>> On 07.12.2015 12:06, Zheng Lin Edwin Yeo wrote:
>>
>>> Hi,
>>>
>>> Would like to check, will using the FastVector Highlighter takes up more
>>> indexing space (the index size) as compared to the Original Highlighter?
>>>
>>> I'm using Solr 5.3.0
>>>
>>> Regards,
>>> Edwin
>>>
>>>
>> --
>> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>> Solr & Elasticsearch Support * http://sematext.com/
>>
>>
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
Re: FastVector Highlighter
Posted by Zheng Lin Edwin Yeo <ed...@gmail.com>.
Hi Emir,
The term vector, positions and frequencies wasn't enabled, so I'm doing the
re-indexing. That is where I found that the index size is bigger than
previously when I was using the Original Highlighter.
Regards,
Edwin
On 7 December 2015 at 19:19, Emir Arnautovic <em...@sematext.com>
wrote:
> Hi Edwin,
> FastVector Highlighter requires term vector, positions and frequencies, so
> if it is not enabled on fields that you want to highlight, it will increase
> index size. Since it is common to have those enabled for standard
> highlighter to speed up highlighting, those might already be enabled,
> otherwise reindexing is required as well.
>
> Regards,
> Emir
>
>
> On 07.12.2015 12:06, Zheng Lin Edwin Yeo wrote:
>
>> Hi,
>>
>> Would like to check, will using the FastVector Highlighter takes up more
>> indexing space (the index size) as compared to the Original Highlighter?
>>
>> I'm using Solr 5.3.0
>>
>> Regards,
>> Edwin
>>
>>
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
Re: FastVector Highlighter
Posted by Emir Arnautovic <em...@sematext.com>.
Hi Edwin,
FastVector Highlighter requires term vector, positions and frequencies,
so if it is not enabled on fields that you want to highlight, it will
increase index size. Since it is common to have those enabled for
standard highlighter to speed up highlighting, those might already be
enabled, otherwise reindexing is required as well.
Regards,
Emir
On 07.12.2015 12:06, Zheng Lin Edwin Yeo wrote:
> Hi,
>
> Would like to check, will using the FastVector Highlighter takes up more
> indexing space (the index size) as compared to the Original Highlighter?
>
> I'm using Solr 5.3.0
>
> Regards,
> Edwin
>
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/