Settings for DocValues

[Zheng Lin Edwin Yeo <ed...@gmail.com>]

Hi,

Would like to find out, if we set docValues="true" in my configuration of
the fieldType in schema,xml, must we set the corresponding indexed="false"
and stored="false"

Will there be any implication if I set my indexed="true and stored="true"?

I'm using Solr 6.1.0

Regards,
Edwin

Re: Settings for DocValues

[Alessandro Benedetti <ab...@apache.org>]

In addition to what Erick said, there is actually a smaller implication
between Stored and docValues as well .
With latest Solr releases docValues data structures are used to fetch the
stored content.
In the case of multi-valued fields, we can have inconsistency with the
ordering of the multiple values.

So, if the case applies, I suggest to specify the additional attribute.

In the past, Solr guaranteed that retrieval of multi-valued fields would
> preserve the order of values. Because values may now be retrieved from
> column-stored fields (docValues="true"), in conjunction with the fact
> that DocValues
> <https://cwiki.apache.org/confluence/display/solr/DocValues> do not
> currently preserve order, means that users should set
> useDocValuesAsStored="false"
> <https://cwiki.apache.org/confluence/display/solr/Defining+Fields> to
> prevent future optimizations from using the column-stored values over the
> row-stored values when fields have both stored="true" and docValues="true"


Cheers

On Wed, Aug 24, 2016 at 4:42 AM, Zheng Lin Edwin Yeo <ed...@gmail.com>
wrote:

> Hi Erick,
>
> Thanks for the explanation.
>
> Regards,
> Edwin
>
>
> On 24 August 2016 at 02:27, Erick Erickson <er...@gmail.com>
> wrote:
>
> > These are orthogonal. The indexed and docvalues
> > structures are very different. One is useful for
> > searching and the other is useful for faceting and the like.
> >
> > If you set indexed="false" and docValues="true", then try
> > to search on the field you roughly do a "table scan" which
> > is very slow.
> >
> > Rule of thumb:
> > If you're searching set indexed="true".
> > If you're faceting/grouping/sorting set docValues="true".
> >
> > Best,
> > Erick
> >
> > On Tue, Aug 23, 2016 at 8:14 AM, Zheng Lin Edwin Yeo
> > <ed...@gmail.com> wrote:
> > > Hi,
> > >
> > > Would like to find out, if we set docValues="true" in my configuration
> of
> > > the fieldType in schema,xml, must we set the corresponding
> > indexed="false"
> > > and stored="false"
> > >
> > > Will there be any implication if I set my indexed="true and
> > stored="true"?
> > >
> > > I'm using Solr 6.1.0
> > >
> > > Regards,
> > > Edwin
> >
>



-- 
--------------------------

Benedetti Alessandro
Visiting card : http://about.me/alessandro_benedetti

"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"

William Blake - Songs of Experience -1794 England

Re: Settings for DocValues

[Zheng Lin Edwin Yeo <ed...@gmail.com>]

Hi Erick,

Thanks for the explanation.

Regards,
Edwin


On 24 August 2016 at 02:27, Erick Erickson <er...@gmail.com> wrote:

> These are orthogonal. The indexed and docvalues
> structures are very different. One is useful for
> searching and the other is useful for faceting and the like.
>
> If you set indexed="false" and docValues="true", then try
> to search on the field you roughly do a "table scan" which
> is very slow.
>
> Rule of thumb:
> If you're searching set indexed="true".
> If you're faceting/grouping/sorting set docValues="true".
>
> Best,
> Erick
>
> On Tue, Aug 23, 2016 at 8:14 AM, Zheng Lin Edwin Yeo
> <ed...@gmail.com> wrote:
> > Hi,
> >
> > Would like to find out, if we set docValues="true" in my configuration of
> > the fieldType in schema,xml, must we set the corresponding
> indexed="false"
> > and stored="false"
> >
> > Will there be any implication if I set my indexed="true and
> stored="true"?
> >
> > I'm using Solr 6.1.0
> >
> > Regards,
> > Edwin
>

Re: Settings for DocValues

[Erick Erickson <er...@gmail.com>]

These are orthogonal. The indexed and docvalues
structures are very different. One is useful for
searching and the other is useful for faceting and the like.

If you set indexed="false" and docValues="true", then try
to search on the field you roughly do a "table scan" which
is very slow.

Rule of thumb:
If you're searching set indexed="true".
If you're faceting/grouping/sorting set docValues="true".

Best,
Erick

On Tue, Aug 23, 2016 at 8:14 AM, Zheng Lin Edwin Yeo
<ed...@gmail.com> wrote:
> Hi,
>
> Would like to find out, if we set docValues="true" in my configuration of
> the fieldType in schema,xml, must we set the corresponding indexed="false"
> and stored="false"
>
> Will there be any implication if I set my indexed="true and stored="true"?
>
> I'm using Solr 6.1.0
>
> Regards,
> Edwin