You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Shawn Heisey <ap...@elyograg.org> on 2015/09/18 23:27:32 UTC
Is docValues required in Solr 5.x for distributed result grouping?
A query that works fine in Solr 4.9.1 doesn't work in 5.2.1 with the
same schema. The field that I am grouping on does not have docValues.
I get this exception:
java.lang.IllegalStateException: unexpected docvalues type SORTED_SET
for field 'ip' (expected=SORTED). Use UninvertingReader or index with
docvalues.
If I make a non-distributed request to a single shard on 5.2.1, or a
distributed request on 4.9.1, it works fine. I created a copyField with
docvalues, and I can do grouping on that field in 5.2.1.
The original field uses KeywordTokenizerFactory, then it is lowercased.
The copy with docValues is StrField. I need it to be lowercased in the
groups (analyzed terms), so StrField isn't really what I'm after.
This seems like a bug. I'm ready to file an issue in Jira, but thought
it would be a good idea to mention it here first.
Thanks,
Shawn
Re: Is docValues required in Solr 5.x for distributed result
grouping?
Posted by Oliver Schrenk <os...@elmar.nl>.
The error message looks a lot like this bug
https://issues.apache.org/jira/browse/SOLR-7495
group.faceting is broken for numeric values. Does it mean that I have to enable docvalues for every field that I want to facet on?
On 24 Sep 2015, at 17:02, Tomoko Uchida <to...@gmail.com>> wrote:
Hi,
Of course the Doc Values data structure can be used by anything who wants
to retrieve the column base view of documents per field, but is anywhere
documented all the ways it's used in Solr ?
According to the Solr guide about docvalues, it is used in faceting,
sorting, and grouping.
https://cwiki.apache.org/confluence/display/solr/DocValues
In Lucene 4.0, a new approach was introduced. DocValue fields are now
column-oriented fields with a document-to-value mapping built at index
time. This approach promises to relieve some of the memory requirements of
the fieldCache and make lookups for faceting, sorting, and grouping much
faster.
I'm not sure about other docvalues uses not mentioned here... I'd also like
to know if there are.
Thanks,
Tomoko
2015-09-24 17:26 GMT+09:00 Alessandro Benedetti <be...@gmail.com>
:
I didn't know DocValues to be used apart from sorting and faceting (fc
algorithm) on fields.
Of course the Doc Values data structure can be used by anything who wants
to retrieve the column base view of documents per field, but is anywhere
documented all the ways it's used in Solr ?
Cheers
2015-09-24 2:33 GMT+01:00 Shawn Heisey <ap...@elyograg.org>:
On 9/18/2015 3:27 PM, Shawn Heisey wrote:
A query that works fine in Solr 4.9.1 doesn't work in 5.2.1 with the
same schema. The field that I am grouping on does not have docValues.
I get this exception:
java.lang.IllegalStateException: unexpected docvalues type SORTED_SET
for field 'ip' (expected=SORTED). Use UninvertingReader or index with
docvalues.
No response in five days ... I guess I'll go ahead and raise that issue.
Thanks,
Shawn
--
--------------------------
Benedetti Alessandro
Visiting card - http://about.me/alessandro_benedetti
Blog - http://alexbenedetti.blogspot.co.uk
"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"
William Blake - Songs of Experience -1794 England
Re: Is docValues required in Solr 5.x for distributed result grouping?
Posted by Tomoko Uchida <to...@gmail.com>.
Hi,
> Of course the Doc Values data structure can be used by anything who wants
> to retrieve the column base view of documents per field, but is anywhere
> documented all the ways it's used in Solr ?
According to the Solr guide about docvalues, it is used in faceting,
sorting, and grouping.
https://cwiki.apache.org/confluence/display/solr/DocValues
> In Lucene 4.0, a new approach was introduced. DocValue fields are now
column-oriented fields with a document-to-value mapping built at index
time. This approach promises to relieve some of the memory requirements of
the fieldCache and make lookups for faceting, sorting, and grouping much
faster.
I'm not sure about other docvalues uses not mentioned here... I'd also like
to know if there are.
Thanks,
Tomoko
2015-09-24 17:26 GMT+09:00 Alessandro Benedetti <be...@gmail.com>
:
> I didn't know DocValues to be used apart from sorting and faceting (fc
> algorithm) on fields.
> Of course the Doc Values data structure can be used by anything who wants
> to retrieve the column base view of documents per field, but is anywhere
> documented all the ways it's used in Solr ?
>
> Cheers
>
> 2015-09-24 2:33 GMT+01:00 Shawn Heisey <ap...@elyograg.org>:
>
> > On 9/18/2015 3:27 PM, Shawn Heisey wrote:
> > > A query that works fine in Solr 4.9.1 doesn't work in 5.2.1 with the
> > > same schema. The field that I am grouping on does not have docValues.
> > > I get this exception:
> > >
> > > java.lang.IllegalStateException: unexpected docvalues type SORTED_SET
> > > for field 'ip' (expected=SORTED). Use UninvertingReader or index with
> > > docvalues.
> >
> > No response in five days ... I guess I'll go ahead and raise that issue.
> >
> > Thanks,
> > Shawn
> >
> >
> >
>
>
> --
> --------------------------
>
> Benedetti Alessandro
> Visiting card - http://about.me/alessandro_benedetti
> Blog - http://alexbenedetti.blogspot.co.uk
>
> "Tyger, tyger burning bright
> In the forests of the night,
> What immortal hand or eye
> Could frame thy fearful symmetry?"
>
> William Blake - Songs of Experience -1794 England
>
Re: Is docValues required in Solr 5.x for distributed result grouping?
Posted by Alessandro Benedetti <be...@gmail.com>.
I didn't know DocValues to be used apart from sorting and faceting (fc
algorithm) on fields.
Of course the Doc Values data structure can be used by anything who wants
to retrieve the column base view of documents per field, but is anywhere
documented all the ways it's used in Solr ?
Cheers
2015-09-24 2:33 GMT+01:00 Shawn Heisey <ap...@elyograg.org>:
> On 9/18/2015 3:27 PM, Shawn Heisey wrote:
> > A query that works fine in Solr 4.9.1 doesn't work in 5.2.1 with the
> > same schema. The field that I am grouping on does not have docValues.
> > I get this exception:
> >
> > java.lang.IllegalStateException: unexpected docvalues type SORTED_SET
> > for field 'ip' (expected=SORTED). Use UninvertingReader or index with
> > docvalues.
>
> No response in five days ... I guess I'll go ahead and raise that issue.
>
> Thanks,
> Shawn
>
>
>
--
--------------------------
Benedetti Alessandro
Visiting card - http://about.me/alessandro_benedetti
Blog - http://alexbenedetti.blogspot.co.uk
"Tyger, tyger burning bright
In the forests of the night,
What immortal hand or eye
Could frame thy fearful symmetry?"
William Blake - Songs of Experience -1794 England
Re: Is docValues required in Solr 5.x for distributed result
grouping?
Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/18/2015 3:27 PM, Shawn Heisey wrote:
> A query that works fine in Solr 4.9.1 doesn't work in 5.2.1 with the
> same schema. The field that I am grouping on does not have docValues.
> I get this exception:
>
> java.lang.IllegalStateException: unexpected docvalues type SORTED_SET
> for field 'ip' (expected=SORTED). Use UninvertingReader or index with
> docvalues.
No response in five days ... I guess I'll go ahead and raise that issue.
Thanks,
Shawn