You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "Sanders, Marshall (AT - Atlanta)" <Ma...@autotrader.com> on 2015/11/16 17:00:00 UTC
Expand Component Fields Response
Is it possible to specify a separate set of fields to return from the expand component which is different from the standard fl parameter? Something like this:
fl=fielda&expand.fl=fieldb
Our current use case means we actually only care about the numFound from the expand component and not any of the actual fields. We could also use a facet for the field we're collapsing on, but this means mapping from the field we collapsed on to the different facets and isn't very elegant, and we also have to ask for a large facet.limit to make sure that we get the appropriate counts back. This is pretty poor for high cardinality fields. The alternative is the current where we ask for the expand component and get TONS of information back that we don't care about.
Thanks for any help!
Marshall Sanders
Technical Lead - Software Engineer
Autotrader.com
404-568-7130
RE: Expand Component Fields Response
Posted by "Sanders, Marshall (AT - Atlanta)" <Ma...@autotrader.com>.
Joel,
Thanks for the response. I updated the JIRA with 2 new patches. One for trunk, and one for branches/branch_5x. It would be great if it could get reviewed and make it in before 5.4 if it meets approval.
https://issues.apache.org/jira/browse/SOLR-8306
Thanks,
Marshall Sanders
Technical Lead – Software Engineer
Autotrader.com
404-568-7130
-----Original Message-----
From: Joel Bernstein [mailto:joelsolr@gmail.com]
Sent: Tuesday, November 17, 2015 5:37 PM
To: solr-user@lucene.apache.org
Subject: Re: Expand Component Fields Response
Hi Marshall,
This sounds pretty reasonable. I should have some to review the patch later in the week.
Joel Bernstein
http://joelsolr.blogspot.com/
On Tue, Nov 17, 2015 at 3:42 PM, Sanders, Marshall (AT - Atlanta) < Marshall.Sanders@autotrader.com> wrote:
> Well I didn't receive any responses and couldn't find any resources so
> I created a patch and a corresponding JIRA to allow the
> ExpandComponent to use the TotalHitCountCollector which will only
> return the total hit count when expand.rows=0 which more accurately
> reflected my use case. (We don't care about the expanded document
> itself, just the number available so that we can show something like
> "52 more like this")
>
> https://issues.apache.org/jira/browse/SOLR-8306
>
> I'm not sure if this is the right forum for something like this, or
> how to get feedback on the patch. If someone more knowledgeable could
> help me out in that area it would be excellent. Thanks!
>
> Marshall Sanders
> Technical Lead - Software Engineer
> Autotrader.com
> 404-568-7130
>
> -----Original Message-----
> From: Sanders, Marshall (AT - Atlanta) [mailto:
> Marshall.Sanders@autotrader.com]
> Sent: Monday, November 16, 2015 11:00 AM
> To: solr-user@lucene.apache.org
> Subject: Expand Component Fields Response
>
> Is it possible to specify a separate set of fields to return from the
> expand component which is different from the standard fl parameter?
> Something like this:
>
> fl=fielda&expand.fl=fieldb
>
> Our current use case means we actually only care about the numFound
> from the expand component and not any of the actual fields. We could
> also use a facet for the field we're collapsing on, but this means
> mapping from the field we collapsed on to the different facets and
> isn't very elegant, and we also have to ask for a large facet.limit to
> make sure that we get the appropriate counts back. This is pretty poor for high cardinality fields.
> The alternative is the current where we ask for the expand component
> and get TONS of information back that we don't care about.
>
> Thanks for any help!
>
> Marshall Sanders
> Technical Lead - Software Engineer
> Autotrader.com
> 404-568-7130
>
>
Re: Expand Component Fields Response
Posted by Joel Bernstein <jo...@gmail.com>.
Hi Marshall,
This sounds pretty reasonable. I should have some to review the patch later
in the week.
Joel Bernstein
http://joelsolr.blogspot.com/
On Tue, Nov 17, 2015 at 3:42 PM, Sanders, Marshall (AT - Atlanta) <
Marshall.Sanders@autotrader.com> wrote:
> Well I didn't receive any responses and couldn't find any resources so I
> created a patch and a corresponding JIRA to allow the ExpandComponent to
> use the TotalHitCountCollector which will only return the total hit count
> when expand.rows=0 which more accurately reflected my use case. (We don't
> care about the expanded document itself, just the number available so that
> we can show something like "52 more like this")
>
> https://issues.apache.org/jira/browse/SOLR-8306
>
> I'm not sure if this is the right forum for something like this, or how to
> get feedback on the patch. If someone more knowledgeable could help me out
> in that area it would be excellent. Thanks!
>
> Marshall Sanders
> Technical Lead - Software Engineer
> Autotrader.com
> 404-568-7130
>
> -----Original Message-----
> From: Sanders, Marshall (AT - Atlanta) [mailto:
> Marshall.Sanders@autotrader.com]
> Sent: Monday, November 16, 2015 11:00 AM
> To: solr-user@lucene.apache.org
> Subject: Expand Component Fields Response
>
> Is it possible to specify a separate set of fields to return from the
> expand component which is different from the standard fl parameter?
> Something like this:
>
> fl=fielda&expand.fl=fieldb
>
> Our current use case means we actually only care about the numFound from
> the expand component and not any of the actual fields. We could also use a
> facet for the field we're collapsing on, but this means mapping from the
> field we collapsed on to the different facets and isn't very elegant, and
> we also have to ask for a large facet.limit to make sure that we get the
> appropriate counts back. This is pretty poor for high cardinality fields.
> The alternative is the current where we ask for the expand component and
> get TONS of information back that we don't care about.
>
> Thanks for any help!
>
> Marshall Sanders
> Technical Lead - Software Engineer
> Autotrader.com
> 404-568-7130
>
>
RE: Expand Component Fields Response
Posted by "Sanders, Marshall (AT - Atlanta)" <Ma...@autotrader.com>.
Well I didn't receive any responses and couldn't find any resources so I created a patch and a corresponding JIRA to allow the ExpandComponent to use the TotalHitCountCollector which will only return the total hit count when expand.rows=0 which more accurately reflected my use case. (We don't care about the expanded document itself, just the number available so that we can show something like "52 more like this")
https://issues.apache.org/jira/browse/SOLR-8306
I'm not sure if this is the right forum for something like this, or how to get feedback on the patch. If someone more knowledgeable could help me out in that area it would be excellent. Thanks!
Marshall Sanders
Technical Lead - Software Engineer
Autotrader.com
404-568-7130
-----Original Message-----
From: Sanders, Marshall (AT - Atlanta) [mailto:Marshall.Sanders@autotrader.com]
Sent: Monday, November 16, 2015 11:00 AM
To: solr-user@lucene.apache.org
Subject: Expand Component Fields Response
Is it possible to specify a separate set of fields to return from the expand component which is different from the standard fl parameter? Something like this:
fl=fielda&expand.fl=fieldb
Our current use case means we actually only care about the numFound from the expand component and not any of the actual fields. We could also use a facet for the field we're collapsing on, but this means mapping from the field we collapsed on to the different facets and isn't very elegant, and we also have to ask for a large facet.limit to make sure that we get the appropriate counts back. This is pretty poor for high cardinality fields. The alternative is the current where we ask for the expand component and get TONS of information back that we don't care about.
Thanks for any help!
Marshall Sanders
Technical Lead - Software Engineer
Autotrader.com
404-568-7130