You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Ennio Bozzetti <EB...@thorlabs.com> on 2018/04/26 19:38:38 UTC
Search Analytics Help
Hello,
I'm setting up SOLR on an internal website for my company and I would like to know if anyone can recommend an analytics that I can see what the users are searching for? Does the log in SOLR give me that information?
Thank you,
Ennio Bozzetti
Re: Search Analytics Help
Posted by Walter Underwood <wu...@wunderwood.org>.
In the past, I’ve recommended seaurchin.io, a great tool. But, they were acquired by Algolia and the service will be shut down this month.
As far as I know, there is nothing close to SeaUrchin.
wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/ (my blog)
> On Apr 27, 2018, at 6:54 AM, Doug Turnbull <dt...@opensourceconnections.com> wrote:
>
> Exactly Alessandro -
>
> I can totally build something, but there's not a good open source solution
> solution for:
>
> - Gathering queries / user / session metadata at search time from your app
> - Gathering the returned result set and their display posn (just doc ids
> would be fine)
> - Gathering the clicks/conversions/reformulations/etc that result from that
> search
>
> Then with that data
>
> - Show search relevance performance in dashboards to business stakeholders
> - Allow computation over this data to create training sets for LTR, etc
>
> I see companies reinvent this wheel over and over and over... Surprised
> Elastic hasn't built 'SearchBeat' that does all this :)
>
> -Doug
>
>
>
> On Fri, Apr 27, 2018 at 9:47 AM Alessandro Benedetti <a....@sease.io>
> wrote:
>
>> Michal,
>> Doug was referring to an open source solution ready out of the box and just
>> pluggable ( a sort of plug and play).
>> Of course you can implement your own solution and using ELK or kafka is
>> absolutely a valid option.
>>
>> Cheers
>>
>>
>> --------------------------
>> Alessandro Benedetti
>> Search Consultant, R&D Software Engineer, Director
>> www.sease.io
>>
>> On Fri, Apr 27, 2018 at 10:21 AM, Michal Hlavac <mi...@hlavki.eu> wrote:
>>
>>> Hi,
>>>
>>> you have plenty options. Without any special effort there is ELK. Parse
>>> solr logs with logstash, feed elasticsearch with data, then analyze in
>>> kibana.
>>>
>>> Another option is to send every relevant search request to kafka, then
>> you
>>> can do more sophisticated data analytic using kafka-stream API. Then use
>>> ELK to feed elasticsearch with logstash kafka input plugin. For this
>>> scenario you need to do some programming. I`ve already created this
>>> component but I hadn't time to publish it.
>>>
>>> Another option is use only logstash to feed e.g. graphite database and
>>> show results with grafana or combine all these options.
>>>
>>> You can also monitor SOLR instances by JMX logstash input plugin.
>>>
>>> Really don't understand what do you mean by saying that there is nothing
>>> satisfactory.
>>>
>>> m.
>>>
>>> On štvrtok, 26. apríla 2018 22:23:30 CEST Doug Turnbull wrote:
>>>> Honestly I haven’t seen anything satisfactory (yet). It’s a huge need
>> in
>>>> the open source community
>>>>
>>>> On Thu, Apr 26, 2018 at 3:38 PM Ennio Bozzetti <EBozzetti@thorlabs.com
>>>
>>>> wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> I'm setting up SOLR on an internal website for my company and I would
>>> like
>>>>> to know if anyone can recommend an analytics that I can see what the
>>> users
>>>>> are searching for? Does the log in SOLR give me that information?
>>>>>
>>>>> Thank you,
>>>>> Ennio Bozzetti
>>>>>
>>>>> --
>>>> CTO, OpenSource Connections
>>>> Author, Relevant Search
>>>> http://o19s.com/doug
>>>
>>>
>>>
>>
> --
> CTO, OpenSource Connections
> Author, Relevant Search
> http://o19s.com/doug
Re: Search Analytics Help
Posted by Doug Turnbull <dt...@opensourceconnections.com>.
Exactly Alessandro -
I can totally build something, but there's not a good open source solution
solution for:
- Gathering queries / user / session metadata at search time from your app
- Gathering the returned result set and their display posn (just doc ids
would be fine)
- Gathering the clicks/conversions/reformulations/etc that result from that
search
Then with that data
- Show search relevance performance in dashboards to business stakeholders
- Allow computation over this data to create training sets for LTR, etc
I see companies reinvent this wheel over and over and over... Surprised
Elastic hasn't built 'SearchBeat' that does all this :)
-Doug
On Fri, Apr 27, 2018 at 9:47 AM Alessandro Benedetti <a....@sease.io>
wrote:
> Michal,
> Doug was referring to an open source solution ready out of the box and just
> pluggable ( a sort of plug and play).
> Of course you can implement your own solution and using ELK or kafka is
> absolutely a valid option.
>
> Cheers
>
>
> --------------------------
> Alessandro Benedetti
> Search Consultant, R&D Software Engineer, Director
> www.sease.io
>
> On Fri, Apr 27, 2018 at 10:21 AM, Michal Hlavac <mi...@hlavki.eu> wrote:
>
> > Hi,
> >
> > you have plenty options. Without any special effort there is ELK. Parse
> > solr logs with logstash, feed elasticsearch with data, then analyze in
> > kibana.
> >
> > Another option is to send every relevant search request to kafka, then
> you
> > can do more sophisticated data analytic using kafka-stream API. Then use
> > ELK to feed elasticsearch with logstash kafka input plugin. For this
> > scenario you need to do some programming. I`ve already created this
> > component but I hadn't time to publish it.
> >
> > Another option is use only logstash to feed e.g. graphite database and
> > show results with grafana or combine all these options.
> >
> > You can also monitor SOLR instances by JMX logstash input plugin.
> >
> > Really don't understand what do you mean by saying that there is nothing
> > satisfactory.
> >
> > m.
> >
> > On štvrtok, 26. apríla 2018 22:23:30 CEST Doug Turnbull wrote:
> > > Honestly I haven’t seen anything satisfactory (yet). It’s a huge need
> in
> > > the open source community
> > >
> > > On Thu, Apr 26, 2018 at 3:38 PM Ennio Bozzetti <EBozzetti@thorlabs.com
> >
> > > wrote:
> > >
> > > > Hello,
> > > >
> > > > I'm setting up SOLR on an internal website for my company and I would
> > like
> > > > to know if anyone can recommend an analytics that I can see what the
> > users
> > > > are searching for? Does the log in SOLR give me that information?
> > > >
> > > > Thank you,
> > > > Ennio Bozzetti
> > > >
> > > > --
> > > CTO, OpenSource Connections
> > > Author, Relevant Search
> > > http://o19s.com/doug
> >
> >
> >
>
--
CTO, OpenSource Connections
Author, Relevant Search
http://o19s.com/doug
Re: Search Analytics Help
Posted by Alessandro Benedetti <a....@sease.io>.
Michal,
Doug was referring to an open source solution ready out of the box and just
pluggable ( a sort of plug and play).
Of course you can implement your own solution and using ELK or kafka is
absolutely a valid option.
Cheers
--------------------------
Alessandro Benedetti
Search Consultant, R&D Software Engineer, Director
www.sease.io
On Fri, Apr 27, 2018 at 10:21 AM, Michal Hlavac <mi...@hlavki.eu> wrote:
> Hi,
>
> you have plenty options. Without any special effort there is ELK. Parse
> solr logs with logstash, feed elasticsearch with data, then analyze in
> kibana.
>
> Another option is to send every relevant search request to kafka, then you
> can do more sophisticated data analytic using kafka-stream API. Then use
> ELK to feed elasticsearch with logstash kafka input plugin. For this
> scenario you need to do some programming. I`ve already created this
> component but I hadn't time to publish it.
>
> Another option is use only logstash to feed e.g. graphite database and
> show results with grafana or combine all these options.
>
> You can also monitor SOLR instances by JMX logstash input plugin.
>
> Really don't understand what do you mean by saying that there is nothing
> satisfactory.
>
> m.
>
> On štvrtok, 26. apríla 2018 22:23:30 CEST Doug Turnbull wrote:
> > Honestly I haven’t seen anything satisfactory (yet). It’s a huge need in
> > the open source community
> >
> > On Thu, Apr 26, 2018 at 3:38 PM Ennio Bozzetti <EB...@thorlabs.com>
> > wrote:
> >
> > > Hello,
> > >
> > > I'm setting up SOLR on an internal website for my company and I would
> like
> > > to know if anyone can recommend an analytics that I can see what the
> users
> > > are searching for? Does the log in SOLR give me that information?
> > >
> > > Thank you,
> > > Ennio Bozzetti
> > >
> > > --
> > CTO, OpenSource Connections
> > Author, Relevant Search
> > http://o19s.com/doug
>
>
>
Re: Search Analytics Help
Posted by ennio <eb...@thorlabs.com>.
I have not. I will take a look at it.
Thanks for sharing the link.
--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Re: Search Analytics Help
Posted by Sameer Maggon <sa...@searchstax.com>.
Ennio,
Have you taken a look at SearchStax Analytics?
https://www.searchstax.com/docs/search-analytics-start/
Thanks,
On Wed, May 23, 2018 at 11:34 AM, ennio <eb...@thorlabs.com> wrote:
> Thanks all for the comments. I'm looking at the ELK option here.
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
>
--
Sameer Maggon
https://www.searchstax.com
Re: Search Analytics Help
Posted by ennio <eb...@thorlabs.com>.
Thanks all for the comments. I'm looking at the ELK option here.
--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Re: Search Analytics Help
Posted by Michal Hlavac <mi...@hlavki.eu>.
Hi,
you have plenty options. Without any special effort there is ELK. Parse solr logs with logstash, feed elasticsearch with data, then analyze in kibana.
Another option is to send every relevant search request to kafka, then you can do more sophisticated data analytic using kafka-stream API. Then use ELK to feed elasticsearch with logstash kafka input plugin. For this scenario you need to do some programming. I`ve already created this component but I hadn't time to publish it.
Another option is use only logstash to feed e.g. graphite database and show results with grafana or combine all these options.
You can also monitor SOLR instances by JMX logstash input plugin.
Really don't understand what do you mean by saying that there is nothing satisfactory.
m.
On štvrtok, 26. apríla 2018 22:23:30 CEST Doug Turnbull wrote:
> Honestly I haven’t seen anything satisfactory (yet). It’s a huge need in
> the open source community
>
> On Thu, Apr 26, 2018 at 3:38 PM Ennio Bozzetti <EB...@thorlabs.com>
> wrote:
>
> > Hello,
> >
> > I'm setting up SOLR on an internal website for my company and I would like
> > to know if anyone can recommend an analytics that I can see what the users
> > are searching for? Does the log in SOLR give me that information?
> >
> > Thank you,
> > Ennio Bozzetti
> >
> > --
> CTO, OpenSource Connections
> Author, Relevant Search
> http://o19s.com/doug
Re: Search Analytics Help
Posted by Doug Turnbull <dt...@opensourceconnections.com>.
Honestly I haven’t seen anything satisfactory (yet). It’s a huge need in
the open source community
On Thu, Apr 26, 2018 at 3:38 PM Ennio Bozzetti <EB...@thorlabs.com>
wrote:
> Hello,
>
> I'm setting up SOLR on an internal website for my company and I would like
> to know if anyone can recommend an analytics that I can see what the users
> are searching for? Does the log in SOLR give me that information?
>
> Thank you,
> Ennio Bozzetti
>
> --
CTO, OpenSource Connections
Author, Relevant Search
http://o19s.com/doug
RE: Search Analytics Help
Posted by "Hanjan, Harinder" <Ha...@calgary.ca>.
This seems promising
https://github.com/lucidworks/banana
-----Original Message-----
From: Ennio Bozzetti [mailto:EBozzetti@thorlabs.com]
Sent: Thursday, April 26, 2018 1:39 PM
To: solr-user@lucene.apache.org
Subject: [EXT] Search Analytics Help
Hello,
I'm setting up SOLR on an internal website for my company and I would like to know if anyone can recommend an analytics that I can see what the users are searching for? Does the log in SOLR give me that information?
Thank you,
Ennio Bozzetti
________________________________
NOTICE -
This communication is intended ONLY for the use of the person or entity named above and may contain information that is confidential or legally privileged. If you are not the intended recipient named above or a person responsible for delivering messages or communications to the intended recipient, YOU ARE HEREBY NOTIFIED that any use, distribution, or copying of this communication or any of the information contained in it is strictly prohibited. If you have received this communication in error, please notify us immediately by telephone and then destroy or delete this communication, or return it to us by mail if requested by us. The City of Calgary thanks you for your attention and co-operation.