You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by jay harkhani <ja...@hotmail.com> on 2020/05/20 14:09:49 UTC
Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Hello,
Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
Logs and Thread dump stack trace
Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
Can someone please help to isolate this issue.
Regards,
Jay Harkhani.
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by vishal patel <vi...@outlook.com>.
Is there any other option?
Sent from Outlook<http://aka.ms/weboutlook>
________________________________
From: Mikhail Khludnev <mk...@apache.org>
Sent: Sunday, May 24, 2020 3:24 AM
To: solr-user <so...@lucene.apache.org>
Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Unfortunately {!terms} doesn't let one ^boost terms.
On Sat, May 23, 2020 at 10:13 AM vishal patel <vi...@outlook.com>
wrote:
> Hi Jason
>
> Thanks for reply.
>
> I have checked jay's query using "terms" query parser and it is really
> helpful to us. After execute using "terms" query parser it will come within
> a 500 milliseconds even though grouping is applied.
> Jay's Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Actually I want to apply same things in my query but my field "msg_id" is
> applied boost.group is also used in my query.
> I am also upgrading Solr 8.5.1.
>
>
> MY query is :
> https://drive.google.com/file/d/1Op_Ja292Bcnv0Ijxw6VdAxvGlfsdczmS/view
>
> I got 30 seconds for above query. How can I use the "terms" query parser
> in my query?
>
> Regards,
> Vishal Patel
> ________________________________
> From: Jason Gerlowski <ge...@gmail.com>
> Sent: Friday, May 22, 2020 2:59 AM
> To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hi Jay,
>
> I can't speak to why you're seeing a performance change between 6.x
> and 8.x. What I can suggest though is an alternative way of
> formulating the query: you might get different performance if you run
> your query using Solr's "terms" query parser:
>
> https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
> It's not guaranteed to help, but there's a chance it'll work for you.
> And knowing whether or not it helps might point others here towards
> the cause of your slowdown.
>
> Even if "terms" performs better for you, it's probably worth
> understanding what's going on here of course.
>
> Are all other queries running comparably?
>
> Jason
>
> On Thu, May 21, 2020 at 10:25 AM jay harkhani <ja...@hotmail.com>
> wrote:
> >
> > Hello,
> >
> > Please refer below details.
> >
> > >Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing?
> > Yes, We have created collection from scratch and also re-indexing.
> >
> > >Was it based on the latest template?
> > Yes, It was as per latest template.
> >
> > >What happens if you reexecute the query?
> > Not more visible difference. Minor change in milliseconds.
> >
> > >Are there other processes/containers running on the same VM?
> > No
> >
> > >How much heap and how much total memory you have?
> > My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and
> total memory 25gb. As per me there is no issue related to memory.
> >
> > >Maybe also you need to increase the corresponding caches in the config.
> > We are not using cache in both version.
> >
> > Both version have same configuration.
> >
> > Regards,
> > Jay Harkhani.
> >
> > ________________________________
> > From: Jörn Franke <jo...@gmail.com>
> > Sent: Thursday, May 21, 2020 7:05 PM
> > To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> > Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing? Was it based on the latest template?
> > If not then please try this. Maybe also you need to increase the
> corresponding caches in the config.
> >
> > What happens if you reexecute the query?
> >
> > Are there other processes/containers running on the same VM?
> >
> > How much heap and how much total memory you have? You should only have a
> minor fraction of the memory as heap and most of it „free“ (this means it
> is used for file caches).
> >
> >
> >
> > > Am 21.05.2020 um 15:24 schrieb vishal patel <
> vishalpatel200928@outlook.com>:
> > >
> > > Any one is looking this issue?
> > > I got same issue.
> > >
> > > Regards,
> > > Vishal Patel
> > >
> > >
> > >
> > > ________________________________
> > > From: jay harkhani <ja...@hotmail.com>
> > > Sent: Wednesday, May 20, 2020 7:39 PM
> > > To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> > > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> > >
> > > Hello,
> > >
> > > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across
> one issue. Query which have more ids (around 3000) and grouping is applied
> takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1
> it takes 26090ms. While take reading we have same solr schema and same no.
> of records in both solr version.
> > >
> > > Please refer below details for query, logs and thead dump (generate
> from Solr Admin while execute query).
> > >
> > > Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> > >
> > > Logs and Thread dump stack trace
> > > Solr 8.5.1 :
> https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > > Solr 6.1.0 :
> https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> > >
> > > To analyse further more we found that if we remove grouping field or
> we reduce no. of ids from query it execute fast. Is anything change in
> 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along
> with grouping it works faster?
> > >
> > > Can someone please help to isolate this issue.
> > >
> > > Regards,
> > > Jay Harkhani.
>
--
Sincerely yours
Mikhail Khludnev
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by Mikhail Khludnev <mk...@apache.org>.
Unfortunately {!terms} doesn't let one ^boost terms.
On Sat, May 23, 2020 at 10:13 AM vishal patel <vi...@outlook.com>
wrote:
> Hi Jason
>
> Thanks for reply.
>
> I have checked jay's query using "terms" query parser and it is really
> helpful to us. After execute using "terms" query parser it will come within
> a 500 milliseconds even though grouping is applied.
> Jay's Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Actually I want to apply same things in my query but my field "msg_id" is
> applied boost.group is also used in my query.
> I am also upgrading Solr 8.5.1.
>
>
> MY query is :
> https://drive.google.com/file/d/1Op_Ja292Bcnv0Ijxw6VdAxvGlfsdczmS/view
>
> I got 30 seconds for above query. How can I use the "terms" query parser
> in my query?
>
> Regards,
> Vishal Patel
> ________________________________
> From: Jason Gerlowski <ge...@gmail.com>
> Sent: Friday, May 22, 2020 2:59 AM
> To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hi Jay,
>
> I can't speak to why you're seeing a performance change between 6.x
> and 8.x. What I can suggest though is an alternative way of
> formulating the query: you might get different performance if you run
> your query using Solr's "terms" query parser:
>
> https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
> It's not guaranteed to help, but there's a chance it'll work for you.
> And knowing whether or not it helps might point others here towards
> the cause of your slowdown.
>
> Even if "terms" performs better for you, it's probably worth
> understanding what's going on here of course.
>
> Are all other queries running comparably?
>
> Jason
>
> On Thu, May 21, 2020 at 10:25 AM jay harkhani <ja...@hotmail.com>
> wrote:
> >
> > Hello,
> >
> > Please refer below details.
> >
> > >Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing?
> > Yes, We have created collection from scratch and also re-indexing.
> >
> > >Was it based on the latest template?
> > Yes, It was as per latest template.
> >
> > >What happens if you reexecute the query?
> > Not more visible difference. Minor change in milliseconds.
> >
> > >Are there other processes/containers running on the same VM?
> > No
> >
> > >How much heap and how much total memory you have?
> > My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and
> total memory 25gb. As per me there is no issue related to memory.
> >
> > >Maybe also you need to increase the corresponding caches in the config.
> > We are not using cache in both version.
> >
> > Both version have same configuration.
> >
> > Regards,
> > Jay Harkhani.
> >
> > ________________________________
> > From: Jörn Franke <jo...@gmail.com>
> > Sent: Thursday, May 21, 2020 7:05 PM
> > To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> > Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Did you create Solrconfig.xml for the collection from scratch after
> upgrading and reindexing? Was it based on the latest template?
> > If not then please try this. Maybe also you need to increase the
> corresponding caches in the config.
> >
> > What happens if you reexecute the query?
> >
> > Are there other processes/containers running on the same VM?
> >
> > How much heap and how much total memory you have? You should only have a
> minor fraction of the memory as heap and most of it „free“ (this means it
> is used for file caches).
> >
> >
> >
> > > Am 21.05.2020 um 15:24 schrieb vishal patel <
> vishalpatel200928@outlook.com>:
> > >
> > > Any one is looking this issue?
> > > I got same issue.
> > >
> > > Regards,
> > > Vishal Patel
> > >
> > >
> > >
> > > ________________________________
> > > From: jay harkhani <ja...@hotmail.com>
> > > Sent: Wednesday, May 20, 2020 7:39 PM
> > > To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> > > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> > >
> > > Hello,
> > >
> > > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across
> one issue. Query which have more ids (around 3000) and grouping is applied
> takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1
> it takes 26090ms. While take reading we have same solr schema and same no.
> of records in both solr version.
> > >
> > > Please refer below details for query, logs and thead dump (generate
> from Solr Admin while execute query).
> > >
> > > Query :
> https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> > >
> > > Logs and Thread dump stack trace
> > > Solr 8.5.1 :
> https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > > Solr 6.1.0 :
> https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> > >
> > > To analyse further more we found that if we remove grouping field or
> we reduce no. of ids from query it execute fast. Is anything change in
> 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along
> with grouping it works faster?
> > >
> > > Can someone please help to isolate this issue.
> > >
> > > Regards,
> > > Jay Harkhani.
>
--
Sincerely yours
Mikhail Khludnev
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by vishal patel <vi...@outlook.com>.
Hi Jason
Thanks for reply.
I have checked jay's query using "terms" query parser and it is really helpful to us. After execute using "terms" query parser it will come within a 500 milliseconds even though grouping is applied.
Jay's Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
Actually I want to apply same things in my query but my field "msg_id" is applied boost.group is also used in my query.
I am also upgrading Solr 8.5.1.
MY query is : https://drive.google.com/file/d/1Op_Ja292Bcnv0Ijxw6VdAxvGlfsdczmS/view
I got 30 seconds for above query. How can I use the "terms" query parser in my query?
Regards,
Vishal Patel
________________________________
From: Jason Gerlowski <ge...@gmail.com>
Sent: Friday, May 22, 2020 2:59 AM
To: solr-user@lucene.apache.org <so...@lucene.apache.org>
Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Hi Jay,
I can't speak to why you're seeing a performance change between 6.x
and 8.x. What I can suggest though is an alternative way of
formulating the query: you might get different performance if you run
your query using Solr's "terms" query parser:
https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
It's not guaranteed to help, but there's a chance it'll work for you.
And knowing whether or not it helps might point others here towards
the cause of your slowdown.
Even if "terms" performs better for you, it's probably worth
understanding what's going on here of course.
Are all other queries running comparably?
Jason
On Thu, May 21, 2020 at 10:25 AM jay harkhani <ja...@hotmail.com> wrote:
>
> Hello,
>
> Please refer below details.
>
> >Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing?
> Yes, We have created collection from scratch and also re-indexing.
>
> >Was it based on the latest template?
> Yes, It was as per latest template.
>
> >What happens if you reexecute the query?
> Not more visible difference. Minor change in milliseconds.
>
> >Are there other processes/containers running on the same VM?
> No
>
> >How much heap and how much total memory you have?
> My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and total memory 25gb. As per me there is no issue related to memory.
>
> >Maybe also you need to increase the corresponding caches in the config.
> We are not using cache in both version.
>
> Both version have same configuration.
>
> Regards,
> Jay Harkhani.
>
> ________________________________
> From: Jörn Franke <jo...@gmail.com>
> Sent: Thursday, May 21, 2020 7:05 PM
> To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
> If not then please try this. Maybe also you need to increase the corresponding caches in the config.
>
> What happens if you reexecute the query?
>
> Are there other processes/containers running on the same VM?
>
> How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).
>
>
>
> > Am 21.05.2020 um 15:24 schrieb vishal patel <vi...@outlook.com>:
> >
> > Any one is looking this issue?
> > I got same issue.
> >
> > Regards,
> > Vishal Patel
> >
> >
> >
> > ________________________________
> > From: jay harkhani <ja...@hotmail.com>
> > Sent: Wednesday, May 20, 2020 7:39 PM
> > To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Hello,
> >
> > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
> >
> > Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
> >
> > Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> >
> > Logs and Thread dump stack trace
> > Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> >
> > To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
> >
> > Can someone please help to isolate this issue.
> >
> > Regards,
> > Jay Harkhani.
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by Jason Gerlowski <ge...@gmail.com>.
Hi Jay,
I can't speak to why you're seeing a performance change between 6.x
and 8.x. What I can suggest though is an alternative way of
formulating the query: you might get different performance if you run
your query using Solr's "terms" query parser:
https://lucene.apache.org/solr/guide/8_5/other-parsers.html#terms-query-parser
It's not guaranteed to help, but there's a chance it'll work for you.
And knowing whether or not it helps might point others here towards
the cause of your slowdown.
Even if "terms" performs better for you, it's probably worth
understanding what's going on here of course.
Are all other queries running comparably?
Jason
On Thu, May 21, 2020 at 10:25 AM jay harkhani <ja...@hotmail.com> wrote:
>
> Hello,
>
> Please refer below details.
>
> >Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing?
> Yes, We have created collection from scratch and also re-indexing.
>
> >Was it based on the latest template?
> Yes, It was as per latest template.
>
> >What happens if you reexecute the query?
> Not more visible difference. Minor change in milliseconds.
>
> >Are there other processes/containers running on the same VM?
> No
>
> >How much heap and how much total memory you have?
> My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and total memory 25gb. As per me there is no issue related to memory.
>
> >Maybe also you need to increase the corresponding caches in the config.
> We are not using cache in both version.
>
> Both version have same configuration.
>
> Regards,
> Jay Harkhani.
>
> ________________________________
> From: Jörn Franke <jo...@gmail.com>
> Sent: Thursday, May 21, 2020 7:05 PM
> To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
> If not then please try this. Maybe also you need to increase the corresponding caches in the config.
>
> What happens if you reexecute the query?
>
> Are there other processes/containers running on the same VM?
>
> How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).
>
>
>
> > Am 21.05.2020 um 15:24 schrieb vishal patel <vi...@outlook.com>:
> >
> > Any one is looking this issue?
> > I got same issue.
> >
> > Regards,
> > Vishal Patel
> >
> >
> >
> > ________________________________
> > From: jay harkhani <ja...@hotmail.com>
> > Sent: Wednesday, May 20, 2020 7:39 PM
> > To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> > Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
> >
> > Hello,
> >
> > Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
> >
> > Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
> >
> > Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
> >
> > Logs and Thread dump stack trace
> > Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> > Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
> >
> > To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
> >
> > Can someone please help to isolate this issue.
> >
> > Regards,
> > Jay Harkhani.
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by jay harkhani <ja...@hotmail.com>.
Hello,
Please refer below details.
>Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing?
Yes, We have created collection from scratch and also re-indexing.
>Was it based on the latest template?
Yes, It was as per latest template.
>What happens if you reexecute the query?
Not more visible difference. Minor change in milliseconds.
>Are there other processes/containers running on the same VM?
No
>How much heap and how much total memory you have?
My heap and total memory are same as Solr 6.1.0. heap memory 5 gb and total memory 25gb. As per me there is no issue related to memory.
>Maybe also you need to increase the corresponding caches in the config.
We are not using cache in both version.
Both version have same configuration.
Regards,
Jay Harkhani.
________________________________
From: Jörn Franke <jo...@gmail.com>
Sent: Thursday, May 21, 2020 7:05 PM
To: solr-user@lucene.apache.org <so...@lucene.apache.org>
Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
If not then please try this. Maybe also you need to increase the corresponding caches in the config.
What happens if you reexecute the query?
Are there other processes/containers running on the same VM?
How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).
> Am 21.05.2020 um 15:24 schrieb vishal patel <vi...@outlook.com>:
>
> Any one is looking this issue?
> I got same issue.
>
> Regards,
> Vishal Patel
>
>
>
> ________________________________
> From: jay harkhani <ja...@hotmail.com>
> Sent: Wednesday, May 20, 2020 7:39 PM
> To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hello,
>
> Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
>
> Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
>
> Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Logs and Thread dump stack trace
> Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
>
> To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
>
> Can someone please help to isolate this issue.
>
> Regards,
> Jay Harkhani.
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by Jörn Franke <jo...@gmail.com>.
Did you create Solrconfig.xml for the collection from scratch after upgrading and reindexing? Was it based on the latest template?
If not then please try this. Maybe also you need to increase the corresponding caches in the config.
What happens if you reexecute the query?
Are there other processes/containers running on the same VM?
How much heap and how much total memory you have? You should only have a minor fraction of the memory as heap and most of it „free“ (this means it is used for file caches).
> Am 21.05.2020 um 15:24 schrieb vishal patel <vi...@outlook.com>:
>
> Any one is looking this issue?
> I got same issue.
>
> Regards,
> Vishal Patel
>
>
>
> ________________________________
> From: jay harkhani <ja...@hotmail.com>
> Sent: Wednesday, May 20, 2020 7:39 PM
> To: solr-user@lucene.apache.org <so...@lucene.apache.org>
> Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
>
> Hello,
>
> Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
>
> Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
>
> Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
>
> Logs and Thread dump stack trace
> Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
> Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
>
> To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
>
> Can someone please help to isolate this issue.
>
> Regards,
> Jay Harkhani.
Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Posted by vishal patel <vi...@outlook.com>.
Any one is looking this issue?
I got same issue.
Regards,
Vishal Patel
________________________________
From: jay harkhani <ja...@hotmail.com>
Sent: Wednesday, May 20, 2020 7:39 PM
To: solr-user@lucene.apache.org <so...@lucene.apache.org>
Subject: Query takes more time in Solr 8.5.1 compare to 6.1.0 version
Hello,
Currently I upgrade Solr version from 6.1.0 to 8.5.1 and come across one issue. Query which have more ids (around 3000) and grouping is applied takes more time to execute. In Solr 6.1.0 it takes 677ms and in Solr 8.5.1 it takes 26090ms. While take reading we have same solr schema and same no. of records in both solr version.
Please refer below details for query, logs and thead dump (generate from Solr Admin while execute query).
Query : https://drive.google.com/file/d/1bavCqwHfJxoKHFzdOEt-mSG8N0fCHE-w/view
Logs and Thread dump stack trace
Solr 8.5.1 : https://drive.google.com/file/d/149IgaMdLomTjkngKHrwd80OSEa1eJbBF/view
Solr 6.1.0 : https://drive.google.com/file/d/13v1u__fM8nHfyvA0Mnj30IhdffW6xhwQ/view
To analyse further more we found that if we remove grouping field or we reduce no. of ids from query it execute fast. Is anything change in 8.5.1 version compare to 6.1.0 as in 6.1.0 even for large no. Ids along with grouping it works faster?
Can someone please help to isolate this issue.
Regards,
Jay Harkhani.