You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Sundeep T <su...@gmail.com> on 2017/09/25 18:42:38 UTC
Possible memory leak with VersionBucket objects
Hello,
We are running our solr 6.4.2 instance on a single node without zookeeper.
So, we are not using solr cloud. We have been ingesting about 50k messages
per second into this instance spread over 4 cores.
When we looked at the heapdump we see that it has there are around 385
million instances of VersionBucket objects taking about 8gb memory. This
number seems to grow based on the number of cores into which we are
ingesting data into.PFA a screen cap of heap recording.
Browsing through the jira list we saw a similar issue -
https://issues.apache.org/jira/browse/SOLR-9803
This issue is recently resolved by Erick. But this issue seems be
specifically tied to SolrCloud mode and Zookeeper. We are not using any of
these.
So, we are thinking this could be another issue. Any one has ideas on what
this could be and if there is a fix for it?
Thanks
Sundeep
Re: Possible memory leak with VersionBucket objects
Posted by Sundeep T <su...@gmail.com>.
Sorry, I meant we are "not" running Solr in cloud mode
On Mon, Sep 25, 2017 at 1:29 PM, Sundeep T <su...@gmail.com> wrote:
> Yes, but that issue seems specific to SolrCloud like I mentioned. We are
> running Solr in cloud mode and don't have Zookeeper configured
>
> Thanks
> Sundeep
>
> On Mon, Sep 25, 2017 at 12:52 PM, Steve Rowe <sa...@gmail.com> wrote:
>
>> Hi Sundeep,
>>
>> This looks to me like <https://issues.apache.org/jira/browse/SOLR-9803>
>> / <https://issues.apache.org/jira/browse/SOLR-10506>, which was fixed in
>> Solr 7.0.
>>
>> --
>> Steve
>> www.lucidworks.com
>>
>> > On Sep 25, 2017, at 2:42 PM, Sundeep T <su...@gmail.com> wrote:
>> >
>> > Hello,
>> >
>> > We are running our solr 6.4.2 instance on a single node without
>> zookeeper. So, we are not using solr cloud. We have been ingesting about
>> 50k messages per second into this instance spread over 4 cores.
>> >
>> > When we looked at the heapdump we see that it has there are around 385
>> million instances of VersionBucket objects taking about 8gb memory. This
>> number seems to grow based on the number of cores into which we are
>> ingesting data into.PFA a screen cap of heap recording.
>> >
>> > Browsing through the jira list we saw a similar issue -
>> https://issues.apache.org/jira/browse/SOLR-9803
>> >
>> > This issue is recently resolved by Erick. But this issue seems be
>> specifically tied to SolrCloud mode and Zookeeper. We are not using any of
>> these.
>> >
>> > So, we are thinking this could be another issue. Any one has ideas on
>> what this could be and if there is a fix for it?
>> >
>> > Thanks
>> > Sundeep
>>
>>
>
Re: Possible memory leak with VersionBucket objects
Posted by Sundeep T <su...@gmail.com>.
Yes, but that issue seems specific to SolrCloud like I mentioned. We are
running Solr in cloud mode and don't have Zookeeper configured
Thanks
Sundeep
On Mon, Sep 25, 2017 at 12:52 PM, Steve Rowe <sa...@gmail.com> wrote:
> Hi Sundeep,
>
> This looks to me like <https://issues.apache.org/jira/browse/SOLR-9803> /
> <https://issues.apache.org/jira/browse/SOLR-10506>, which was fixed in
> Solr 7.0.
>
> --
> Steve
> www.lucidworks.com
>
> > On Sep 25, 2017, at 2:42 PM, Sundeep T <su...@gmail.com> wrote:
> >
> > Hello,
> >
> > We are running our solr 6.4.2 instance on a single node without
> zookeeper. So, we are not using solr cloud. We have been ingesting about
> 50k messages per second into this instance spread over 4 cores.
> >
> > When we looked at the heapdump we see that it has there are around 385
> million instances of VersionBucket objects taking about 8gb memory. This
> number seems to grow based on the number of cores into which we are
> ingesting data into.PFA a screen cap of heap recording.
> >
> > Browsing through the jira list we saw a similar issue -
> https://issues.apache.org/jira/browse/SOLR-9803
> >
> > This issue is recently resolved by Erick. But this issue seems be
> specifically tied to SolrCloud mode and Zookeeper. We are not using any of
> these.
> >
> > So, we are thinking this could be another issue. Any one has ideas on
> what this could be and if there is a fix for it?
> >
> > Thanks
> > Sundeep
>
>
Re: Possible memory leak with VersionBucket objects
Posted by Steve Rowe <sa...@gmail.com>.
Hi Sundeep,
This looks to me like <https://issues.apache.org/jira/browse/SOLR-9803> / <https://issues.apache.org/jira/browse/SOLR-10506>, which was fixed in Solr 7.0.
--
Steve
www.lucidworks.com
> On Sep 25, 2017, at 2:42 PM, Sundeep T <su...@gmail.com> wrote:
>
> Hello,
>
> We are running our solr 6.4.2 instance on a single node without zookeeper. So, we are not using solr cloud. We have been ingesting about 50k messages per second into this instance spread over 4 cores.
>
> When we looked at the heapdump we see that it has there are around 385 million instances of VersionBucket objects taking about 8gb memory. This number seems to grow based on the number of cores into which we are ingesting data into.PFA a screen cap of heap recording.
>
> Browsing through the jira list we saw a similar issue -https://issues.apache.org/jira/browse/SOLR-9803
>
> This issue is recently resolved by Erick. But this issue seems be specifically tied to SolrCloud mode and Zookeeper. We are not using any of these.
>
> So, we are thinking this could be another issue. Any one has ideas on what this could be and if there is a fix for it?
>
> Thanks
> Sundeep