You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2018/09/24 20:05:13 UTC
Metrics
Hi,
I'm running a fairly old version of SOLR (4.x) and I found the metrics on
the shard page. However, sometimes there is numbers, sometimes it's all 0.
Just hitting the refresh button shows this.
I'm aware of https://issues.apache.org/jira/browse/SOLR-10214
<https://www.google.com/url?q=https://issues.apache.org/jira/browse/SOLR-10214&sa=D&source=hangouts&ust=1537899568557000&usg=AFQjCNHPnpInvRs6SCo_AXCHqbzRpMwTtA>
so
I'm not concerned about the empty number, but I'm wondering what the
reasoning in the others. As an example, when I keep refreshing, the hit
ratio varies between 0 and 0.9 with almost all possible values :-/
So how are those metrics working?
Thanks,
JMS
Re: Metrics
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Erick,
(Late) thanks for the clarification on that.
JMS
Le lun. 24 sept. 2018 à 19:06, Erick Erickson <er...@gmail.com> a
écrit :
> The other caches (filterCache, queryResultCache) only have meaning for
> the current searcher opened. Whenever a soft or
> hard-commit-with-opensearcher-true, those caches are all reset to 0
> and stats start accumulating until the _next_ commit. So depending on
> when you look you might see a cache that's just been cleared because a
> new searcher has been opened or one that's been in use for a long
> time.
>
> However, there is a cumulative section for those two caches. The
> cumulative section accumulates the statistics since Solr was started.
> That section should be much more stable on a system that's been
> running for a while. Of course those all start out at zero when you
> start Solr.
>
> Whether the HDFS cache stats follow the same pattern, I don't know.
>
> Best,
> Erick
> On Mon, Sep 24, 2018 at 3:22 PM Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
> >
> > It might be similar to the other cache.. Do you have any pointer the the
> > LRUCache documentation? I want to see what kind of metrics it uses and
> see
> > if it's similar or not
> > to solr/core/src/java/org/apache/solr/core/HdfsDirectoryFactory.java,,,
> >
> > Le lun. 24 sept. 2018 à 18:04, Shawn Heisey <ap...@elyograg.org> a
> écrit :
> >
> > > On 9/24/2018 3:43 PM, Jean-Marc Spaggiari wrote:
> > > > Thanks for taking a look. My indexes are on HDFS. And I configured
> all
> > > the
> > > > solr parameters for that. The "shard page" is when I click on a SOLR
> > > server
> > > > to go to the UI, then in the dropdown on the left I select a shard (a
> > > > leader one), then I click on "plugins/stats". And then I open
> > > > "HdfsBlockCache". There from time to time I can see some numbers,
> but
> > > when
> > > > I keep refreshing it comes back to 0 always, and I have no clues
> what is
> > > > into the cache, or even if it just work :(
> > >
> > > Apologies for jumping into a world where I can't offer any help. I
> have
> > > never used HDFS, so things like this that are related to it are an
> > > unknown to me. I understand most of the other things in Plugins/Stats,
> > > but not that one.
> > >
> > > Thanks,
> > > Shawn
> > >
> > >
>
Re: Metrics
Posted by Erick Erickson <er...@gmail.com>.
The other caches (filterCache, queryResultCache) only have meaning for
the current searcher opened. Whenever a soft or
hard-commit-with-opensearcher-true, those caches are all reset to 0
and stats start accumulating until the _next_ commit. So depending on
when you look you might see a cache that's just been cleared because a
new searcher has been opened or one that's been in use for a long
time.
However, there is a cumulative section for those two caches. The
cumulative section accumulates the statistics since Solr was started.
That section should be much more stable on a system that's been
running for a while. Of course those all start out at zero when you
start Solr.
Whether the HDFS cache stats follow the same pattern, I don't know.
Best,
Erick
On Mon, Sep 24, 2018 at 3:22 PM Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
>
> It might be similar to the other cache.. Do you have any pointer the the
> LRUCache documentation? I want to see what kind of metrics it uses and see
> if it's similar or not
> to solr/core/src/java/org/apache/solr/core/HdfsDirectoryFactory.java,,,
>
> Le lun. 24 sept. 2018 à 18:04, Shawn Heisey <ap...@elyograg.org> a écrit :
>
> > On 9/24/2018 3:43 PM, Jean-Marc Spaggiari wrote:
> > > Thanks for taking a look. My indexes are on HDFS. And I configured all
> > the
> > > solr parameters for that. The "shard page" is when I click on a SOLR
> > server
> > > to go to the UI, then in the dropdown on the left I select a shard (a
> > > leader one), then I click on "plugins/stats". And then I open
> > > "HdfsBlockCache". There from time to time I can see some numbers, but
> > when
> > > I keep refreshing it comes back to 0 always, and I have no clues what is
> > > into the cache, or even if it just work :(
> >
> > Apologies for jumping into a world where I can't offer any help. I have
> > never used HDFS, so things like this that are related to it are an
> > unknown to me. I understand most of the other things in Plugins/Stats,
> > but not that one.
> >
> > Thanks,
> > Shawn
> >
> >
Re: Metrics
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
It might be similar to the other cache.. Do you have any pointer the the
LRUCache documentation? I want to see what kind of metrics it uses and see
if it's similar or not
to solr/core/src/java/org/apache/solr/core/HdfsDirectoryFactory.java,,,
Le lun. 24 sept. 2018 à 18:04, Shawn Heisey <ap...@elyograg.org> a écrit :
> On 9/24/2018 3:43 PM, Jean-Marc Spaggiari wrote:
> > Thanks for taking a look. My indexes are on HDFS. And I configured all
> the
> > solr parameters for that. The "shard page" is when I click on a SOLR
> server
> > to go to the UI, then in the dropdown on the left I select a shard (a
> > leader one), then I click on "plugins/stats". And then I open
> > "HdfsBlockCache". There from time to time I can see some numbers, but
> when
> > I keep refreshing it comes back to 0 always, and I have no clues what is
> > into the cache, or even if it just work :(
>
> Apologies for jumping into a world where I can't offer any help. I have
> never used HDFS, so things like this that are related to it are an
> unknown to me. I understand most of the other things in Plugins/Stats,
> but not that one.
>
> Thanks,
> Shawn
>
>
Re: Metrics
Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/24/2018 3:43 PM, Jean-Marc Spaggiari wrote:
> Thanks for taking a look. My indexes are on HDFS. And I configured all the
> solr parameters for that. The "shard page" is when I click on a SOLR server
> to go to the UI, then in the dropdown on the left I select a shard (a
> leader one), then I click on "plugins/stats". And then I open
> "HdfsBlockCache". There from time to time I can see some numbers, but when
> I keep refreshing it comes back to 0 always, and I have no clues what is
> into the cache, or even if it just work :(
Apologies for jumping into a world where I can't offer any help. I have
never used HDFS, so things like this that are related to it are an
unknown to me. I understand most of the other things in Plugins/Stats,
but not that one.
Thanks,
Shawn
Re: Metrics
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Shawn,
Thanks for taking a look. My indexes are on HDFS. And I configured all the
solr parameters for that. The "shard page" is when I click on a SOLR server
to go to the UI, then in the dropdown on the left I select a shard (a
leader one), then I click on "plugins/stats". And then I open
"HdfsBlockCache". There from time to time I can see some numbers, but when
I keep refreshing it comes back to 0 always, and I have no clues what is
into the cache, or even if it just work :(
Thanks,
JMS
Le lun. 24 sept. 2018 à 17:39, Shawn Heisey <ap...@elyograg.org> a écrit :
> On 9/24/2018 2:05 PM, Jean-Marc Spaggiari wrote:
> > I'm running a fairly old version of SOLR (4.x) and I found the metrics on
> > the shard page. However, sometimes there is numbers, sometimes it's all
> 0.
> > Just hitting the refresh button shows this.
> >
> > I'm aware of https://issues.apache.org/jira/browse/SOLR-10214
> > so
> > I'm not concerned about the empty number, but I'm wondering what the
> > reasoning in the others. As an example, when I keep refreshing, the hit
> > ratio varies between 0 and 0.9 with almost all possible values :-/
> >
> > So how are those metrics working?
>
> What specifically are you looking at? You mention "the shard page" but
> I really have no idea what that means.
>
> The code touched by SOLR-10214 is only used in Solr's HDFS support. If
> you're not running with indexes in HDFS, then that will have no impact
> on your system.
>
> Thanks,
> Shawn
>
>
Re: Metrics
Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/24/2018 2:05 PM, Jean-Marc Spaggiari wrote:
> I'm running a fairly old version of SOLR (4.x) and I found the metrics on
> the shard page. However, sometimes there is numbers, sometimes it's all 0.
> Just hitting the refresh button shows this.
>
> I'm aware of https://issues.apache.org/jira/browse/SOLR-10214
> so
> I'm not concerned about the empty number, but I'm wondering what the
> reasoning in the others. As an example, when I keep refreshing, the hit
> ratio varies between 0 and 0.9 with almost all possible values :-/
>
> So how are those metrics working?
What specifically are you looking at? You mention "the shard page" but
I really have no idea what that means.
The code touched by SOLR-10214 is only used in Solr's HDFS support. If
you're not running with indexes in HDFS, then that will have no impact
on your system.
Thanks,
Shawn