You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mike Drob (JIRA)" <ji...@apache.org> on 2016/10/17 22:05:58 UTC
[jira] [Issue Comment Deleted] (SOLR-9641) Emit distributed tracing
information from Solr
[ https://issues.apache.org/jira/browse/SOLR-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mike Drob updated SOLR-9641:
----------------------------
Comment: was deleted
(was: This is a fairly large patch that covers a lot of ground. A summary of the changes is:
* Introduce dependency on new version of HTrace. HTrace-3 (transitively required by Hadoop) cannot communicate with HTrace-4 (used by me here), but they are packaged/namespace separately and can exist in the same application. Hadoop will include HTrace-4 starting in version 2.8 and 3.0, I believe.
* Introduce new solr.xml config section, that passes all parameters to the HTrace configuration. If we decide to make the distributed tracing library we use pluggable, then I think we can spend some time to make the section a little more generic, but for now it is fine.
* Add trace object to CoreContainer. This seemed like a logical place for a singleton scoped to the entire Solr process, but I ran into issues when trying to add tracing to Overseer operations. This design decision may need to be revisited.
* Instrument SolrCore to handle all kinds of core related requests. This gets us most index handlers at once.
* Instrument a few of the executors we use to pass along trace ids for tracing over distribution requests.
* Instrument CollectionsHandler for create. Same pattern could be applied for other collection operations, but it may be a good idea to make this more generic later.
* Added a basic test. There is a start of a test for HDFS, but it's very much a work in progress.)
> Emit distributed tracing information from Solr
> ----------------------------------------------
>
> Key: SOLR-9641
> URL: https://issues.apache.org/jira/browse/SOLR-9641
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Mike Drob
> Fix For: master (7.0)
>
> Attachments: SOLR-9641.patch
>
>
> While Solr already offers a few tools for exposing timing, this information can be difficult to aggregate and analyze. By integrating distributed tracing into Solr operations, we can gain new performance and behaviour insights.
> One such solution can be accomplished via Apache HTrace (incubating).
> (More rationale to follow.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org