You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@trafficserver.apache.org by "HugManh (via GitHub)" <gi...@apache.org> on 2023/07/06 05:06:45 UTC

[GitHub] [trafficserver] HugManh opened a new issue, #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

HugManh opened a new issue, #9961:
URL: https://github.com/apache/trafficserver/issues/9961

   Hi everyone,
   I using TrafficSrever branch: master - [#828b7d3](https://github.com/apache/trafficserver/commit/828b7d3e40655982f8abc88a5e634ed17ec39681). I trying OpenTelemetry Tracer Plugin to manage tracer for system. When i use the plugin, it make request processing time increase.
   
   When use plugin:
   ![has_otel](https://github.com/apache/trafficserver/assets/43240025/0f16c616-0dae-49b0-a131-83a9d186b8ec)
   ![req_has_otel](https://github.com/apache/trafficserver/assets/43240025/79af44b5-568d-40fb-b392-8f2454d1d7cc)
   
   Don't use plugin:
   ![no_otel](https://github.com/apache/trafficserver/assets/43240025/3e421b75-6b3b-46b4-8e4e-7aa4efd922ad)
   ![req_no_otel](https://github.com/apache/trafficserver/assets/43240025/9f2606d7-f50e-4bc7-9d13-63315ef391ad)
   
   Has anyone used this plugin yet?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [PLugin] OpenTelemetry Tracer Plugin make request processing time increase [trafficserver]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.

github-actions[bot] commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-2219323959

   This issue has been automatically marked as stale because it has not had recent activity. Marking it stale to flag it for further consideration by the community.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [trafficserver] shukitchan commented on issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

Posted by "shukitchan (via GitHub)" <gi...@apache.org>.

shukitchan commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-1629672110

   What would be the number after the change?
   
   Do you want to submit a pull request for the change?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [trafficserver] HugManh commented on issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

Posted by "HugManh (via GitHub)" <gi...@apache.org>.

HugManh commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-1623890654

   > How does your observability stack look like?
   > 
   > The plugin is sending a OTLP http request for sending the trace info to a backend. So if your backend is quite far away, it can take quite some time.
   
   My backend is pretty close so I think it's not due to this. I tried with opentelemetry-cpp version 1.3.0 and as a result request time is faster than branch master . Note: The results I posted above is from the opentelemetry branch master[#](https://github.com/apache/trafficserver/issues/9961#issue-1790816839).
   Do you think the problem is with the sdk?
   Result of version 1.3.0:
   ![photo_2023-07-06_22-00-08](https://github.com/apache/trafficserver/assets/43240025/56bbfd7c-e6de-46c2-9519-819372820ea3)
   
   > One alternative is this - https://opentelemetry.io/docs/collector/deployment/agent/ You can have the deployment of an agent/collector on the same host of your ATS. And you configure the plugin to send OTLP request to the agent/collector instead. That should be much faster. And then you let the agent/collector do its work to send the info to a real backend.
   
   I will try this later, 
   Thankyou @shukitchan 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [PLugin] OpenTelemetry Tracer Plugin make request processing time increase [trafficserver]

Posted by "shukitchan (via GitHub)" <gi...@apache.org>.

shukitchan closed issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase
URL: https://github.com/apache/trafficserver/issues/9961


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [trafficserver] HugManh commented on issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

Posted by "HugManh (via GitHub)" <gi...@apache.org>.

HugManh commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-1624682124

   I think i found problem in the plugin. I change span processor from SimpleSpanProcessor to BatchSpanProcessor. This solved my problem.
   @shukitchan Thank you very much! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [trafficserver] shukitchan commented on issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

Posted by "shukitchan (via GitHub)" <gi...@apache.org>.

shukitchan commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-1623067941

   How does your observability stack look like? 
   
   The plugin is sending a OTLP http request for sending the trace info to a backend. So if your backend is quite far away, it can take quite some time. 
   
   One alternative is this - https://opentelemetry.io/docs/collector/deployment/agent/ 
   You can have the deployment of an agent/collector on the same host of your ATS. And you configure the plugin to send OTLP request to the agent/collector instead. That should be much faster. And then you let the agent/collector do its work to send the info to a real backend. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [trafficserver] shukitchan commented on issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

Posted by "shukitchan (via GitHub)" <gi...@apache.org>.

shukitchan commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-1623991213

   300+ms is still a lot. 
   I think we should try having the agent/collector in the local host. 
   
   I have not got the time to try the latest opentelemetry-cpp release. So I can't say if there is anything changed in the sdk that will cause this much latency. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [trafficserver] HugManh commented on issue #9961: [PLugin] OpenTelemetry Tracer Plugin make request processing time increase

Posted by "HugManh (via GitHub)" <gi...@apache.org>.

HugManh commented on issue #9961:
URL: https://github.com/apache/trafficserver/issues/9961#issuecomment-1624599865

   @shukitchan Have you tried using opentelemetry without collector?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org