You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2022/01/14 10:39:00 UTC

[GitHub] [skywalking] xu1009 opened a new issue #8433: [Feature] Support collect thread pool metrics

xu1009 opened a new issue #8433:
URL: https://github.com/apache/skywalking/issues/8433


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   thread pool monitor is important in web service, server container, like tomcat, undertow etc, monitor its worker pool is very import, every project needs implement it
   
   
   ### Use case
   
   when use skywalking, we can config target class extends ThreadPoolExecutor, get thread pool metric, like coresize, maxsize, poolsize, queue size..., and send this metric to oap service every second, from ui, can see the metric
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015590609


   Check K8s monitoring temple config. Or just put the metric name on UI setup mode page, and enter. It will tell you, it's a labeled value.
   Don't use tag equal to split one metric into several.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015495499


   you mean the agent report metric with same name and different tags by meter api ?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015518143


   yes, the oal config like  this in this way
   
   
   expSuffix: instance(['service'], ['instance'], Layer.GENERAL)
   metricPrefix: instancesss
   metricsRules:
     - name: undertow_thread_pool_core_size
       exp: thread_pool.tagEqual("pool_name", "undertow_worker_pool").tagEqual("metric_type", "core_pool_size")
     - name: undertow_thread_pool_max_size
       exp: thread_pool.tagEqual("pool_name", "undertow_worker_pool").tagEqual("metric_type", "max_pool_size")
     - name: undertow_thread_pool_size
       exp: thread_pool.tagEqual("pool_name", "undertow_worker_pool").tagEqual("metric_type", "pool_size")
     - name: undertow_thread_pool_queue_size
       exp: thread_pool.tagEqual("pool_name", "undertow_worker_pool").tagEqual("metric_type", "queue_size")
     - name: undertow_thread_pool_active_count
       exp: thread_pool.tagEqual("pool_name", "undertow_worker_pool").tagEqual("metric_type", "active_size")


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] [Java] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016656871


   ![image](https://user-images.githubusercontent.com/22722907/150175697-c3070ab7-65ad-40c6-a0bf-8546c33d04b3.png)
   
   it is ok


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015235248


   > i do not get your mean, there are many kinds of thread pool, every type thread pool can have a ui component, all in one seems strange,and it is difficult to look
   
   We don't have to set all thread pool metrics in one UI component. But `labeled value` could reduce the cost of the database resources. The way you are doing right now, is making one metric per database row. But labeled value could compress all types(queue size, pool size, max pool size) into one metric name.
   
   ```
   undertow_thread_pool{pool_name="undertow_pool1",type="pool_size"} 10
   undertow_thread_pool{pool_name="undertow_pool2",type="pool_size"} 15
   undertow_thread_pool{pool_name="undertow_pool2",type="max_size"} 20
   ```
   
   Then you just need one metric name on the UI, `undertow_thread_pool`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1014109036


   instance_undertow_thread_pool_core_size = from(ServiceInstanceJVMThreadPool.corePoolSize).filter(threadPoolNameType == ThreadPoolNameType.UNDERTOW).longAvg();
   instance_undertow_thread_pool_max_size = from(ServiceInstanceJVMThreadPool.maximumPoolSize).filter(threadPoolNameType == ThreadPoolNameType.UNDERTOW).longAvg();
   instance_undertow_thread_pool_size = from(ServiceInstanceJVMThreadPool.poolSize).filter(threadPoolNameType == ThreadPoolNameType.UNDERTOW).longAvg();
   instance_undertow_thread_pool_queue_size = from(ServiceInstanceJVMThreadPool.queueSize).filter(threadPoolNameType == ThreadPoolNameType.UNDERTOW).longAvg();
   instance_undertow_thread_pool_active_count = from(ServiceInstanceJVMThreadPool.activeCount).filter(threadPoolNameType == ThreadPoolNameType.UNDERTOW).longAvg();
   
   
   message ThreadPool {
       ThreadPoolNameType type = 1;
       int64 corePoolSize = 2;
       int64 maximumPoolSize = 3;
       int64 poolSize = 4;
       int64 queueSize = 5;
       int64 activeCount = 6;
   
   }
   
   enum ThreadPoolNameType {
       UNDERTOW_WORKER_POOL = 0;
       TOMCAT_WORKER_POOL = 1;
   }
   
   
   ![image](https://user-images.githubusercontent.com/22722907/149704058-2878ba41-13d6-4aef-985d-be8c09280ef1.png)
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015189686


   ![image](https://user-images.githubusercontent.com/22722907/149902103-ef7a634a-ea27-4f33-9244-2876363b0e2e.png)
   
   ![image](https://user-images.githubusercontent.com/22722907/149902167-b39e052e-b84f-4143-9890-8d5e50b27c4a.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015944579


   This is a labeled value metrics visualized as a chart
   ![image](https://user-images.githubusercontent.com/5441976/150038471-10f7d54b-ef4d-4f52-b0fd-044ff525ffc8.png)
   ![image](https://user-images.githubusercontent.com/5441976/150038517-d1bf2966-dc93-4a3e-9a30-3724e2fcdf04.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] mrproliu commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
mrproliu commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016167704


   In the MAL, if you want to make it as labels metrics, need to add the  aggregate function on the metric. In this case, it should be thread_pool.avg(['pool_name', 'metrx_type', 'service']). 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015512766


   Yes. And AFAIK the MAL could land this one metric name with different tags in the storage. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 removed a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 removed a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016152475


   ```json
   {
      "metricCase_":1,
      "metric_":{
         "name_":"thread_pool",
         "labels_":[
            {
               "name_":"metric_type",
               "value_":"max_pool_size",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            },
            {
               "name_":"pool_name",
               "value_":"undertow_worker_pool",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            }
         ],
         "value_":80.0,
         "memoizedIsInitialized":-1,
         "unknownFields":{
            "fields":{
               
            }
         },
         "memoizedSize":-1,
         "memoizedHashCode":0
      },
      "service_":"",
      "serviceInstance_":"",
      "timestamp_":0,
      "memoizedIsInitialized":1,
      "unknownFields":{
         "fields":{
            
         }
      },
      "memoizedSize":-1,
      "memoizedHashCode":0
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016156454


   @wankai123 @mrproliu Could you take a look? I hope the final result keep `thread_pool` as metric name, and labels(undertow_worker_pool + max_pool_size) as the final label.
   
   @xu1009 It is better you could use `H2` server mode to check the data, or ElasticSearch. Otherwise, it is hard for us to help this very detailed thing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng edited a comment on issue #8433: [Feature] [Java] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016913771


   Cool, good to see this. Let's move on to the official PR/Review to take care of code details. Thank you so much for your patience.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015214246


   I think we should use `labeled value`, which only requires one metric name in the MAL script. And UI's component title could be `Thread Pool`,  which could add more pool relative metrics easily.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016060400


   And please provide the data in the MeterServiceHandler. Then we could know what is going on.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1014442147


   ok, i have a look


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016151857


    {"metricCase_":1,"metric_":{"name_":"thread_pool","labels_":[{"name_":"metric_type","value_":"active_size","memoizedIsInitialized":-1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0},{"name_":"pool_name","value_":"undertow_worker_pool","memoizedIsInitialized":-1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0}],"value_":0.0,"memoizedIsInitialized":-1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0},"service_":"Your_ApplicationName","serviceInstance_":"e33531aac85b4b93b8404b4f5f008fc8@192.168.255.10","timestamp_":1642576599799,"memoizedIsInitialized":1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0} 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016052740


   ![image](https://user-images.githubusercontent.com/22722907/150060150-d49e19a1-5dee-43de-9a12-10a39dafcc15.png)
   
   ![image](https://user-images.githubusercontent.com/22722907/150060306-3ff3f22f-df3f-40aa-9612-a3cf0b4e9c62.png)
   
   
   ![image](https://user-images.githubusercontent.com/22722907/150060184-a80b6442-1a59-4f34-a4f3-72e811ad92fc.png)
   
   ![image](https://user-images.githubusercontent.com/22722907/150060215-5b38f6f6-8543-41fc-8f66-5e052b197cde.png)
   
   
   yes, i config it in this way, but, it has no data in ui
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016060400


   And please provide the data in the MeterReceiver. Then we could know what is going on.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016152475


   {"metricCase_":1,"metric_":{"name_":"thread_pool","labels_":[{"name_":"metric_type","value_":"max_pool_size","memoizedIsInitialized":-1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0},{"name_":"pool_name","value_":"undertow_worker_pool","memoizedIsInitialized":-1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0}],"value_":80.0,"memoizedIsInitialized":-1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0},"service_":"","serviceInstance_":"","timestamp_":0,"memoizedIsInitialized":1,"unknownFields":{"fields":{}},"memoizedSize":-1,"memoizedHashCode":0} 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1014433537


   For agent side, it is very similar to agent tracing plugin. Just calling different core APIs. Check this.
   
   https://skywalking.apache.org/docs/skywalking-java/latest/en/setup/service-agent/java-agent/java-plugin-development-guide/#meter-plugin


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015518143


   yes, the oal config like  this in this way,same metric name with tag filter 
   
   
   ![image](https://user-images.githubusercontent.com/22722907/149965925-0aa82fd8-a661-47e5-bd65-e1ec50cbdf33.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015229172


   i do not get your mean, there are many kinds of thread pool, every type thread pool can have a ui component, all in one seems strange,and it is difficult to look
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1014114078


   This kind of filter function is very hard coded, and it has to set for all kinds of pools, which is not flexible, and have to set a lot of UI components to list all possibilities.
   I am thinking whether we should treat this as a logic endpoint? And metrics reporting through meter API rather than JVM and OAL analysis.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] [Java] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016570318


   @xu1009 Any update?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] [Java] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1024865712


   @xu1009 Are you going to add more meter plugins for thread pools?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015186603


   It is good to know. Could you post the metric sample here? To make the further review easier?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] [Java] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016913771


   Cool, good to see this. Let's move on to the official PR/Review to take care of code details. Thank you so much for you patience.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015518143


   yes, the oal config like  this in this way
   
   
   ![image](https://user-images.githubusercontent.com/22722907/149965925-0aa82fd8-a661-47e5-bd65-e1ec50cbdf33.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1013040095


   Could you share what do the OAP and UI look like?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1014439424


   At the backend, you just need to learn meter receiver and MAL
   
   1. https://skywalking.apache.org/docs/main/latest/en/setup/backend/backend-meter/#manual-meter-api
   2. Meter design, https://skywalking.apache.org/docs/main/latest/en/concepts-and-designs/meter/
   3. MAL, https://skywalking.apache.org/docs/main/latest/en/concepts-and-designs/mal/
   
   And learn fron slueth MAL setup
   1. https://skywalking.apache.org/docs/main/latest/en/setup/backend/spring-sleuth-setup/
   2. Configuration file example, https://github.com/apache/skywalking/blob/fc27f766c5da0f4165152025a6ba4080d034d1fc/oap-server/server-starter/src/main/resources/meter-analyzer-config/spring-sleuth.yaml


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016241894


   ![image](https://user-images.githubusercontent.com/22722907/150101656-3ca65f63-3070-43a3-b8cf-4356455f5c52.png)
   
   ![image](https://user-images.githubusercontent.com/22722907/150101730-3cde927c-23b2-4317-bd0f-1a6aacdff8a9.png)
   
   no data display in ui 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016152475


   ```json
   {
      "metricCase_":1,
      "metric_":{
         "name_":"thread_pool",
         "labels_":[
            {
               "name_":"metric_type",
               "value_":"max_pool_size",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            },
            {
               "name_":"pool_name",
               "value_":"undertow_worker_pool",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            }
         ],
         "value_":80.0,
         "memoizedIsInitialized":-1,
         "unknownFields":{
            "fields":{
               
            }
         },
         "memoizedSize":-1,
         "memoizedHashCode":0
      },
      "service_":"",
      "serviceInstance_":"",
      "timestamp_":0,
      "memoizedIsInitialized":1,
      "unknownFields":{
         "fields":{
            
         }
      },
      "memoizedSize":-1,
      "memoizedHashCode":0
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016148766


   Could you put this in JSON format? And print it in the console, and provide us the rawdata? This debug screenshot is hard for us to know the details.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016215328


   The data looks good, what do you mean `not ok`?
   ![image](https://user-images.githubusercontent.com/5441976/150096504-435e8fd8-e23b-47c2-ae27-1b44e0b7a73f.png)
   
   This is my understanding of the data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng closed issue #8433: [Feature] [Java] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng closed issue #8433:
URL: https://github.com/apache/skywalking/issues/8433


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1014428323


   emm, the agent plugin  and oap server is easy to add new thread pool,  the problem is how to display it in ui, i am not familiar with what you say, this has some demo in skywalking project,or, we can make basic plugin to collect metirc and save it, every one can customizing their dashboard ui


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015231343


   i think we can provide some base thread pool metric collect, like undertow, tomcat, other user can easy to add based on this way, and they can custom their own ui component


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015523043


   This config still could make the metrics into different metric name. I prefer we could do
   ```
   metricsRules:
       - name: java_thread_pool
          exp: java_thread_pool
   ```
   If you want to separate pools of Java, you could use  `undertow_thread_pool`. And types of `metric_type` is going to be available on the UI automatically as labels.
   
   Coud you try this? @wankai123 could help if you face any issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016055684


   Could you check what does the metric look like in the database?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016212886


   ![image](https://user-images.githubusercontent.com/22722907/150095867-59abaa71-4b5d-405b-aea8-57e87b57a3d3.png)
   
   it is not ok, the above image is data in database


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016052740


   ![image](https://user-images.githubusercontent.com/22722907/150060150-d49e19a1-5dee-43de-9a12-10a39dafcc15.png)
   
   ![image](https://user-images.githubusercontent.com/22722907/150060306-3ff3f22f-df3f-40aa-9612-a3cf0b4e9c62.png)
   
   
   ![image](https://user-images.githubusercontent.com/22722907/150060184-a80b6442-1a59-4f34-a4f3-72e811ad92fc.png)
   
   ![image](https://user-images.githubusercontent.com/22722907/150060215-5b38f6f6-8543-41fc-8f66-5e052b197cde.png)
   
   
   yes, i config it in this way, but, it has no data in ui,  from the agent log, i can see meter report data 
   
   ![image](https://user-images.githubusercontent.com/22722907/150060733-95f7c695-f086-40e8-8d5b-84cbfaff1d3a.png)
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1013019521


   now, in my projeject, agent core has a model contains pool name and thead threadPoolExecutor instance, the agent plugin set the thread pool name and instance to it on constructor, and the core get  message from the model, and send metrics to oap service


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1013015979


   Then we need a way to build a labels(pool name) metric for connection pool. What do you want to build?
   Could you provide more details?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016144701


   <img width="1244" alt="企业微信截图_f3a61c2b-75c1-4388-b698-5050d9f59509" src="https://user-images.githubusercontent.com/22722907/150081024-af46573e-d93b-43a4-a654-c780cd6ff128.png">
   
   this is the data from MeterServiceHandler, the database is h2, i do not have tool to look


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015185532


   i have tried, it is ok,plugin can give the  threadPoolExecutor instance,  and agent core build thread pool metrics, and send it to backend by meter api


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1015585977


   i try, it not work, could you give some demo with ui template and oal config
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1013040095


   Could you share what do the OAL script, the new part of proto,  and UI look like?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] wu-sheng commented on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016244447


   Do you check the instance name(entity name in the table) and time bucket?
   
   And, you could debug `MetricsQuery#readLabeledMetricsValues` to see what is going on. The logic is also not hard.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016151857


   ```json
   {
      "metricCase_":1,
      "metric_":{
         "name_":"thread_pool",
         "labels_":[
            {
               "name_":"metric_type",
               "value_":"active_size",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            },
            {
               "name_":"pool_name",
               "value_":"undertow_worker_pool",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            }
         ],
         "value_":0.0,
         "memoizedIsInitialized":-1,
         "unknownFields":{
            "fields":{
               
            }
         },
         "memoizedSize":-1,
         "memoizedHashCode":0
      },
      "service_":"Your_ApplicationName",
      "serviceInstance_":"e33531aac85b4b93b8404b4f5f008fc8@192.168.255.10",
      "timestamp_":1642576599799,
      "memoizedIsInitialized":1,
      "unknownFields":{
         "fields":{
            
         }
      },
      "memoizedSize":-1,
      "memoizedHashCode":0
   }
   ```
   
   The second in the same streaming.
   ```json
   {
      "metricCase_":1,
      "metric_":{
         "name_":"thread_pool",
         "labels_":[
            {
               "name_":"metric_type",
               "value_":"max_pool_size",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            },
            {
               "name_":"pool_name",
               "value_":"undertow_worker_pool",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            }
         ],
         "value_":80.0,
         "memoizedIsInitialized":-1,
         "unknownFields":{
            "fields":{
               
            }
         },
         "memoizedSize":-1,
         "memoizedHashCode":0
      },
      "service_":"",
      "serviceInstance_":"",
      "timestamp_":0,
      "memoizedIsInitialized":1,
      "unknownFields":{
         "fields":{
            
         }
      },
      "memoizedSize":-1,
      "memoizedHashCode":0
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [skywalking] xu1009 edited a comment on issue #8433: [Feature] Support collect thread pool metrics

Posted by GitBox <gi...@apache.org>.
xu1009 edited a comment on issue #8433:
URL: https://github.com/apache/skywalking/issues/8433#issuecomment-1016151857


   
   ```json
   {
      "metricCase_":1,
      "metric_":{
         "name_":"thread_pool",
         "labels_":[
            {
               "name_":"metric_type",
               "value_":"active_size",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            },
            {
               "name_":"pool_name",
               "value_":"undertow_worker_pool",
               "memoizedIsInitialized":-1,
               "unknownFields":{
                  "fields":{
                     
                  }
               },
               "memoizedSize":-1,
               "memoizedHashCode":0
            }
         ],
         "value_":0.0,
         "memoizedIsInitialized":-1,
         "unknownFields":{
            "fields":{
               
            }
         },
         "memoizedSize":-1,
         "memoizedHashCode":0
      },
      "service_":"Your_ApplicationName",
      "serviceInstance_":"e33531aac85b4b93b8404b4f5f008fc8@192.168.255.10",
      "timestamp_":1642576599799,
      "memoizedIsInitialized":1,
      "unknownFields":{
         "fields":{
            
         }
      },
      "memoizedSize":-1,
      "memoizedHashCode":0
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org