You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@dubbo.apache.org by GitBox <gi...@apache.org> on 2022/08/25 07:18:46 UTC

[GitHub] [dubbo-go] fubug opened a new issue, #2031: common.MergeURL占用内存一直上升

fubug opened a new issue, #2031:
URL: https://github.com/apache/dubbo-go/issues/2031

   ![pprof001 (1)](https://user-images.githubusercontent.com/18571911/186595185-33a395eb-2276-48f3-b2ed-8ae909ef0cc7.svg)
   ![image](https://user-images.githubusercontent.com/18571911/186595287-07d41ec8-6cda-4ad9-9cca-c0657f56bd45.png)
   ![image](https://user-images.githubusercontent.com/18571911/186600442-701ebd2b-fe72-4ffb-927b-170564af67bc.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336308608

   > 这是我的配置文件
   > 
   > ```
   > dubbo:
   >   registries:
   >     demoZK: # 定义服务注册发现中心
   >       protocol: zookeeper
   >       address: x.x.x.x:2181
   >     demoZK2: # 定义服务注册发现中心
   >       protocol: zookeeper
   >       address: x.x.x.x:2182
   >     demoZK3: # 定义服务注册发现中心
   >       protocol: zookeeper
   >       address: x.x.x.x:2183
   >   consumer:
   >     references:
   >       AbcService: # 存根类名
   >         registry: demoZK,demoZK2,demoZK3
   >         protocol: dubbo # dubbo 协议,默认 hessian2 序列化方式
   >         interface: com.xx.xx.xx.AbcService # 接口需要与 go/java 客户端对应
   > ```
   
   行,我今天测一下


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] georgehao commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
georgehao commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303168745

   发个复现步骤


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1340315475

   什么时间封版本3.0.3


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] fubug commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
fubug commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303386051

   > 目前是有内存泄露的问题吗,其实上面那个图和top其实说明不了啥问题,如果有内存泄露的情况,发个复现步骤吧
   
   稍等,我花时间整理个最小版本的代码


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336797630

   很多
   ![Uploading zk.png…]()
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1337288045

   > > > > 嗯嗯,你这边方便帮忙看看 zk 里面 <img alt="image" width="1065" src="https://user-images.githubusercontent.com/12541438/205541413-b5e4ef06-911b-4084-95d4-253270493a93.png"> 这种日志多么
   > > > 
   > > > 
   > > > 这个日志是dubbo-go zk打印的吗?
   > > 
   > > 
   > > 嗯,zk 里面打印的。
   > 
   > 抽空给看下
   
   嗯嗯,我这边大概知道了,这两天会提个 PR 在测一下


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] fubug commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
fubug commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303314696

   截图失真比较严重,辛苦下载下来看下吧https://github.com/fubug/go/blob/main/start%20inuse_space.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336641232

   配置:go版本1.16, web框架gin, 引入dubbo-go v3,zk版本3.4.8


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336798911

   很多Close 
   <img width="1308" alt="zk" src="https://user-images.githubusercontent.com/10061880/205562056-8d7a4d18-f9b4-4a44-a49d-d1fe36b801cf.png">
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1338963041

   > 
   
   directory.go 文件吗?哪一行代码?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336646217

   go 1.16, web gin, dubbo-go v3,zk 3.4.8
   逻辑:gin api路由直接转dubbo-go client 调用java dubbo
   压测:请求gin api,qps=500+,8个小时,内存涨了120MB


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336677785

   嗯嗯,你这边方便帮忙看看 zk 里面 
   <img width="1065" alt="image" src="https://user-images.githubusercontent.com/12541438/205541413-b5e4ef06-911b-4084-95d4-253270493a93.png">
   这种日志多么


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


Re: [I] common.MergeURL占用内存一直上升 [dubbo-go]

Posted by "17703726883 (via GitHub)" <gi...@apache.org>.
17703726883 commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1752282136

   1.5.8也出现这个问题了,请问3.0解决了吗


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336307145

   这是我的配置文件
   ```
   dubbo:
     registries:
       demoZK: # 定义服务注册发现中心
         protocol: zookeeper
         address: x.x.x.x:2181
       demoZK2: # 定义服务注册发现中心
         protocol: zookeeper
         address: x.x.x.x:2182
       demoZK3: # 定义服务注册发现中心
         protocol: zookeeper
         address: x.x.x.x:2183
     consumer:
       references:
         AbcService: # 存根类名
           registry: demoZK,demoZK2,demoZK3
           protocol: dubbo # dubbo 协议,默认 hessian2 序列化方式
           interface: com.xx.xx.xx.AbcService # 接口需要与 go/java 客户端对应
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336307032

   ```
   dubbo:
     registries:
       demoZK: # 定义服务注册发现中心
         protocol: zookeeper
         address: x.x.x.x:2181
       demoZK2: # 定义服务注册发现中心
         protocol: zookeeper
         address: x.x.x.x:2182
       demoZK3: # 定义服务注册发现中心
         protocol: zookeeper
         address: x.x.x.x:2183
     consumer:
       references:
         AbcService: # 存根类名
           registry: demoZK,demoZK2,demoZK3
           protocol: dubbo # dubbo 协议,默认 hessian2 序列化方式
           interface: com.asiainno.uplive.riskcontrol.service.AbcService # 接口需要与 go/java 客户端对应
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336355571

   go.mod
   ```
   	dubbo.apache.org/dubbo-go/v3 v3.0.2
   	github.com/apache/dubbo-go-hessian2 v1.11.1 // indirect
   
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1339034576

   > > 
   > 
   > directory.go 文件吗?哪一行代码?
   
   <img width="1429" alt="image" src="https://user-images.githubusercontent.com/12541438/205874211-ebb1e7c9-fc05-416c-8a94-acfc5c313797.png">
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303131893

   疯狂调用 MergeURL这个函数的确会内存上升,细节在定位


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1310221803

   目前怀疑跟多 zk 有关,这边用户把注册中心切换成 nacos 之后看着正常。 有类似问题的可以先切换试试。 root cause 我在跟一下


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336782584

   > 嗯嗯,你这边方便帮忙看看 zk 里面 <img alt="image" width="1065" src="https://user-images.githubusercontent.com/12541438/205541413-b5e4ef06-911b-4084-95d4-253270493a93.png"> 这种日志多么
   
   这个日志是dubbo-go zk打印的吗?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] georgehao commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
georgehao commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303171579

   目前是有内存泄露的问题吗,其实上面那个图和top其实说明不了啥问题,如果有内存泄露的情况,发个复现步骤吧


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1338893291

   第一张图和第二张图对比,时间相差3-4个小时,内存涨了60MB
   ![pprof_001](https://user-images.githubusercontent.com/10061880/205845971-f6b8b006-e476-4476-b010-06aa3100ecb0.png) 图一
   ![pprof_002](https://user-images.githubusercontent.com/10061880/205845997-dc123524-6c9f-4790-b68a-2bda453d888e.png) 图二
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336219285

   这个问题还没有修复吗??调用链,config.Load->refConfig.Refer->common.MergeURL,没有调用很多次,咋来的内存溢出


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] zhaoyunxing92 commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
zhaoyunxing92 commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1241986345

   @彭笳鑫


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] baerwang commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
baerwang commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1296885998

   ```go
   func MergeURL(serviceURL *URL, referenceURL *URL) *URL {
   	// After Clone, it is a new URL that there is no thread safe issue.
   	mergedURL := serviceURL.Clone()
   	// iterator the referenceURL if serviceURL not have the key ,merge in
   	// referenceURL usually will not changed. so change RangeParams to GetParams to avoid the string value copy.// Group get group
   	for key, value := range referenceURL.GetParams() {
   		if _, ok := mergedURL.GetNonDefaultParam(key); !ok {
   			if len(value) > 0 {
   				mergedURL.params[key] = value
   			}
   		}
   	}
   
   	// loadBalance,cluster,retries strategy config
   	methodConfigMergeFcn := mergeNormalParam(mergedURL.params, referenceURL, []string{constant.LoadbalanceKey, constant.ClusterKey, constant.RetriesKey, constant.TimeoutKey})
   
   	// remote timestamp
   	if v, ok := serviceURL.GetNonDefaultParam(constant.TimestampKey); !ok {
   		mergedURL.params[constant.RemoteTimestampKey] = []string{v}
   		mergedURL.params[constant.TimestampKey] = []string{referenceURL.GetParam(constant.TimestampKey, "")}
   	}
   
   	// finally execute methodConfigMergeFcn
   	for _, method := range referenceURL.Methods {
   		for _, fcn := range methodConfigMergeFcn {
   			fcn("methods." + method)
   		}
   	}
   	// In this way, we will raise some performance.
   	return mergedURL
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336306166

   > 
   
   go调java,我这边是可以复现的,直接用jmeter压测,内存很快就涨上来;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1337260558

   > > > 嗯嗯,你这边方便帮忙看看 zk 里面 <img alt="image" width="1065" src="https://user-images.githubusercontent.com/12541438/205541413-b5e4ef06-911b-4084-95d4-253270493a93.png"> 这种日志多么
   > > 
   > > 
   > > 这个日志是dubbo-go zk打印的吗?
   > 
   > 嗯,zk 里面打印的。
   
   抽空给看下


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1337304934

   感恩的心


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336343375

   > > > 这是我的配置文件
   > > > ```
   > > > dubbo:
   > > >   registries:
   > > >     demoZK: # 定义服务注册发现中心
   > > >       protocol: zookeeper
   > > >       address: x.x.x.x:2181
   > > >     demoZK2: # 定义服务注册发现中心
   > > >       protocol: zookeeper
   > > >       address: x.x.x.x:2182
   > > >     demoZK3: # 定义服务注册发现中心
   > > >       protocol: zookeeper
   > > >       address: x.x.x.x:2183
   > > >   consumer:
   > > >     references:
   > > >       AbcService: # 存根类名
   > > >         registry: demoZK,demoZK2,demoZK3
   > > >         protocol: dubbo # dubbo 协议,默认 hessian2 序列化方式
   > > >         interface: com.xx.xx.xx.AbcService # 接口需要与 go/java 客户端对应
   > > > ```
   > > 
   > > 
   > > 行,我今天测一下
   > 
   > 有没有结果
   我这启动了一个 java 的 provider, 3 个 zk 做注册中心, go client 用 100w 次 loop 请求,内存变化不是很大。你这边有最小复现流程么?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336414638

   Hello,你那边复现出来了吗?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1338916887

   > 第一张图和第二张图对比,时间相差3-4个小时,内存涨了60MB ![pprof_001](https://user-images.githubusercontent.com/10061880/205845971-f6b8b006-e476-4476-b010-06aa3100ecb0.png) 图一 ![pprof_002](https://user-images.githubusercontent.com/10061880/205845997-dc123524-6c9f-4790-b68a-2bda453d888e.png) 图二
   
   您这边是测试的代码么?如果是的话,可以试试,在 subscribe 那边加一个return,比如 失败 2 次就 return,先不 DoSub, 看看内存情况。 可以先下一个 dubbo-go 然后  用  go mod edit 去替换掉dubbo-go。 
   我还在找root cause。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336791424

   > > 嗯嗯,你这边方便帮忙看看 zk 里面 <img alt="image" width="1065" src="https://user-images.githubusercontent.com/12541438/205541413-b5e4ef06-911b-4084-95d4-253270493a93.png"> 这种日志多么
   > 
   > 这个日志是dubbo-go zk打印的吗?
   
   嗯,zk 里面打印的。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336289473

   > 这个问题还没有修复吗??调用链,config.Load->refConfig.Refer->common.MergeURL,没有调用很多次,咋来的内存溢出
   
   
   平常状态下比较难复现,你也是 go 调用 java 么?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] georgehao commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
georgehao commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303176099

   如果可以的话,发一下内存的增长的截图。如果有条件的发下 内存 diff profile的log
   
   ```
   curl -s http://127.0.0.1:8080/debug/pprof/heap > 1231.heap
   过 一段时间 (5m, 10m, 30m, 1h)
   curl -s http://127.0.0.1:8080/debug/pprof/heap > 1241.heap
   go tool pprof --http :9090 --base 1231.heap  1241.heap
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] justxuewei commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
justxuewei commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1340324273

   > 什么时间封版本3.0.3
   
   Now, we are releasing `v3.0.4`. The patch to fix this issue might be put into `v3.0.5` or others.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1246970817

   初步怀疑像先merge了一个 url,然后在把 url 更新到event里,下次从event里面在拿出来在 merge,有更详细的复现步骤么 @fubug 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] Lvnszn commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
Lvnszn commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1303623029

   初步怀疑推送风暴,可以提供注册中心的推送日志么?
   集群规模大概是多少?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] AlexStocks commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
AlexStocks commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1318595168

   有一个用户使用了 zk v3.4.10,也遇到了这个问题。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] AlexStocks commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
AlexStocks commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336312688

   > > 
   > 
   > go调java,我这边是可以复现的,直接用jmeter压测,内存很快就涨上来;
   
   能否在钉钉群 23331795 一块聊下?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336340207

   > > 这是我的配置文件
   > > ```
   > > dubbo:
   > >   registries:
   > >     demoZK: # 定义服务注册发现中心
   > >       protocol: zookeeper
   > >       address: x.x.x.x:2181
   > >     demoZK2: # 定义服务注册发现中心
   > >       protocol: zookeeper
   > >       address: x.x.x.x:2182
   > >     demoZK3: # 定义服务注册发现中心
   > >       protocol: zookeeper
   > >       address: x.x.x.x:2183
   > >   consumer:
   > >     references:
   > >       AbcService: # 存根类名
   > >         registry: demoZK,demoZK2,demoZK3
   > >         protocol: dubbo # dubbo 协议,默认 hessian2 序列化方式
   > >         interface: com.xx.xx.xx.AbcService # 接口需要与 go/java 客户端对应
   > > ```
   > 
   > 行,我今天测一下
   
   有没有结果


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336355602

   > > > > 这是我的配置文件
   > > > > ```
   > > > > dubbo:
   > > > >   registries:
   > > > >     demoZK: # 定义服务注册发现中心
   > > > >       protocol: zookeeper
   > > > >       address: x.x.x.x:2181
   > > > >     demoZK2: # 定义服务注册发现中心
   > > > >       protocol: zookeeper
   > > > >       address: x.x.x.x:2182
   > > > >     demoZK3: # 定义服务注册发现中心
   > > > >       protocol: zookeeper
   > > > >       address: x.x.x.x:2183
   > > > >   consumer:
   > > > >     references:
   > > > >       AbcService: # 存根类名
   > > > >         registry: demoZK,demoZK2,demoZK3
   > > > >         protocol: dubbo # dubbo 协议,默认 hessian2 序列化方式
   > > > >         interface: com.xx.xx.xx.AbcService # 接口需要与 go/java 客户端对应
   > > > > ```
   > > > 
   > > > 
   > > > 行,我今天测一下
   > > 
   > > 
   > > 有没有结果
   > > 我这启动了一个 java 的 provider, 3 个 zk 做注册中心, go client 用 100w 次 loop 请求,内存变化不是很大。你这边有最小复现流程么?
   
   <img width="990" alt="j_test" src="https://user-images.githubusercontent.com/10061880/205482655-f4821e85-6ca1-4f16-92d6-a2c7641130f1.png">


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1336359298

   pprof数据如下:


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] shenchao861129 commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
shenchao861129 commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1318468715

   我们目前也遇到了同样的问题。
   
   ![image](https://user-images.githubusercontent.com/834323/202430430-1129c518-bc39-40be-89f9-c588910ac3b5.png)
   
   
   环境:
   dubbo-go: v3.0.1
   ZooKeeper: v3.4.8
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org


[GitHub] [dubbo-go] mengccmumu commented on issue #2031: common.MergeURL占用内存一直上升

Posted by GitBox <gi...@apache.org>.
mengccmumu commented on issue #2031:
URL: https://github.com/apache/dubbo-go/issues/2031#issuecomment-1340406871

   > 
   have to wait so long~!,i hope it can be fixed in v 3.0.5
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org