You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@bookkeeper.apache.org by GitBox <gi...@apache.org> on 2022/09/29 08:47:55 UTC
[GitHub] [bookkeeper] wolfstudy opened a new issue, #3507: In bookie 4.12.0, rocksdb(6.10.2) has memory leak?
wolfstudy opened a new issue, #3507:
URL: https://github.com/apache/bookkeeper/issues/3507
**BUG REPORT**
***Describe the bug***
Our 64GB machine uses 15GB of memory inside and outside the heap, but the machine kills the Bookie process directly because the system memory is not enough. The memory usage is all occupied by the Bookie process, so the only place to suspect is to call the sub-JNI part, and only rocksdb is left. The bookie version is 4.12.0, and the version of rocksdb is 6.10.2.
free -m
```
total used free shared buff/cache available
Mem: 63088 58063 337 268 4688 4639
Swap: 0 0 0
```
pmesg -T output as follows:
<img width="1130" alt="image" src="https://user-images.githubusercontent.com/20965307/192985133-6e8358cd-a712-4120-a2cf-198bd605b4d0.png">
And the JVM monitor as follows:
***Screenshots***
If applicable, add screenshots to help explain your problem.
***Additional context***
Add any other context about the problem here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@bookkeeper.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bookkeeper] dlg99 commented on issue #3507: In bookie 4.12.0, rocksdb(6.10.2) has memory leak?
Posted by GitBox <gi...@apache.org>.
dlg99 commented on issue #3507:
URL: https://github.com/apache/bookkeeper/issues/3507#issuecomment-1270433714
there were multiple changes around RocksDb.
Please try upgrading to BK 4.14.x (this should be easier than upgrade to 4.15).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@bookkeeper.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bookkeeper] hangc0276 commented on issue #3507: In bookie 4.12.0, rocksdb(6.10.2) has memory leak?
Posted by "hangc0276 (via GitHub)" <gi...@apache.org>.
hangc0276 commented on issue #3507:
URL: https://github.com/apache/bookkeeper/issues/3507#issuecomment-1605914617
We tested RocksDB 6.16.4, the native memory leak issue still exists, and after upgrading the RocksDB to 6.29.4.1, this issue fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@bookkeeper.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [bookkeeper] wolfstudy commented on issue #3507: In bookie 4.12.0, rocksdb(6.10.2) has memory leak?
Posted by GitBox <gi...@apache.org>.
wolfstudy commented on issue #3507:
URL: https://github.com/apache/bookkeeper/issues/3507#issuecomment-1272211082
> there were multiple changes around RocksDb. Please try upgrading to BK 4.14.x (this should be easier than upgrade to 4.15).
Thanks @dlg99 feedback, we are trying to upgrade Bookie version to 4.14.x. At the same time, I want to dump the memory in the heap to see if you can see what caused the memory leak. Is it because of the memory leak in RocksDB itself or because of a problem with the interface we call RocksDB JNI that caused the memory leak?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@bookkeeper.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] In bookie 4.12.0, rocksdb(6.10.2) has memory leak? [bookkeeper]
Posted by "shoothzj (via GitHub)" <gi...@apache.org>.
shoothzj closed issue #3507: In bookie 4.12.0, rocksdb(6.10.2) has memory leak?
URL: https://github.com/apache/bookkeeper/issues/3507
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@bookkeeper.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org