You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/08/15 12:14:53 UTC
[GitHub] [incubator-doris] zenoyang opened a new issue #6447: [Bug] DeleteInfos in the DeleteHandler will never be deleted
zenoyang opened a new issue #6447:
URL: https://github.com/apache/incubator-doris/issues/6447
**Describe the bug**
DeleteInfos in the DeleteHandler will never be deleted, taking up too much memory and metadata storage.
When users use a large number of delete statements, FE metadata parsing problems will occur, resulting in failure to restart all FEs due to load image failure.
An error is reported when starting FE:
```
java.lang.IllegalArgumentException: capacity < 0: (-2144832511 < 0)
at java.base/java.nio.Buffer.createCapacityException(Buffer.java:256)
at java.base/java.nio.CharBuffer.allocate(CharBuffer.java:347)
at java.base/java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:809)
at org.apache.doris.common.io.Text.decode(Text.java:362)
at org.apache.doris.common.io.Text.decode(Text.java:341)
at org.apache.doris.common.io.Text.readString(Text.java:416)
at org.apache.doris.load.DeleteHandler.read(DeleteHandler.java:687)
at org.apache.doris.catalog.Catalog.loadDeleteHandler(Catalog.java:1879)
at org.apache.doris.catalog.Catalog.loadImage(Catalog.java:1530)
at org.apache.doris.catalog.Catalog.initialize(Catalog.java:772)
at org.apache.doris.PaloFe.start(PaloFe.java:109)
at org.apache.doris.PaloFe.main(PaloFe.java:60)
```
**To Reproduce**
Steps to reproduce the behavior:
1. Execute the "show delete" statement to see all the historical deleted information
2. When there are too many deleteInfo, load image error when restarting FE, and FE cannot be started
**Expected behavior**
1. According to the `label_keep_max_second` configuration, clean up the old deleteInfo
2. Support pagination to read metadata text when load image
**Environment**
- OS: Centos7
- Version: Doris branch-0.13
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman closed issue #6447: [Bug] DeleteInfos in the DeleteHandler will never be deleted
Posted by GitBox <gi...@apache.org>.
morningman closed issue #6447:
URL: https://github.com/apache/incubator-doris/issues/6447
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org