You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Ashish Kumar (Jira)" <ji...@apache.org> on 2025/05/20 05:09:00 UTC
[jira] [Created] (HDDS-13079) Improve logging in DN for delete operation
Ashish Kumar created HDDS-13079:
-----------------------------------
Summary: Improve logging in DN for delete operation
Key: HDDS-13079
URL: https://issues.apache.org/jira/browse/HDDS-13079
Project: Apache Ozone
Issue Type: Bug
Components: DN
Reporter: Ashish Kumar
Assignee: Ashish Kumar
1. Below log can come in some scenario and leads to confusion.
One of the scenario is when container is open and deletes are happening on those container. Those transactions remains in SCM db until container gets CLOSED.
When container gets closed, SCM sends delete transactions for that container to DN at the same time. DN uses multiple thread in command handler which may lead to higher transaction value is processed before smaller one and causing logs to flood like below.
We can change below log to DEBUG level.
{code:java}
2025-05-19 08:52:51,883 INFO [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 98 <= 150
2025-05-19 08:52:51,884 INFO [DeleteBlocksCommandHandlerThread-3]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 124 <= 150
2025-05-19 08:52:51,884 INFO [DeleteBlocksCommandHandlerThread-4]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 146 <= 150
2025-05-19 08:52:51,885 INFO [DeleteBlocksCommandHandlerThread-0]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 160 <= 200
2025-05-19 08:52:51,885 INFO [DeleteBlocksCommandHandlerThread-2]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 174 <= 210
2025-05-19 08:52:51,886 INFO [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 182 <= 210
2025-05-19 08:52:51,886 INFO [DeleteBlocksCommandHandlerThread-3]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 197 <= 210
2025-05-19 08:52:51,887 INFO [DeleteBlocksCommandHandlerThread-4]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 205 <= 255
2025-05-19 08:52:51,887 INFO [DeleteBlocksCommandHandlerThread-0]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 216 <= 265
2025-05-19 08:52:51,888 INFO [DeleteBlocksCommandHandlerThread-2]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 230 <= 296
2025-05-19 08:52:51,888 INFO [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 242 <= 296 {code}
2. Change below log to info level also add count of success and failed transaction when DN process delete request from SCM.
{code:java}
LOG.debug("Sending following block deletion ACK to SCM");{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org