You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Aryan Gupta (Jira)" <ji...@apache.org> on 2025/05/20 19:12:00 UTC
[jira] [Resolved] (HDDS-13079) Improve logging in DN for delete operation
[ https://issues.apache.org/jira/browse/HDDS-13079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aryan Gupta resolved HDDS-13079.
--------------------------------
Fix Version/s: 2.1.0
Resolution: Fixed
> Improve logging in DN for delete operation
> ------------------------------------------
>
> Key: HDDS-13079
> URL: https://issues.apache.org/jira/browse/HDDS-13079
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: DN
> Reporter: Ashish Kumar
> Assignee: Ashish Kumar
> Priority: Major
> Labels: pull-request-available
> Fix For: 2.1.0
>
>
> 1. Below log can come in some scenario and leads to confusion.
> One of the scenario is when container is open and deletes are happening on those container. Those transactions remains in SCM db until container gets CLOSED.
> When container gets closed, SCM sends delete transactions for that container to DN at the same time. DN uses multiple thread in command handler which may lead to higher transaction value is processed before smaller one and causing logs to flood like below.
> We can change below log to DEBUG level.
> {code:java}
> 2025-05-19 08:52:51,883 INFO [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 98 <= 150
> 2025-05-19 08:52:51,884 INFO [DeleteBlocksCommandHandlerThread-3]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 124 <= 150
> 2025-05-19 08:52:51,884 INFO [DeleteBlocksCommandHandlerThread-4]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 146 <= 150
> 2025-05-19 08:52:51,885 INFO [DeleteBlocksCommandHandlerThread-0]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 160 <= 200
> 2025-05-19 08:52:51,885 INFO [DeleteBlocksCommandHandlerThread-2]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 174 <= 210
> 2025-05-19 08:52:51,886 INFO [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 182 <= 210
> 2025-05-19 08:52:51,886 INFO [DeleteBlocksCommandHandlerThread-3]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 197 <= 210
> 2025-05-19 08:52:51,887 INFO [DeleteBlocksCommandHandlerThread-4]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 205 <= 255
> 2025-05-19 08:52:51,887 INFO [DeleteBlocksCommandHandlerThread-0]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 216 <= 265
> 2025-05-19 08:52:51,888 INFO [DeleteBlocksCommandHandlerThread-2]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 230 <= 296
> 2025-05-19 08:52:51,888 INFO [DeleteBlocksCommandHandlerThread-1]-org.apache.hadoop.ozone.container.common.statemachine.commandhandler.DeleteBlocksCommandHandler: Delete blocks for containerId: 3 is either received out of order or retried, 242 <= 296 {code}
>
> 2. Change below log to info level also add count of success and failed transaction when DN process delete request from SCM.
> {code:java}
> LOG.debug("Sending following block deletion ACK to SCM");{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org