You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Wei-Chiu Chuang (Jira)" <ji...@apache.org> on 2020/10/19 21:20:00 UTC

[jira] [Created] (HDDS-4356) SCM is flooded with useless "Deleting blocks" messages

Wei-Chiu Chuang created HDDS-4356:
-------------------------------------

             Summary: SCM is flooded with useless "Deleting blocks" messages
                 Key: HDDS-4356
                 URL: https://issues.apache.org/jira/browse/HDDS-4356
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
          Components: SCM
    Affects Versions: 1.0.0
            Reporter: Wei-Chiu Chuang


Testing a 1.0.0 SCM.

I'm seeing these messages flooding SCM log file when a dead DN is detected.
{noformat}
2020-10-19 13:48:19,642 INFO org.apache.hadoop.hdds.scm.node.DeadNodeHandler: A dead datanode is detected. 9b27c38d-9104-491b-b76b-959dc9dd06a2{ip: 10.12.1.82, host: rhel12.ozone.local, networkLocation: /default, certSerialId: null}
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.server.SCMBlockProtocolServer: SCM is informed by OM to delete 1000 blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,894 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,895 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,895 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
2020-10-19 13:48:24,895 INFO org.apache.hadoop.hdds.scm.block.BlockManagerImpl: Deleting blocks
 {noformat}
SCM deletes 1000 blocks max at a time, and the "Deleting blocks" message repeats for 1000 times. Worse, it doesn't give any useful information (at the very least, it should print the block id)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org