You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Nilotpal Nandi (Jira)" <ji...@apache.org> on 2022/07/01 10:15:00 UTC
[jira] [Created] (HDDS-6976) 0G data moved by container balancer after successful iteration
Nilotpal Nandi created HDDS-6976:
------------------------------------
Summary: 0G data moved by container balancer after successful iteration
Key: HDDS-6976
URL: https://issues.apache.org/jira/browse/HDDS-6976
Project: Apache Ozone
Issue Type: Bug
Components: SCM
Reporter: Nilotpal Nandi
steps taken :
-------------
1. Write 40GB of data on 5 DNs, Run container balancer using CLI, balancer went in running state.
2. Run SCM failover.
3. New leader election happened and container balancer started again.
Logs in new SCM leader shows that only 0GB moved.
scm log
{noformat}
Container Balancer status:
Container Balancer Configuration values:
2022-06-17 11:03:15,603 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Starting ContainerBalancer in this scm on status change
2022-06-17 11:03:15,606 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Starting Container Balancer...
Container Balancer status:
Container Balancer Configuration values:
2022-06-17 11:03:15,612 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Container Balancer has identified 3 Over-Utilized and 2 Under-Utilized Datanodes that need to be balanced.
2022-06-17 11:03:15,618 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode bde02c7a-3693-4a65-8227-d655943591c2 for container move.
2022-06-17 11:03:15,618 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #1003 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode bde02c7a-3693-4a65-8227-d655943591c2
2022-06-17 11:03:15,643 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode bde02c7a-3693-4a65-8227-d655943591c2 for container move.
2022-06-17 11:03:15,643 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #4 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode bde02c7a-3693-4a65-8227-d655943591c2
2022-06-17 11:03:15,655 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode bde02c7a-3693-4a65-8227-d655943591c2 for container move.
2022-06-17 11:03:15,655 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #1005 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode bde02c7a-3693-4a65-8227-d655943591c2
2022-06-17 11:03:15,662 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode bde02c7a-3693-4a65-8227-d655943591c2 for container move.
2022-06-17 11:03:15,662 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #3 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode bde02c7a-3693-4a65-8227-d655943591c2
2022-06-17 11:03:15,669 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode bde02c7a-3693-4a65-8227-d655943591c2 for container move.
2022-06-17 11:03:15,669 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #1 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode bde02c7a-3693-4a65-8227-d655943591c2
2022-06-17 11:03:15,676 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode daf9bc99-d66d-443e-82de-2e837ac130b2 for container move.
2022-06-17 11:03:15,676 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #1002 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode daf9bc99-d66d-443e-82de-2e837ac130b2
2022-06-17 11:03:15,681 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode daf9bc99-d66d-443e-82de-2e837ac130b2 for container move.
2022-06-17 11:03:15,681 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #1001 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode daf9bc99-d66d-443e-82de-2e837ac130b2
2022-06-17 11:03:15,690 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer matched source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c with target datanode daf9bc99-d66d-443e-82de-2e837ac130b2 for container move.
2022-06-17 11:03:15,690 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: ContainerBalancer is trying to move container #2 from source datanode 160b0324-2ce8-4f24-a5a2-e63fcc59073c to target datanode daf9bc99-d66d-443e-82de-2e837ac130b2
2022-06-17 11:03:15,705 INFO org.apache.hadoop.hdds.scm.container.balancer.FindSourceGreedy: no more candidate source data node
2022-06-17 11:05:12,912 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Number of datanodes involved in this iteration: 3. Size moved in this iteration: 0GB.
2022-06-17 11:05:12,912 INFO org.apache.hadoop.hdds.scm.container.balancer.ContainerBalancer: Result of this iteration of Container Balancer: ITERATION_COMPLETED
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org