[jira] [Created] (HDFS-18014) Slow peer lookup in DatanodeManager fails for IPv6 DataNodes

["Siyao Meng (Jira)" <ji...@apache.org>]

Siyao Meng created HDFS-18014:
---------------------------------

             Summary: Slow peer lookup in DatanodeManager fails for IPv6 DataNodes
                 Key: HDFS-18014
                 URL: https://issues.apache.org/jira/browse/HDFS-18014
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namenode
            Reporter: Siyao Meng
            Assignee: Siyao Meng


{{DatanodeManager#getDnDescriptorsFromIpAddr}} extracts the host from each slow peer key with {{node.split(":")[0]}}. The keys are DataNode info addresses ({{DatanodeID#getInfoAddr()}} or {{getInfoSecureAddr()}}) recorded by {{BlockReceiver}} and stored by {{SlowPeerTracker#addReport}}.

For an IPv6 DataNode the key is {{2001:db8::1:9864}} (or {{[2001:db8::1]:9864}} once HDFS-18010 brackets IPv6 literals), so the extracted host is {{2001}} (or {{[2001}}). {{Host2NodesMap#getDatanodeByHost}} never finds the node, so {{getSlowPeersUuidSet}} and {{getAllSlowDataNodes}} return nothing for IPv6 DataNodes and {{dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled}} has no effect on them.

Fix: take the host as everything before the last {{:}} and strip surrounding brackets. IPv4 and hostname keys parse the same as before.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org