You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Leon Gao (Jira)" <ji...@apache.org> on 2021/10/11 22:00:00 UTC
[jira] [Created] (HDFS-16268) Balancer stuck when moving striped
blocks due to NPE
Leon Gao created HDFS-16268:
-------------------------------
Summary: Balancer stuck when moving striped blocks due to NPE
Key: HDFS-16268
URL: https://issues.apache.org/jira/browse/HDFS-16268
Project: Hadoop HDFS
Issue Type: Bug
Components: balancer & mover, erasure-coding
Affects Versions: 3.2.2
Reporter: Leon Gao
Assignee: Leon Gao
{code:java}
21/10/11 06:11:26 WARN balancer.Dispatcher: Dispatcher thread failed
java.lang.NullPointerException
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$PendingMove.markMovedIfGoodBlock(Dispatcher.java:289)
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$PendingMove.chooseBlockAndProxy(Dispatcher.java:272)
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$PendingMove.access$2500(Dispatcher.java:236)
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$Source.chooseNextMove(Dispatcher.java:899)
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$Source.dispatchBlocks(Dispatcher.java:958)
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$Source.access$3300(Dispatcher.java:757)
at org.apache.hadoop.hdfs.server.balancer.Dispatcher$2.run(Dispatcher.java:1226)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
{code}
Due to NPE in the middle, there will be pending moves left in the queue so balancer will stuck forever.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org