You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by air <cn...@gmail.com> on 2012/04/11 06:47:34 UTC
Fwd: Decommission process without deletion
---------- 已转发邮件 ----------
发件人： air <cn...@gmail.com>
日期： 2012年4月11日 上午11:21
主题： Re: Decommission process without deletion
收件人： CDH Users <cd...@cloudera.org>
this is the log of last week's decommission log, the decommission process
successfully at the end ！
2012-03-28 14:18:12,429 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020)
Starting thread to transfer block blk_-5988161868320786448_405451 to 192.16
8.85.98:50010
2012-03-28 14:18:12,430 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020)
Starting thread to transfer block blk_-4840159203919666938_336712 to 192.16
8.85.102:50010
2012-03-28 14:18:12,450 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block
blk_-5623726625798347617_167375 src: /192.168.85.
97:46739 dest: /192.168.85.106:50010
2012-03-28 14:18:12,464 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Received block
blk_-5623726625798347617_167375 src: /192.168.85.9
7:46739 dest: /192.168.85.106:50010 of size 1321
2012-03-28 14:18:13,837 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075,
ipcPort=50020):Transmitted block blk_-5988161868320786448_405451 to /
192.168.85.98:50010
2012-03-28 14:18:13,911 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
192.168.85.106:50010, storageID=DS-117065712
-192.168.85.106-50010-1327909270390, infoPort=50075,
ipcPort=50020):Transmitted block blk_-4840159203919666938_336712 to /
192.168.85.102:50010
2012-03-28 14:18:15,431 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-7595219335459687840_180028 file /data1/dfs/
data/current/subdir10/subdir50/blk_-7595219335459687840 for deletion
2012-03-28 14:18:15,432 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-4477867212286377943_214106 file /data/dfs/d
ata/current/subdir48/blk_-4477867212286377943 for deletion
2012-03-28 14:18:15,432 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-1891414201539663539_454306 file /data1/dfs/
data/current/subdir52/subdir4/subdir13/blk_-1891414201539663539 for deletion
*2012-03-28 14:18:15,432 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_-400857555653086208_125812 file /data3/dfs/d*
*ata/current/subdir41/blk_-400857555653086208 for deletion*
*2012-03-28 14:18:15,433 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block
blk_3639319147299843291_395265 file /data1/dfs/d*
*ata/current/subdir56/blk_3639319147299843291 for deletion*
2012-03-28 14:18:15,433 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Deleted block
blk_-400857555653086208_125812 at file /data3/dfs/d
ata/current/subdir41/blk_-400857555653086208
在 2012年4月11日 上午11:17，air <cn...@gmail.com>写道：
I want to decommission a data node from our cluster , when look at the data
> node page (50070) , *the node is in " Decommission In Progress " ,but
> the total blocks on the data node do not decrease* ...
>
> I then trace the datanode's log something as follows printing , there is
> no scheduler to delete blocks, but when I decommission a datanode last
> week , *that datanode's total blocks keep decreasing*..., is there
> something wrong ? or bugs ?:
>
> 2012-04-11 11:14:54,435 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6573017297751334656_168550 to /
> 192.168.85.98:50010
> 2012-04-11 11:14:55,241 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6575243939298789628_114035 to /
> 192.168.85.99:50010
> 2012-04-11 11:14:57,410 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6589031782005118375_649615 to 192.168.85.103:50010
> 2012-04-11 11:14:57,410 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6589952891904532767_468695 to 192.168.85.94:50010
> 2012-04-11 11:14:58,688 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6589952891904532767_468695 to /
> 192.168.85.94:50010
> 2012-04-11 11:14:58,752 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6589031782005118375_649615 to /
> 192.168.85.103:50010
> 2012-04-11 11:15:00,411 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6607872487411185264_383722 to 192.168.85.98:50010 192.168.85.99:50010
> 2012-04-11 11:15:00,411 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6608621128742038818_290623 to 192.168.85.99:50010
> 2012-04-11 11:15:02,245 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6608621128742038818_290623 to /
> 192.168.85.99:50010
> 2012-04-11 11:15:02,486 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020):Transmitted block blk_6607872487411185264_383722 to /
> 192.168.85.98:50010
> 2012-04-11 11:15:03,413 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6619660552568522275_159052 to 192.168.85.92:50010
> 2012-04-11 11:15:03,414 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(
> 192.168.85.104:50010,
> storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075,
> ipcPort=50020) Starting thread to transfer block
> blk_6619893588660468927_376751 to 192.168.85.93:50010 192.168.85.95:50010
>
> --
> 不学习，不知道
>
>
--
不学习，不知道
--
不学习，不知道