You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Henry Hung <YT...@winbond.com> on 2014/11/25 03:35:17 UTC
how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don't want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Henry Hung <YT...@winbond.com>.
Thank you for the information.
Another thing, if I set the expire time to 1 hour, will it have bad impact to cluster when I shutdown 1 of the data node?
From: Brahma Reddy Battula [mailto:brahmareddy.battula@huawei.com]
Sent: Tuesday, November 25, 2014 12:40 PM
To: user@hadoop.apache.org
Subject: RE: how to increate data node expire time
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don't want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Henry Hung <YT...@winbond.com>.
Thank you for the information.
Another thing, if I set the expire time to 1 hour, will it have bad impact to cluster when I shutdown 1 of the data node?
From: Brahma Reddy Battula [mailto:brahmareddy.battula@huawei.com]
Sent: Tuesday, November 25, 2014 12:40 PM
To: user@hadoop.apache.org
Subject: RE: how to increate data node expire time
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don't want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Henry Hung <YT...@winbond.com>.
Thank you for the information.
Another thing, if I set the expire time to 1 hour, will it have bad impact to cluster when I shutdown 1 of the data node?
From: Brahma Reddy Battula [mailto:brahmareddy.battula@huawei.com]
Sent: Tuesday, November 25, 2014 12:40 PM
To: user@hadoop.apache.org
Subject: RE: how to increate data node expire time
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don't want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Henry Hung <YT...@winbond.com>.
Thank you for the information.
Another thing, if I set the expire time to 1 hour, will it have bad impact to cluster when I shutdown 1 of the data node?
From: Brahma Reddy Battula [mailto:brahmareddy.battula@huawei.com]
Sent: Tuesday, November 25, 2014 12:40 PM
To: user@hadoop.apache.org
Subject: RE: how to increate data node expire time
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don't want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Brahma Reddy Battula <br...@huawei.com>.
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don’t want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Brahma Reddy Battula <br...@huawei.com>.
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don’t want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Brahma Reddy Battula <br...@huawei.com>.
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don’t want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
RE: how to increate data node expire time
Posted by Brahma Reddy Battula <br...@huawei.com>.
Hi Henry
The NameNode updates this detail after 10.30 minutes by default. You can see the dead and live datanodes at that time.
It computes this heartbeatExpireInterval time by the following formula
heartbeatExpireInterval = 2 * heartbeatRecheckInterval +
10 * 1000* heartbeatInterval
where heartbeatRecheckInterval is defined by the configuration dfs.namenode.heartbeat.recheck-interval which is 5 minutes by default and heartbeatInterval by dfs.heartbeat.interval which is 3 seconds by default.
Hence
heartbeatExpireInterval = 10.30 minutes
SO If you want keep more time, you can configure dfs.namenode.heartbeat.recheck-interval based one your requirement..
Thanks & Regards
Brahma Reddy Battula
________________________________
From: Henry Hung [YTHung1@winbond.com]
Sent: Tuesday, November 25, 2014 8:05 AM
To: user@hadoop.apache.org
Subject: how to increate data node expire time
Hi All,
In Hadoop 2.2.0, how to increase the data node expire time before name node list it as a dead node?
I want to shut down a data node for 30 minutes, and I don’t want the name node to list it as dead node to prevent the re-replication process.
Best regards,
Henry
________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.