You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Dhanasekaran Anbalagan <bu...@gmail.com> on 2013/01/30 17:05:05 UTC
How to find Blacklisted Nodes via cli.
Hi Guys,
How to find Blacklisted Nodes via, command line. I want to see job
Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
and also how to clear blacklisted nodes to clear start. The only option to
restart the service. some other way clear the Blacklisted Nodes.
please guide me.
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Harsh,
Thanks I understand, In HDFS Dead Nodes concept.
In MapReduce How to clear blacklisted nodes via command line. We are using
CM, we have frequently nodes will be blacklisted It's very hard to select
nodes and restart the mapreduce services via CM.
Please guide me command line option clear the blacklisted nodes restart
the task tracker on particular node
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <ha...@cloudera.com> wrote:
> There isn't a concept of 'blacklist' in HDFS, it exists only in
> MapReduce (MR1) and YARN.
>
> Dead Nodes (and those that have been excluded) are reported via "hdfs
> dfsadmin -report" as indicated earlier.
>
> On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
> <bu...@gmail.com> wrote:
> > Hi Hemanth,
> >
> > Thanks for spending your valuable time for me.
> >
> > This mapred job -list-blacklisted-trackers for find jobtracker level but
> I
> > want hdfs level I didn't find any command. [HDFS Blacklisted nodes]
> Please
> > guide me. And also to clear blacklisted nodes via command line
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> >
> > On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> > <yh...@thoughtworks.com> wrote:
> >>
> >> Hi,
> >>
> >> Part answer: you can get the blacklisted tasktrackers using the command
> >> line:
> >>
> >> mapred job -list-blacklisted-trackers.
> >>
> >> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if
> it
> >> works fine after some time. Though I am not very sure about this.
> >>
> >> Thanks
> >> hemanth
> >>
> >>
> >> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
> >> <bu...@gmail.com> wrote:
> >>>
> >>> Hi Guys,
> >>>
> >>> How to find Blacklisted Nodes via, command line. I want to see job
> >>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
> >>>
> >>> and also how to clear blacklisted nodes to clear start. The only option
> >>> to restart the service. some other way clear the Blacklisted Nodes.
> >>>
> >>> please guide me.
> >>>
> >>> -Dhanasekaran.
> >>>
> >>> Did I learn something today? If not, I wasted it.
> >>
> >>
> >
>
>
>
> --
> Harsh J
>
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Harsh,
Thanks I understand, In HDFS Dead Nodes concept.
In MapReduce How to clear blacklisted nodes via command line. We are using
CM, we have frequently nodes will be blacklisted It's very hard to select
nodes and restart the mapreduce services via CM.
Please guide me command line option clear the blacklisted nodes restart
the task tracker on particular node
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <ha...@cloudera.com> wrote:
> There isn't a concept of 'blacklist' in HDFS, it exists only in
> MapReduce (MR1) and YARN.
>
> Dead Nodes (and those that have been excluded) are reported via "hdfs
> dfsadmin -report" as indicated earlier.
>
> On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
> <bu...@gmail.com> wrote:
> > Hi Hemanth,
> >
> > Thanks for spending your valuable time for me.
> >
> > This mapred job -list-blacklisted-trackers for find jobtracker level but
> I
> > want hdfs level I didn't find any command. [HDFS Blacklisted nodes]
> Please
> > guide me. And also to clear blacklisted nodes via command line
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> >
> > On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> > <yh...@thoughtworks.com> wrote:
> >>
> >> Hi,
> >>
> >> Part answer: you can get the blacklisted tasktrackers using the command
> >> line:
> >>
> >> mapred job -list-blacklisted-trackers.
> >>
> >> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if
> it
> >> works fine after some time. Though I am not very sure about this.
> >>
> >> Thanks
> >> hemanth
> >>
> >>
> >> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
> >> <bu...@gmail.com> wrote:
> >>>
> >>> Hi Guys,
> >>>
> >>> How to find Blacklisted Nodes via, command line. I want to see job
> >>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
> >>>
> >>> and also how to clear blacklisted nodes to clear start. The only option
> >>> to restart the service. some other way clear the Blacklisted Nodes.
> >>>
> >>> please guide me.
> >>>
> >>> -Dhanasekaran.
> >>>
> >>> Did I learn something today? If not, I wasted it.
> >>
> >>
> >
>
>
>
> --
> Harsh J
>
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Harsh,
Thanks I understand, In HDFS Dead Nodes concept.
In MapReduce How to clear blacklisted nodes via command line. We are using
CM, we have frequently nodes will be blacklisted It's very hard to select
nodes and restart the mapreduce services via CM.
Please guide me command line option clear the blacklisted nodes restart
the task tracker on particular node
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <ha...@cloudera.com> wrote:
> There isn't a concept of 'blacklist' in HDFS, it exists only in
> MapReduce (MR1) and YARN.
>
> Dead Nodes (and those that have been excluded) are reported via "hdfs
> dfsadmin -report" as indicated earlier.
>
> On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
> <bu...@gmail.com> wrote:
> > Hi Hemanth,
> >
> > Thanks for spending your valuable time for me.
> >
> > This mapred job -list-blacklisted-trackers for find jobtracker level but
> I
> > want hdfs level I didn't find any command. [HDFS Blacklisted nodes]
> Please
> > guide me. And also to clear blacklisted nodes via command line
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> >
> > On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> > <yh...@thoughtworks.com> wrote:
> >>
> >> Hi,
> >>
> >> Part answer: you can get the blacklisted tasktrackers using the command
> >> line:
> >>
> >> mapred job -list-blacklisted-trackers.
> >>
> >> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if
> it
> >> works fine after some time. Though I am not very sure about this.
> >>
> >> Thanks
> >> hemanth
> >>
> >>
> >> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
> >> <bu...@gmail.com> wrote:
> >>>
> >>> Hi Guys,
> >>>
> >>> How to find Blacklisted Nodes via, command line. I want to see job
> >>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
> >>>
> >>> and also how to clear blacklisted nodes to clear start. The only option
> >>> to restart the service. some other way clear the Blacklisted Nodes.
> >>>
> >>> please guide me.
> >>>
> >>> -Dhanasekaran.
> >>>
> >>> Did I learn something today? If not, I wasted it.
> >>
> >>
> >
>
>
>
> --
> Harsh J
>
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Harsh,
Thanks I understand, In HDFS Dead Nodes concept.
In MapReduce How to clear blacklisted nodes via command line. We are using
CM, we have frequently nodes will be blacklisted It's very hard to select
nodes and restart the mapreduce services via CM.
Please guide me command line option clear the blacklisted nodes restart
the task tracker on particular node
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <ha...@cloudera.com> wrote:
> There isn't a concept of 'blacklist' in HDFS, it exists only in
> MapReduce (MR1) and YARN.
>
> Dead Nodes (and those that have been excluded) are reported via "hdfs
> dfsadmin -report" as indicated earlier.
>
> On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
> <bu...@gmail.com> wrote:
> > Hi Hemanth,
> >
> > Thanks for spending your valuable time for me.
> >
> > This mapred job -list-blacklisted-trackers for find jobtracker level but
> I
> > want hdfs level I didn't find any command. [HDFS Blacklisted nodes]
> Please
> > guide me. And also to clear blacklisted nodes via command line
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> >
> > On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> > <yh...@thoughtworks.com> wrote:
> >>
> >> Hi,
> >>
> >> Part answer: you can get the blacklisted tasktrackers using the command
> >> line:
> >>
> >> mapred job -list-blacklisted-trackers.
> >>
> >> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if
> it
> >> works fine after some time. Though I am not very sure about this.
> >>
> >> Thanks
> >> hemanth
> >>
> >>
> >> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
> >> <bu...@gmail.com> wrote:
> >>>
> >>> Hi Guys,
> >>>
> >>> How to find Blacklisted Nodes via, command line. I want to see job
> >>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
> >>>
> >>> and also how to clear blacklisted nodes to clear start. The only option
> >>> to restart the service. some other way clear the Blacklisted Nodes.
> >>>
> >>> please guide me.
> >>>
> >>> -Dhanasekaran.
> >>>
> >>> Did I learn something today? If not, I wasted it.
> >>
> >>
> >
>
>
>
> --
> Harsh J
>
Re: How to find Blacklisted Nodes via cli.
Posted by Harsh J <ha...@cloudera.com>.
There isn't a concept of 'blacklist' in HDFS, it exists only in
MapReduce (MR1) and YARN.
Dead Nodes (and those that have been excluded) are reported via "hdfs
dfsadmin -report" as indicated earlier.
On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
<bu...@gmail.com> wrote:
> Hi Hemanth,
>
> Thanks for spending your valuable time for me.
>
> This mapred job -list-blacklisted-trackers for find jobtracker level but I
> want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
> guide me. And also to clear blacklisted nodes via command line
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
>
> On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> <yh...@thoughtworks.com> wrote:
>>
>> Hi,
>>
>> Part answer: you can get the blacklisted tasktrackers using the command
>> line:
>>
>> mapred job -list-blacklisted-trackers.
>>
>> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
>> works fine after some time. Though I am not very sure about this.
>>
>> Thanks
>> hemanth
>>
>>
>> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
>> <bu...@gmail.com> wrote:
>>>
>>> Hi Guys,
>>>
>>> How to find Blacklisted Nodes via, command line. I want to see job
>>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>>
>>> and also how to clear blacklisted nodes to clear start. The only option
>>> to restart the service. some other way clear the Blacklisted Nodes.
>>>
>>> please guide me.
>>>
>>> -Dhanasekaran.
>>>
>>> Did I learn something today? If not, I wasted it.
>>
>>
>
--
Harsh J
Re: How to find Blacklisted Nodes via cli.
Posted by Harsh J <ha...@cloudera.com>.
There isn't a concept of 'blacklist' in HDFS, it exists only in
MapReduce (MR1) and YARN.
Dead Nodes (and those that have been excluded) are reported via "hdfs
dfsadmin -report" as indicated earlier.
On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
<bu...@gmail.com> wrote:
> Hi Hemanth,
>
> Thanks for spending your valuable time for me.
>
> This mapred job -list-blacklisted-trackers for find jobtracker level but I
> want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
> guide me. And also to clear blacklisted nodes via command line
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
>
> On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> <yh...@thoughtworks.com> wrote:
>>
>> Hi,
>>
>> Part answer: you can get the blacklisted tasktrackers using the command
>> line:
>>
>> mapred job -list-blacklisted-trackers.
>>
>> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
>> works fine after some time. Though I am not very sure about this.
>>
>> Thanks
>> hemanth
>>
>>
>> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
>> <bu...@gmail.com> wrote:
>>>
>>> Hi Guys,
>>>
>>> How to find Blacklisted Nodes via, command line. I want to see job
>>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>>
>>> and also how to clear blacklisted nodes to clear start. The only option
>>> to restart the service. some other way clear the Blacklisted Nodes.
>>>
>>> please guide me.
>>>
>>> -Dhanasekaran.
>>>
>>> Did I learn something today? If not, I wasted it.
>>
>>
>
--
Harsh J
Re: How to find Blacklisted Nodes via cli.
Posted by Harsh J <ha...@cloudera.com>.
There isn't a concept of 'blacklist' in HDFS, it exists only in
MapReduce (MR1) and YARN.
Dead Nodes (and those that have been excluded) are reported via "hdfs
dfsadmin -report" as indicated earlier.
On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
<bu...@gmail.com> wrote:
> Hi Hemanth,
>
> Thanks for spending your valuable time for me.
>
> This mapred job -list-blacklisted-trackers for find jobtracker level but I
> want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
> guide me. And also to clear blacklisted nodes via command line
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
>
> On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> <yh...@thoughtworks.com> wrote:
>>
>> Hi,
>>
>> Part answer: you can get the blacklisted tasktrackers using the command
>> line:
>>
>> mapred job -list-blacklisted-trackers.
>>
>> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
>> works fine after some time. Though I am not very sure about this.
>>
>> Thanks
>> hemanth
>>
>>
>> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
>> <bu...@gmail.com> wrote:
>>>
>>> Hi Guys,
>>>
>>> How to find Blacklisted Nodes via, command line. I want to see job
>>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>>
>>> and also how to clear blacklisted nodes to clear start. The only option
>>> to restart the service. some other way clear the Blacklisted Nodes.
>>>
>>> please guide me.
>>>
>>> -Dhanasekaran.
>>>
>>> Did I learn something today? If not, I wasted it.
>>
>>
>
--
Harsh J
Re: How to find Blacklisted Nodes via cli.
Posted by Harsh J <ha...@cloudera.com>.
There isn't a concept of 'blacklist' in HDFS, it exists only in
MapReduce (MR1) and YARN.
Dead Nodes (and those that have been excluded) are reported via "hdfs
dfsadmin -report" as indicated earlier.
On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
<bu...@gmail.com> wrote:
> Hi Hemanth,
>
> Thanks for spending your valuable time for me.
>
> This mapred job -list-blacklisted-trackers for find jobtracker level but I
> want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
> guide me. And also to clear blacklisted nodes via command line
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
>
> On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> <yh...@thoughtworks.com> wrote:
>>
>> Hi,
>>
>> Part answer: you can get the blacklisted tasktrackers using the command
>> line:
>>
>> mapred job -list-blacklisted-trackers.
>>
>> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
>> works fine after some time. Though I am not very sure about this.
>>
>> Thanks
>> hemanth
>>
>>
>> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
>> <bu...@gmail.com> wrote:
>>>
>>> Hi Guys,
>>>
>>> How to find Blacklisted Nodes via, command line. I want to see job
>>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>>
>>> and also how to clear blacklisted nodes to clear start. The only option
>>> to restart the service. some other way clear the Blacklisted Nodes.
>>>
>>> please guide me.
>>>
>>> -Dhanasekaran.
>>>
>>> Did I learn something today? If not, I wasted it.
>>
>>
>
--
Harsh J
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Hemanth,
Thanks for spending your valuable time for me.
This mapred job -list-blacklisted-trackers for find jobtracker level but I
want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
guide me. And also to clear blacklisted nodes via command line
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala <
yhemanth@thoughtworks.com> wrote:
> Hi,
>
> Part answer: you can get the blacklisted tasktrackers using the command
> line:
>
> mapred job -list-blacklisted-trackers.
>
> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
> works fine after some time. Though I am not very sure about this.
>
> Thanks
> hemanth
>
>
> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan <
> bugcy013@gmail.com> wrote:
>
>> Hi Guys,
>>
>> How to find Blacklisted Nodes via, command line. I want to see job
>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>
>> and also how to clear blacklisted nodes to clear start. The
>> only option to restart the service. some other way clear the Blacklisted
>> Nodes.
>>
>> please guide me.
>>
>> -Dhanasekaran.
>>
>> Did I learn something today? If not, I wasted it.
>>
>
>
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Hemanth,
Thanks for spending your valuable time for me.
This mapred job -list-blacklisted-trackers for find jobtracker level but I
want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
guide me. And also to clear blacklisted nodes via command line
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala <
yhemanth@thoughtworks.com> wrote:
> Hi,
>
> Part answer: you can get the blacklisted tasktrackers using the command
> line:
>
> mapred job -list-blacklisted-trackers.
>
> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
> works fine after some time. Though I am not very sure about this.
>
> Thanks
> hemanth
>
>
> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan <
> bugcy013@gmail.com> wrote:
>
>> Hi Guys,
>>
>> How to find Blacklisted Nodes via, command line. I want to see job
>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>
>> and also how to clear blacklisted nodes to clear start. The
>> only option to restart the service. some other way clear the Blacklisted
>> Nodes.
>>
>> please guide me.
>>
>> -Dhanasekaran.
>>
>> Did I learn something today? If not, I wasted it.
>>
>
>
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Hemanth,
Thanks for spending your valuable time for me.
This mapred job -list-blacklisted-trackers for find jobtracker level but I
want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
guide me. And also to clear blacklisted nodes via command line
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala <
yhemanth@thoughtworks.com> wrote:
> Hi,
>
> Part answer: you can get the blacklisted tasktrackers using the command
> line:
>
> mapred job -list-blacklisted-trackers.
>
> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
> works fine after some time. Though I am not very sure about this.
>
> Thanks
> hemanth
>
>
> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan <
> bugcy013@gmail.com> wrote:
>
>> Hi Guys,
>>
>> How to find Blacklisted Nodes via, command line. I want to see job
>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>
>> and also how to clear blacklisted nodes to clear start. The
>> only option to restart the service. some other way clear the Blacklisted
>> Nodes.
>>
>> please guide me.
>>
>> -Dhanasekaran.
>>
>> Did I learn something today? If not, I wasted it.
>>
>
>
Re: How to find Blacklisted Nodes via cli.
Posted by Dhanasekaran Anbalagan <bu...@gmail.com>.
Hi Hemanth,
Thanks for spending your valuable time for me.
This mapred job -list-blacklisted-trackers for find jobtracker level but I
want hdfs level I didn't find any command. [HDFS Blacklisted nodes] Please
guide me. And also to clear blacklisted nodes via command line
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala <
yhemanth@thoughtworks.com> wrote:
> Hi,
>
> Part answer: you can get the blacklisted tasktrackers using the command
> line:
>
> mapred job -list-blacklisted-trackers.
>
> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
> works fine after some time. Though I am not very sure about this.
>
> Thanks
> hemanth
>
>
> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan <
> bugcy013@gmail.com> wrote:
>
>> Hi Guys,
>>
>> How to find Blacklisted Nodes via, command line. I want to see job
>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>>
>> and also how to clear blacklisted nodes to clear start. The
>> only option to restart the service. some other way clear the Blacklisted
>> Nodes.
>>
>> please guide me.
>>
>> -Dhanasekaran.
>>
>> Did I learn something today? If not, I wasted it.
>>
>
>
Re: How to find Blacklisted Nodes via cli.
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
Part answer: you can get the blacklisted tasktrackers using the command
line:
mapred job -list-blacklisted-trackers.
Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
works fine after some time. Though I am not very sure about this.
Thanks
hemanth
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
Re: How to find Blacklisted Nodes via cli.
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
Part answer: you can get the blacklisted tasktrackers using the command
line:
mapred job -list-blacklisted-trackers.
Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
works fine after some time. Though I am not very sure about this.
Thanks
hemanth
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
Re: How to find Blacklisted Nodes via cli.
Posted by Nitin Pawar <ni...@gmail.com>.
*bin/hadoop dfsadmin -report should give you what you are looking for.*
*
*
*a node is blacklisted only if there are too many failures on a particular
node. You can clear it by restarting the particular datanode or tasktracker
service. This is for the better performance of your hadoop cluster to
remove a node where too many failures are happening so that you can figure
out the reason and then add it back in cluster. you can also exclude the
node from the cluster all together. *
*
*
*I never tried myself removing a node from blacklist on the fly so not sure
how that is done. I will wait if someone can tell me witout restart its
possible or not (without increasing the failure thresholds ) *
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
--
Nitin Pawar
Re: How to find Blacklisted Nodes via cli.
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
Part answer: you can get the blacklisted tasktrackers using the command
line:
mapred job -list-blacklisted-trackers.
Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
works fine after some time. Though I am not very sure about this.
Thanks
hemanth
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
Re: How to find Blacklisted Nodes via cli.
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
Part answer: you can get the blacklisted tasktrackers using the command
line:
mapred job -list-blacklisted-trackers.
Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if it
works fine after some time. Though I am not very sure about this.
Thanks
hemanth
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
Re: How to find Blacklisted Nodes via cli.
Posted by Nitin Pawar <ni...@gmail.com>.
*bin/hadoop dfsadmin -report should give you what you are looking for.*
*
*
*a node is blacklisted only if there are too many failures on a particular
node. You can clear it by restarting the particular datanode or tasktracker
service. This is for the better performance of your hadoop cluster to
remove a node where too many failures are happening so that you can figure
out the reason and then add it back in cluster. you can also exclude the
node from the cluster all together. *
*
*
*I never tried myself removing a node from blacklist on the fly so not sure
how that is done. I will wait if someone can tell me witout restart its
possible or not (without increasing the failure thresholds ) *
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
--
Nitin Pawar
Re: How to find Blacklisted Nodes via cli.
Posted by Nitin Pawar <ni...@gmail.com>.
*bin/hadoop dfsadmin -report should give you what you are looking for.*
*
*
*a node is blacklisted only if there are too many failures on a particular
node. You can clear it by restarting the particular datanode or tasktracker
service. This is for the better performance of your hadoop cluster to
remove a node where too many failures are happening so that you can figure
out the reason and then add it back in cluster. you can also exclude the
node from the cluster all together. *
*
*
*I never tried myself removing a node from blacklist on the fly so not sure
how that is done. I will wait if someone can tell me witout restart its
possible or not (without increasing the failure thresholds ) *
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
--
Nitin Pawar
Re: How to find Blacklisted Nodes via cli.
Posted by Nitin Pawar <ni...@gmail.com>.
*bin/hadoop dfsadmin -report should give you what you are looking for.*
*
*
*a node is blacklisted only if there are too many failures on a particular
node. You can clear it by restarting the particular datanode or tasktracker
service. This is for the better performance of your hadoop cluster to
remove a node where too many failures are happening so that you can figure
out the reason and then add it back in cluster. you can also exclude the
node from the cluster all together. *
*
*
*I never tried myself removing a node from blacklist on the fly so not sure
how that is done. I will wait if someone can tell me witout restart its
possible or not (without increasing the failure thresholds ) *
On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
<bu...@gmail.com>wrote:
> Hi Guys,
>
> How to find Blacklisted Nodes via, command line. I want to see job
> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
>
> and also how to clear blacklisted nodes to clear start. The only option to
> restart the service. some other way clear the Blacklisted Nodes.
>
> please guide me.
>
> -Dhanasekaran.
>
> Did I learn something today? If not, I wasted it.
>
--
Nitin Pawar