You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by hadoop hive <ha...@gmail.com> on 2012/01/27 12:17:41 UTC
jobtracker url(Critical)
Hey folks,
i m facing a problem, with job Tracker URL, actually i added a node to the
cluster and after sometime i restart the cluster, then i found that my job
tracker is showing recent added node in *nodes * but rest of nodes are not
available not even in *blacklist. *
*
*
can any1 have any idea why its happening.
Thanks and regards
Vikas Srivastava
Re: jobtracker url(Critical)
Posted by hadoop hive <ha...@gmail.com>.
Thanks Edward I'll do that.
On Fri, Jan 27, 2012 at 6:36 PM, Edward Capriolo <ed...@gmail.com>wrote:
> Task tracker sometimes so not clean up their mapred temp directories well
> if that is the case the tt on startup can spent many minutes deleting
> files. I use find to delete files older then a couple of days.
>
> On Friday, January 27, 2012, hadoop hive <ha...@gmail.com> wrote:
> > Hey Harsh,
> >
> > but after sumtym they are available 1 by 1 in jobtracker URL.
> >
> > any idea how they add up slowly slowly.
> >
> > regards
> > Vikas
> >
> > On Fri, Jan 27, 2012 at 5:05 PM, Harsh J <ha...@cloudera.com> wrote:
> >
> >> Vikas,
> >>
> >> Have you ensured your non-appearing tasktracker services are
> >> started/alive and carry no communication errors in their logs? Did you
> >> perhaps bring up a firewall accidentally, that was not present before?
> >>
> >> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <ha...@gmail.com>
> wrote:
> >> > Hey folks,
> >> >
> >> > i m facing a problem, with job Tracker URL, actually i added a node
> to
> >> the
> >> > cluster and after sometime i restart the cluster, then i found that
> my
> >> job
> >> > tracker is showing recent added node in *nodes * but rest of nodes
> are
> >> not
> >> > available not even in *blacklist. *
> >> > *
> >> > *
> >> > can any1 have any idea why its happening.
> >> >
> >> >
> >> > Thanks and regards
> >> > Vikas Srivastava
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> Customer Ops. Engineer, Cloudera
> >>
> >
>
Re: jobtracker url(Critical)
Posted by Edward Capriolo <ed...@gmail.com>.
Task tracker sometimes so not clean up their mapred temp directories well
if that is the case the tt on startup can spent many minutes deleting
files. I use find to delete files older then a couple of days.
On Friday, January 27, 2012, hadoop hive <ha...@gmail.com> wrote:
> Hey Harsh,
>
> but after sumtym they are available 1 by 1 in jobtracker URL.
>
> any idea how they add up slowly slowly.
>
> regards
> Vikas
>
> On Fri, Jan 27, 2012 at 5:05 PM, Harsh J <ha...@cloudera.com> wrote:
>
>> Vikas,
>>
>> Have you ensured your non-appearing tasktracker services are
>> started/alive and carry no communication errors in their logs? Did you
>> perhaps bring up a firewall accidentally, that was not present before?
>>
>> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <ha...@gmail.com>
wrote:
>> > Hey folks,
>> >
>> > i m facing a problem, with job Tracker URL, actually i added a node to
>> the
>> > cluster and after sometime i restart the cluster, then i found that my
>> job
>> > tracker is showing recent added node in *nodes * but rest of nodes are
>> not
>> > available not even in *blacklist. *
>> > *
>> > *
>> > can any1 have any idea why its happening.
>> >
>> >
>> > Thanks and regards
>> > Vikas Srivastava
>>
>>
>>
>> --
>> Harsh J
>> Customer Ops. Engineer, Cloudera
>>
>
Re: jobtracker url(Critical)
Posted by hadoop hive <ha...@gmail.com>.
Hey Harsh,
but after sumtym they are available 1 by 1 in jobtracker URL.
any idea how they add up slowly slowly.
regards
Vikas
On Fri, Jan 27, 2012 at 5:05 PM, Harsh J <ha...@cloudera.com> wrote:
> Vikas,
>
> Have you ensured your non-appearing tasktracker services are
> started/alive and carry no communication errors in their logs? Did you
> perhaps bring up a firewall accidentally, that was not present before?
>
> On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <ha...@gmail.com> wrote:
> > Hey folks,
> >
> > i m facing a problem, with job Tracker URL, actually i added a node to
> the
> > cluster and after sometime i restart the cluster, then i found that my
> job
> > tracker is showing recent added node in *nodes * but rest of nodes are
> not
> > available not even in *blacklist. *
> > *
> > *
> > can any1 have any idea why its happening.
> >
> >
> > Thanks and regards
> > Vikas Srivastava
>
>
>
> --
> Harsh J
> Customer Ops. Engineer, Cloudera
>
Re: jobtracker url(Critical)
Posted by Harsh J <ha...@cloudera.com>.
Vikas,
Have you ensured your non-appearing tasktracker services are
started/alive and carry no communication errors in their logs? Did you
perhaps bring up a firewall accidentally, that was not present before?
On Fri, Jan 27, 2012 at 4:47 PM, hadoop hive <ha...@gmail.com> wrote:
> Hey folks,
>
> i m facing a problem, with job Tracker URL, actually i added a node to the
> cluster and after sometime i restart the cluster, then i found that my job
> tracker is showing recent added node in *nodes * but rest of nodes are not
> available not even in *blacklist. *
> *
> *
> can any1 have any idea why its happening.
>
>
> Thanks and regards
> Vikas Srivastava
--
Harsh J
Customer Ops. Engineer, Cloudera