You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Francesco De Luca <f....@gmail.com> on 2011/04/17 12:18:02 UTC
Observation of MapReduce Task execution
Exists any notification mechanism to be notified of all task state changes
(task failure,task completion ecc)?
In particular i need to follow all the map and reduce task execution.
Re: Observation of MapReduce Task execution
Posted by Francesco De Luca <f....@gmail.com>.
Sorry :-) ... i make a mistake in my question.
The question is how can i use TaskTracker
2011/4/17 Francesco De Luca <f....@gmail.com>
> Apologize... i should use TaskTracker to be notified ??
>
>
> 2011/4/17 Harsh J <ha...@cloudera.com>
>
>> Its available in the API as well:
>>
>> http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/TaskCompletionEvent.html#getTaskTrackerHttp()
>>
>> On Sun, Apr 17, 2011 at 7:20 PM, Francesco De Luca <f....@gmail.com>
>> wrote:
>> > Thank you Harsh.
>> > And there is a way to know on which node a task is submitted?
>> >
>> > 2011/4/17 Harsh J <ha...@cloudera.com>
>> >>
>> >> Hello,
>> >>
>> >> On Sun, Apr 17, 2011 at 3:48 PM, Francesco De Luca <
>> f.deluca86@gmail.com>
>> >> wrote:
>> >> >
>> >> > Exists any notification mechanism to be notified of all task state
>> >> > changes
>> >> > (task failure,task completion ecc)?
>> >> >
>> >> > In particular i need to follow all the map and reduce task execution.
>> >>
>> >> You can loop over and request the TaskCompletionEvents from your
>> >> RunningJob instance:
>> >>
>> >>
>> http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)
>> >>
>> >> --
>> >> Harsh J
>> >
>> >
>>
>>
>>
>> --
>> Harsh J
>>
>
>
Re: Observation of MapReduce Task execution
Posted by Francesco De Luca <f....@gmail.com>.
Apologize... i should use TaskTracker ??
2011/4/17 Harsh J <ha...@cloudera.com>
> Its available in the API as well:
>
> http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/TaskCompletionEvent.html#getTaskTrackerHttp()
>
> On Sun, Apr 17, 2011 at 7:20 PM, Francesco De Luca <f....@gmail.com>
> wrote:
> > Thank you Harsh.
> > And there is a way to know on which node a task is submitted?
> >
> > 2011/4/17 Harsh J <ha...@cloudera.com>
> >>
> >> Hello,
> >>
> >> On Sun, Apr 17, 2011 at 3:48 PM, Francesco De Luca <
> f.deluca86@gmail.com>
> >> wrote:
> >> >
> >> > Exists any notification mechanism to be notified of all task state
> >> > changes
> >> > (task failure,task completion ecc)?
> >> >
> >> > In particular i need to follow all the map and reduce task execution.
> >>
> >> You can loop over and request the TaskCompletionEvents from your
> >> RunningJob instance:
> >>
> >>
> http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)
> >>
> >> --
> >> Harsh J
> >
> >
>
>
>
> --
> Harsh J
>
Re: Observation of MapReduce Task execution
Posted by Harsh J <ha...@cloudera.com>.
Its available in the API as well:
http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/TaskCompletionEvent.html#getTaskTrackerHttp()
On Sun, Apr 17, 2011 at 7:20 PM, Francesco De Luca <f....@gmail.com> wrote:
> Thank you Harsh.
> And there is a way to know on which node a task is submitted?
>
> 2011/4/17 Harsh J <ha...@cloudera.com>
>>
>> Hello,
>>
>> On Sun, Apr 17, 2011 at 3:48 PM, Francesco De Luca <f....@gmail.com>
>> wrote:
>> >
>> > Exists any notification mechanism to be notified of all task state
>> > changes
>> > (task failure,task completion ecc)?
>> >
>> > In particular i need to follow all the map and reduce task execution.
>>
>> You can loop over and request the TaskCompletionEvents from your
>> RunningJob instance:
>>
>> http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)
>>
>> --
>> Harsh J
>
>
--
Harsh J
Re: Observation of MapReduce Task execution
Posted by Francesco De Luca <f....@gmail.com>.
Thank you Harsh.
And there is a way to know on which node a task is submitted?
2011/4/17 Harsh J <ha...@cloudera.com>
> Hello,
>
> On Sun, Apr 17, 2011 at 3:48 PM, Francesco De Luca <f....@gmail.com>
> wrote:
> >
> > Exists any notification mechanism to be notified of all task state
> changes
> > (task failure,task completion ecc)?
> >
> > In particular i need to follow all the map and reduce task execution.
>
> You can loop over and request the TaskCompletionEvents from your
> RunningJob instance:
>
> http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)
>
> --
> Harsh J
>
Re: Observation of MapReduce Task execution
Posted by Harsh J <ha...@cloudera.com>.
Hello,
On Sun, Apr 17, 2011 at 3:48 PM, Francesco De Luca <f....@gmail.com> wrote:
>
> Exists any notification mechanism to be notified of all task state changes
> (task failure,task completion ecc)?
>
> In particular i need to follow all the map and reduce task execution.
You can loop over and request the TaskCompletionEvents from your
RunningJob instance:
http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/RunningJob.html#getTaskCompletionEvents(int)
--
Harsh J