You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Rakhi Khatwani <ra...@gmail.com> on 2009/05/18 14:53:58 UTC

JobInProgress and TaskInProgress

Hi,
      how do i get the job progress n task progress information
programmaticaly at any point of time using the API's
there is a JobInProgress and TaskInProgress classes... but both of them are
private

any suggestions?

Thanks,
Raakhi

Re: JobInProgress and TaskInProgress

Posted by Amareshwari Sriramadasu <am...@yahoo-inc.com>.
You can use RunningJob handle to query map/reduce progress.
See api @ 
http://hadoop.apache.org/core/docs/r0.20.0/api/org/apache/hadoop/mapred/RunningJob.html

Thanks
Amareshwari
Jothi Padmanabhan wrote:
> Look at JobClient -- There are some useful methods there.
> For example, displayTasks and monitorAndPrintJob might provide most of the
> information that you are looking for.
>
> Jothi
>
>
> On 5/19/09 10:14 AM, "Rakhi Khatwani" <ra...@gmail.com> wrote:
>
>   
>> Hi,
>>       I am looking for the following:
>> for each task: % completed for both map n reduce, exceptions (if
>> encountered).
>> for each job: % completed, status (RUNNING,FAILED,PAUSED etc).
>> i would wanna write a program so that i can programatically access the above
>> information at any point of time.
>>
>> Thanks,
>> Raakhi
>>
>> On Mon, May 18, 2009 at 7:46 PM, Jothi Padmanabhan
>> <jo...@yahoo-inc.com>wrote:
>>
>>     
>>> Could you let us know what information are you looking to extract from
>>> these
>>> classes? You possibly could get them from other classes.
>>>
>>> Jothi
>>>
>>>
>>> On 5/18/09 6:23 PM, "Rakhi Khatwani" <ra...@gmail.com> wrote:
>>>
>>>       
>>>> Hi,
>>>>       how do i get the job progress n task progress information
>>>> programmaticaly at any point of time using the API's
>>>> there is a JobInProgress and TaskInProgress classes... but both of them
>>>>         
>>> are
>>>       
>>>> private
>>>>
>>>> any suggestions?
>>>>
>>>> Thanks,
>>>> Raakhi
>>>>         
>>>       
>
>

Re: JobInProgress and TaskInProgress

Posted by Jothi Padmanabhan <jo...@yahoo-inc.com>.
Look at JobClient -- There are some useful methods there.
For example, displayTasks and monitorAndPrintJob might provide most of the
information that you are looking for.

Jothi


On 5/19/09 10:14 AM, "Rakhi Khatwani" <ra...@gmail.com> wrote:

> Hi,
>       I am looking for the following:
> for each task: % completed for both map n reduce, exceptions (if
> encountered).
> for each job: % completed, status (RUNNING,FAILED,PAUSED etc).
> i would wanna write a program so that i can programatically access the above
> information at any point of time.
> 
> Thanks,
> Raakhi
> 
> On Mon, May 18, 2009 at 7:46 PM, Jothi Padmanabhan
> <jo...@yahoo-inc.com>wrote:
> 
>> Could you let us know what information are you looking to extract from
>> these
>> classes? You possibly could get them from other classes.
>> 
>> Jothi
>> 
>> 
>> On 5/18/09 6:23 PM, "Rakhi Khatwani" <ra...@gmail.com> wrote:
>> 
>>> Hi,
>>>       how do i get the job progress n task progress information
>>> programmaticaly at any point of time using the API's
>>> there is a JobInProgress and TaskInProgress classes... but both of them
>> are
>>> private
>>> 
>>> any suggestions?
>>> 
>>> Thanks,
>>> Raakhi
>> 
>>

Re: JobInProgress and TaskInProgress

Posted by Rakhi Khatwani <ra...@gmail.com>.
Hi,
      I am looking for the following:
for each task: % completed for both map n reduce, exceptions (if
encountered).
for each job: % completed, status (RUNNING,FAILED,PAUSED etc).
i would wanna write a program so that i can programatically access the above
information at any point of time.

Thanks,
Raakhi

On Mon, May 18, 2009 at 7:46 PM, Jothi Padmanabhan <jo...@yahoo-inc.com>wrote:

> Could you let us know what information are you looking to extract from
> these
> classes? You possibly could get them from other classes.
>
> Jothi
>
>
> On 5/18/09 6:23 PM, "Rakhi Khatwani" <ra...@gmail.com> wrote:
>
> > Hi,
> >       how do i get the job progress n task progress information
> > programmaticaly at any point of time using the API's
> > there is a JobInProgress and TaskInProgress classes... but both of them
> are
> > private
> >
> > any suggestions?
> >
> > Thanks,
> > Raakhi
>
>

Re: JobInProgress and TaskInProgress

Posted by Jothi Padmanabhan <jo...@yahoo-inc.com>.
Could you let us know what information are you looking to extract from these
classes? You possibly could get them from other classes.

Jothi


On 5/18/09 6:23 PM, "Rakhi Khatwani" <ra...@gmail.com> wrote:

> Hi,
>       how do i get the job progress n task progress information
> programmaticaly at any point of time using the API's
> there is a JobInProgress and TaskInProgress classes... but both of them are
> private
> 
> any suggestions?
> 
> Thanks,
> Raakhi