[jira] [Updated] (MAPREDUCE-7127) Add aggregated webservice endpoint to fetch all tasks including their attempts

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated MAPREDUCE-7127:
--------------------------------------
    Labels: pull-request-available webservices  (was: webservices)

> Add aggregated webservice endpoint to fetch all tasks including their attempts
> ------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-7127
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7127
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Brandon Scheller
>            Priority: Major
>              Labels: pull-request-available, webservices
>
> We have a usecase where we would like to poll Hadoop for various running Tasks and display info on each individual task attempt to the user.
> On large clusters with many tasks, this is an issue because using the current webservice APIs we would have to make many repeat calls to the same task attempts endpoints.
> To improve performance, we have added additional endpoints to HS and AM webservices that will fetch aggregated data on hadoop tasks including their task attempts for a job.
> This would look like
> - taskDescriptions webservice endpoint to AMWebServices
>  @Path("/jobs/ \{jobid}/taskDescriptions") 
>  
>  - describeTasks webservice endpoint to HSWebServices 
>  @Path("/mapreduce/jobs/\{jobid}/describeTasks")
> It would be similar to the current getJobTasks() in HS and AM webservices except it would include each of the task attempts for each task.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org