You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (Commented) (JIRA)" <ji...@apache.org> on 2011/11/11 21:22:52 UTC
[jira] [Commented] (MAPREDUCE-2863) Support web-services for RM &
NM
[ https://issues.apache.org/jira/browse/MAPREDUCE-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148712#comment-13148712 ]
Thomas Graves commented on MAPREDUCE-2863:
------------------------------------------
I updated the rest apis slightly. Here are the interfaces and will attach output formats separately in a little while. Anyone interested in these please review and comment.
Resource Manager:
http://host:8088/ws/v1/cluster/info
http://host:8088/ws/v1/cluster/nodes -> query params: state(String of RMNodeState) and healthy(boolean)
http://host:8088/ws/v1/cluster/nodes/{nodeAddress} -> nodeAddress is host:port format
http://host:8088/ws/v1/cluster/metrics
http://host:8088/ws/v1/cluster/metrics/{user}
http://host:8088/ws/v1/cluster/scheduler
http://host:8088/ws/v1/cluster/apps/{appid}
http://host:8088/ws/v1/cluster/apps -> query params: state(String of RMAppState), user(String), queue(String), limit(int of number to return), startTimeBegin(ms since epoch), startTimeEnd(ms since epoch), finishTimeBegin(ms since epoch), finishTimeEnd(ms since epoch)
Node Manager:
http://host:9999/ws/v1/nodes/info
http://host:9999/ws/v1/nodes/apps -> query params: state(String of ApplicationState), user(String)
http://host:9999/ws/v1/nodes/apps/{appid}
http://host:9999/ws/v1/nodes/containers
http://host:9999/ws/v1/nodes/containers/{containerid}
mapreduce Application Master - these go through the proxy just like web ui
http://host:8088/proxy/{appid}/ws/v1/mapreduce/info
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/counters
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/counters/{group}/{counterName}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/counters
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/counters/{group}/{counterName}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/conf
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks -> query params: type(m or r)
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts
http://host:8088/proxy/{appid}/ws/v1/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}
History Server:
http://host:19888/ws/v1/history/info
http://host:19888/ws/v1/history/mapreduce/jobs -> query params: user(String), limit(int of # to return), startTimeBegin(ms since epoch), startTimeEnd(ms since epoch), finishTimeBegin(ms since epoch), finishTimeEnd(ms since epoch), queue(String)
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/counters
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/counters/{group}/{counterName}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/counters
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/counters/{group}/{counterName}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/conf
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks -> query params: type(m or r)
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts
http://host:19888/ws/v1/history/mapreduce/jobs/{jobid}/tasks/{taskid}/attempts/{attemptid}
For reference:
public enum ApplicationState {
NEW, INITING, RUNNING, FINISHING_CONTAINERS_WAIT, APPLICATION_RESOURCES_CLEANINGUP, FINISHED
}
public enum RMNodeState {
RUNNING, UNHEALTHY, DECOMMISSIONED, LOST
}
public enum RMAppState {
NEW, SUBMITTED, ACCEPTED, RUNNING, FINISHED, FAILED, KILLED
}
> Support web-services for RM & NM
> --------------------------------
>
> Key: MAPREDUCE-2863
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2863
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, nodemanager, resourcemanager
> Reporter: Arun C Murthy
> Assignee: Thomas Graves
> Attachments: MAPREDUCE-2863.patch
>
>
> It will be very useful for RM and NM to support web-services to export json/xml.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira