You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Rohith Sharma K S (JIRA)" <ji...@apache.org> on 2018/03/21 18:00:00 UTC
[jira] [Commented] (YARN-8048) Support auto-spawning of admin
configured services during bootstrap of rm/apiserver
[ https://issues.apache.org/jira/browse/YARN-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408335#comment-16408335 ]
Rohith Sharma K S commented on YARN-8048:
-----------------------------------------
Attached the patch with following modifications
# SystemServiceManager is a newly added class that is started at the bootstrap of RM/apiserver.
## Scan for configured common directory where files are kept under user hierarchy. Lets say, /tmp/system-service is common location then services to be launched should be kept under user directory i.e /tmp/system-service/user1/<spec-files>
## Each user can have multiple spec files which will be submitted for that particular user.
## It directly submit configured spec file without any modifications. It is admin responsibility to validate the spec file and place it in common location. Any exception, log a error and continue for other service to launch.
## Scanning of FS directories will be done in background thread so that RM switch time doesn't impacted.
## RM integrated this service only if _yarn.webapp.api-service.enable_ is set to true.
I will update on testing status once I verify in secure cluster.
[~gsaha] [~billie.rinaldi@gmail.com] [~leftnoteasy] [~sunilg] please help to review the patch.
> Support auto-spawning of admin configured services during bootstrap of rm/apiserver
> -----------------------------------------------------------------------------------
>
> Key: YARN-8048
> URL: https://issues.apache.org/jira/browse/YARN-8048
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Rohith Sharma K S
> Assignee: Rohith Sharma K S
> Priority: Major
> Attachments: YARN-8048.001.patch
>
>
> Goal is to support auto-spawning of admin configured services during bootstrap of resourcemanager/apiserver.
> *Requirement:* Some of the services might required to be consumed by yarn itself ex: Hbase for atsv2. Instead of depending on user installed HBase or sometimes user may not required to install HBase at all, in such conditions running HBase app on YARN will help for ATSv2.
> Before YARN cluster is started, admin configure these services spec and place it in common location in HDFS. At the time of RM/apiServer bootstrap, these services will be submitted.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org