You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Xuan Gong (JIRA)" <ji...@apache.org> on 2016/05/14 19:59:12 UTC
[jira] [Commented] (YARN-1151) Ability to configure auxiliary
services from HDFS-based JAR files
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283657#comment-15283657 ]
Xuan Gong commented on YARN-1151:
---------------------------------
Uploaded a new patch. We would load the auxService in such sequences:
* if we configured customized local class path
* if we configured the bootstrap class path in HDFS
* NM local class path
> Ability to configure auxiliary services from HDFS-based JAR files
> -----------------------------------------------------------------
>
> Key: YARN-1151
> URL: https://issues.apache.org/jira/browse/YARN-1151
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.1.0-beta, 2.9.0
> Reporter: john lilley
> Assignee: Xuan Gong
> Labels: auxiliary-service, yarn
> Attachments: YARN-1151.1.patch
>
>
> I would like to install an auxiliary service in Hadoop YARN without actually installing files/services on every node in the system. Discussions on the user@ list indicate that this is not easily done. The reason we want an auxiliary service is that our application has some persistent-data components that are not appropriate for HDFS. In fact, they are somewhat analogous to the mapper output of MapReduce's shuffle, which is what led me to auxiliary-services in the first place. It would be much easier if we could just place our service's JARs in HDFS.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org