[jira] [Commented] (YARN-2460) Remove obsolete entries from yarn-default.xml

["Jason Lowe (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-2460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113748#comment-14113748 ] 

Jason Lowe commented on YARN-2460:
----------------------------------

Same cautions here as I mentioned in MAPREDUCE-6057.  Please do not remove any properties that are referenced by the code, even if they aren't referenced by YarnConfiguration.

I'm surprised to see mapreduce.job.* properties here rather than mapred-default.xml, and that seems like a mistake.  The yarn.nodemanager.aux-services.mapreduce_shuffle.class is necessary to avoid having users specify the handler for the mapreduce_shuffle aux service, but we still make them explicitly configure yarn.nodemanager.aux-services to have mapreduce_shuffle if they want to run MapReduce jobs.

yarn.nodemanage.hostname is referenced by other yarn-default.xml entries.

yarn.nodemanager.resourcemanager.connect.* should be renamed to yarn.resourcemanager.connect.*.  This appears to have been overlooked when YARN-1056 was fixed.

> Remove obsolete entries from yarn-default.xml
> ---------------------------------------------
>
>                 Key: YARN-2460
>                 URL: https://issues.apache.org/jira/browse/YARN-2460
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.5.0
>            Reporter: Ray Chiang
>            Priority: Minor
>              Labels: newbie
>
> The following properties are defined in yarn-default.xml, but do not exist in YarnConfiguration.
>   mapreduce.job.hdfs-servers
>   mapreduce.job.jar
>   yarn.ipc.exception.factory.class
>   yarn.ipc.serializer.type
>   yarn.nodemanager.aux-services.mapreduce_shuffle.class
>   yarn.nodemanager.hostname
>   yarn.nodemanager.resourcemanager.connect.retry_interval.secs
>   yarn.nodemanager.resourcemanager.connect.wait.secs
>   yarn.resourcemanager.amliveliness-monitor.interval-ms
>   yarn.resourcemanager.application-tokens.master-key-rolling-interval-secs
>   yarn.resourcemanager.container.liveness-monitor.interval-ms
>   yarn.resourcemanager.nm.liveness-monitor.interval-ms
>   yarn.timeline-service.hostname
>   yarn.timeline-service.http-authentication.simple.anonymous.allowed
>   yarn.timeline-service.http-authentication.type
> Presumably, the mapreduce.* properties are okay.  Similarly, the yarn.timeline-service.* properties are for the future TimelineService.  However, the rest are likely fully deprecated.
> Submitting bug for comment/feedback about which other properties should be kept in yarn-default.xml.



--
This message was sent by Atlassian JIRA
(v6.2#6252)