You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Cheng Pan (Jira)" <ji...@apache.org> on 2026/03/09 14:19:00 UTC
[jira] [Updated] (HADOOP-19835) Make MapReduce Application Master class configurable in YARNRunner
[ https://issues.apache.org/jira/browse/HADOOP-19835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheng Pan updated HADOOP-19835:
-------------------------------
Fix Version/s: (was: 3.4.4)
> Make MapReduce Application Master class configurable in YARNRunner
> ------------------------------------------------------------------
>
> Key: HADOOP-19835
> URL: https://issues.apache.org/jira/browse/HADOOP-19835
> Project: Hadoop Common
> Issue Type: Bug
> Components: mapreduce
> Affects Versions: 3.4.3
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Priority: Minor
> Labels: patch, pull-request-available
>
> YARNRunner currently always uses {{MRJobConfig.APPLICATION_MASTER_CLASS}} when building the command to start the Application Master, and does not read {{{}yarn.app.mapreduce.am{}}}. As a result, custom AM classes (e.g. Celeborn’s {{{}MRAppMasterWithCeleborn{}}}) are never used when submitting jobs via the standard job client.
> This patch changes YARNRunner to take the AM class from configuration: it uses {{jobConf.get("yarn.app.mapreduce.am", MRJobConfig.APPLICATION_MASTER_CLASS)}} and passes that value into the launch arguments. If {{yarn.app.mapreduce.am}} is set, that class is used; otherwise behavior is unchanged (default AM class). This allows remote shuffle and other custom AMs to be used without forking the job client.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org