You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bruno Mahé (Updated JIRA)" <ji...@apache.org> on 2011/12/03 01:01:40 UTC
[jira] [Updated] (MAPREDUCE-3505) yarn APPLICATION_CLASSPATH needs
to be overridable
[ https://issues.apache.org/jira/browse/MAPREDUCE-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bruno Mahé updated MAPREDUCE-3505:
----------------------------------
Description:
Right now MRApps sets the classpath to just being mrapp-generated-classpath, its content and a hardcoded list of directories.
If I understand correctly mrapp-generated-classpath is only there for testing and may change or disappear at any time
The list of hardcoded directories is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java at line 92.
For convenience, here is its current content:
{noformat}
/**
* Classpath for typical applications.
*/
public static final String[] APPLICATION_CLASSPATH =
new String[] {
"$HADOOP_CONF_DIR",
"$HADOOP_COMMON_HOME/share/hadoop/common/*",
"$HADOOP_COMMON_HOME/share/hadoop/common/lib/*",
"$HADOOP_HDFS_HOME/share/hadoop/hdfs/*",
"$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*",
"$YARN_HOME/modules/*",
"$YARN_HOME/lib/*"
};
{noformat}
Not all deployment scenarii fit in this layout and therefore we need a standardized way to customize this class path.
was:
Right now MRApps sets the classpath to just being mrapp-generated-classpath, its content and a hardcoded list of directories.
If I understand correctly mrapp-generated-classpath is only there for testing and may change or disappear at any time
The list of hardcoded directories is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java at line 92.
For convenience, here is its current content:
{quote}
/**
* Classpath for typical applications.
*/
public static final String[] APPLICATION_CLASSPATH =
new String[] {
"$HADOOP_CONF_DIR",
"$HADOOP_COMMON_HOME/share/hadoop/common/*",
"$HADOOP_COMMON_HOME/share/hadoop/common/lib/*",
"$HADOOP_HDFS_HOME/share/hadoop/hdfs/*",
"$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*",
"$YARN_HOME/modules/*",
"$YARN_HOME/lib/*"
};
{quote}
Not all deployment scenarii fit in this layout and therefore we need a standardized way to customize this class path.
> yarn APPLICATION_CLASSPATH needs to be overridable
> --------------------------------------------------
>
> Key: MAPREDUCE-3505
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3505
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.23.1
> Reporter: Bruno Mahé
> Labels: bigtop
>
> Right now MRApps sets the classpath to just being mrapp-generated-classpath, its content and a hardcoded list of directories.
> If I understand correctly mrapp-generated-classpath is only there for testing and may change or disappear at any time
> The list of hardcoded directories is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java at line 92.
> For convenience, here is its current content:
> {noformat}
> /**
> * Classpath for typical applications.
> */
> public static final String[] APPLICATION_CLASSPATH =
> new String[] {
> "$HADOOP_CONF_DIR",
> "$HADOOP_COMMON_HOME/share/hadoop/common/*",
> "$HADOOP_COMMON_HOME/share/hadoop/common/lib/*",
> "$HADOOP_HDFS_HOME/share/hadoop/hdfs/*",
> "$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*",
> "$YARN_HOME/modules/*",
> "$YARN_HOME/lib/*"
> };
> {noformat}
> Not all deployment scenarii fit in this layout and therefore we need a standardized way to customize this class path.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira