You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Gera Shegalov (JIRA)" <ji...@apache.org> on 2014/05/21 05:59:38 UTC
[jira] [Moved] (HADOOP-10623) Provide a utility to be able inspect
the config as seen by a hadoop client daemon
[ https://issues.apache.org/jira/browse/HADOOP-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gera Shegalov moved MAPREDUCE-5897 to HADOOP-10623:
---------------------------------------------------
Target Version/s: 2.5.0 (was: 2.5.0)
Key: HADOOP-10623 (was: MAPREDUCE-5897)
Project: Hadoop Common (was: Hadoop Map/Reduce)
> Provide a utility to be able inspect the config as seen by a hadoop client daemon
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-10623
> URL: https://issues.apache.org/jira/browse/HADOOP-10623
> Project: Hadoop Common
> Issue Type: New Feature
> Reporter: Gera Shegalov
> Assignee: Gera Shegalov
>
> To ease debugging of config issues it is convenient to be able to generate a config as seen by the job client or a hadoop daemon
> {noformat}
> ]$ hadoop org.apache.hadoop.util.ConfigTool -help
> Usage: ConfigTool [ -xml | -json ] [ -loadDefaults ] [ resource1... ]
> if resource contains '/', load from local filesystem
> otherwise, load from the classpath
> Generic options supported are
> -conf <configuration file> specify an application configuration file
> -D <property=value> use value for given property
> -fs <local|namenode:port> specify a namenode
> -jt <local|jobtracker:port> specify a job tracker
> -files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
> -libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
> -archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.
> The general command line syntax is
> bin/hadoop command [genericOptions] [commandOptions]
> {noformat}
> {noformat}
> $ hadoop org.apache.hadoop.util.ConfigTool -Dmy.test.conf=val mapred-site.xml ./hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/etc/hadoop/core-site.xml | python -mjson.tool
> {
> "properties": [
> {
> "isFinal": false,
> "key": "mapreduce.framework.name",
> "resource": "mapred-site.xml",
> "value": "yarn"
> },
> {
> "isFinal": false,
> "key": "mapreduce.client.genericoptionsparser.used",
> "resource": "programatically",
> "value": "true"
> },
> {
> "isFinal": false,
> "key": "my.test.conf",
> "resource": "from command line",
> "value": "val"
> },
> {
> "isFinal": false,
> "key": "from.file.key",
> "resource": "hadoop-dist/target/hadoop-3.0.0-SNAPSHOT/etc/hadoop/core-site.xml",
> "value": "from.file.val"
> },
> {
> "isFinal": false,
> "key": "mapreduce.shuffle.port",
> "resource": "mapred-site.xml",
> "value": "${my.mapreduce.shuffle.port}"
> }
> ]
> }
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)