You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2009/09/23 18:50:16 UTC
[jira] Created: (HADOOP-6280) Uniform way of setting default param
for ToolRunner (like passing -Ddfs.umask)
Uniform way of setting default param for ToolRunner (like passing -Ddfs.umask)
------------------------------------------------------------------------------
Key: HADOOP-6280
URL: https://issues.apache.org/jira/browse/HADOOP-6280
Project: Hadoop Common
Issue Type: New Feature
Components: util
Reporter: Koji Noguchi
Priority: Minor
Sometimes our users want to overwrite the dfs.umask setting we have on our cluster (but continue to use the configdir we setup).
They would need to explicitly insert
hadoop dfs -Ddfs.umask=23 -put ...
or
hadoop jar myjar.jar org.MyMain -Ddfs.umask=23 ...
for all the hadoop related calls.
It would be nice if this can be done by setting an environment like
export HADOOP_TOOL_OPTS=-Ddfs.umask=23
and cover all cases.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6280) Uniform way of setting default
param for ToolRunner (like passing -Ddfs.umask)
Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758779#action_12758779 ]
Koji Noguchi commented on HADOOP-6280:
--------------------------------------
My initial thought was to simply insert
+ exec "$JAVA" $JAVA_HEAP_MAX $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS $HADOOP_TOOL_OPTS "$@"
in the hadoop script.
But this won't work when
# if $CLASS doesn't implement Tool, then command would fail
# hadoop jar case won't work.
If I have
% export HADOOP_TOOL_OPTS -Ddfs.umask=23
% hadoop jar $HADOOP_HOME/hadoop-streaming.jar -input ...
I want to have
java org.apache.hadoop.util.RunJar $HADOOP_HOME/hadoop-streaming.jar -Ddfs.umask=23 -input
and NOT
java org.apache.hadoop.util.RunJar -Ddfs.umask=23 $HADOOP_HOME/hadoop-streaming.jar -input
There must be something obvious I'm missing...
If not, can I ask the ToolRunner to read in the HADOOP_TOOL_OPTS property directly?
> Uniform way of setting default param for ToolRunner (like passing -Ddfs.umask)
> ------------------------------------------------------------------------------
>
> Key: HADOOP-6280
> URL: https://issues.apache.org/jira/browse/HADOOP-6280
> Project: Hadoop Common
> Issue Type: New Feature
> Components: util
> Reporter: Koji Noguchi
> Priority: Minor
>
> Sometimes our users want to overwrite the dfs.umask setting we have on our cluster (but continue to use the configdir we setup).
> They would need to explicitly insert
> hadoop dfs -Ddfs.umask=23 -put ...
> or
> hadoop jar myjar.jar org.MyMain -Ddfs.umask=23 ...
> for all the hadoop related calls.
> It would be nice if this can be done by setting an environment like
> export HADOOP_TOOL_OPTS=-Ddfs.umask=23
> and cover all cases.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.