You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2009/09/23 19:04:16 UTC
[jira] Commented: (HADOOP-6280) Uniform way of setting default
param for ToolRunner (like passing -Ddfs.umask)
[ https://issues.apache.org/jira/browse/HADOOP-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758779#action_12758779 ]
Koji Noguchi commented on HADOOP-6280:
--------------------------------------
My initial thought was to simply insert
+ exec "$JAVA" $JAVA_HEAP_MAX $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS $HADOOP_TOOL_OPTS "$@"
in the hadoop script.
But this won't work when
# if $CLASS doesn't implement Tool, then command would fail
# hadoop jar case won't work.
If I have
% export HADOOP_TOOL_OPTS -Ddfs.umask=23
% hadoop jar $HADOOP_HOME/hadoop-streaming.jar -input ...
I want to have
java org.apache.hadoop.util.RunJar $HADOOP_HOME/hadoop-streaming.jar -Ddfs.umask=23 -input
and NOT
java org.apache.hadoop.util.RunJar -Ddfs.umask=23 $HADOOP_HOME/hadoop-streaming.jar -input
There must be something obvious I'm missing...
If not, can I ask the ToolRunner to read in the HADOOP_TOOL_OPTS property directly?
> Uniform way of setting default param for ToolRunner (like passing -Ddfs.umask)
> ------------------------------------------------------------------------------
>
> Key: HADOOP-6280
> URL: https://issues.apache.org/jira/browse/HADOOP-6280
> Project: Hadoop Common
> Issue Type: New Feature
> Components: util
> Reporter: Koji Noguchi
> Priority: Minor
>
> Sometimes our users want to overwrite the dfs.umask setting we have on our cluster (but continue to use the configdir we setup).
> They would need to explicitly insert
> hadoop dfs -Ddfs.umask=23 -put ...
> or
> hadoop jar myjar.jar org.MyMain -Ddfs.umask=23 ...
> for all the hadoop related calls.
> It would be nice if this can be done by setting an environment like
> export HADOOP_TOOL_OPTS=-Ddfs.umask=23
> and cover all cases.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.