You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Andrey Gladyshev (JIRA)" <ji...@apache.org> on 2008/09/21 02:09:46 UTC
[jira] Created: (HADOOP-4233) Streaming scripts need more
information
Streaming scripts need more information
---------------------------------------
Key: HADOOP-4233
URL: https://issues.apache.org/jira/browse/HADOOP-4233
Project: Hadoop Core
Issue Type: Improvement
Components: contrib/streaming
Reporter: Andrey Gladyshev
Streaming scripts are lack of useful information.
For example we need job.get("map.input.file")) in script.
Information can be provide by environment variable.
It's easy to implement by adding in PipeMapRed.configure() something like:
// add HADOOP_INPUTFILE environment variable with the value of input filename
envPut(childEnv, "HADOOP_INPUTFILE", job_.get("map.input.file"));
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-4233) Streaming scripts need more
information
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley resolved HADOOP-4233.
---------------------------------
Resolution: Duplicate
Resolving issue with the correct resolution type.
> Streaming scripts need more information
> ---------------------------------------
>
> Key: HADOOP-4233
> URL: https://issues.apache.org/jira/browse/HADOOP-4233
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/streaming
> Reporter: Andrey Gladyshev
>
> Streaming scripts are lack of useful information.
> For example we need job.get("map.input.file")) in script.
> Information can be provide by environment variable.
> It's easy to implement by adding in PipeMapRed.configure() something like:
> // add HADOOP_INPUTFILE environment variable with the value of input filename
> envPut(childEnv, "HADOOP_INPUTFILE", job_.get("map.input.file"));
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-4233) Streaming scripts need more
information
Posted by "Andrey Gladyshev (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrey Gladyshev resolved HADOOP-4233.
--------------------------------------
Resolution: Fixed
Release Note: It's implemented already
> Streaming scripts need more information
> ---------------------------------------
>
> Key: HADOOP-4233
> URL: https://issues.apache.org/jira/browse/HADOOP-4233
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/streaming
> Reporter: Andrey Gladyshev
>
> Streaming scripts are lack of useful information.
> For example we need job.get("map.input.file")) in script.
> Information can be provide by environment variable.
> It's easy to implement by adding in PipeMapRed.configure() something like:
> // add HADOOP_INPUTFILE environment variable with the value of input filename
> envPut(childEnv, "HADOOP_INPUTFILE", job_.get("map.input.file"));
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4233) Streaming scripts need more
information
Posted by "Andrey Gladyshev (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12633090#action_12633090 ]
Andrey Gladyshev commented on HADOOP-4233:
------------------------------------------
You are right.
Thank you very much.
> Streaming scripts need more information
> ---------------------------------------
>
> Key: HADOOP-4233
> URL: https://issues.apache.org/jira/browse/HADOOP-4233
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/streaming
> Reporter: Andrey Gladyshev
>
> Streaming scripts are lack of useful information.
> For example we need job.get("map.input.file")) in script.
> Information can be provide by environment variable.
> It's easy to implement by adding in PipeMapRed.configure() something like:
> // add HADOOP_INPUTFILE environment variable with the value of input filename
> envPut(childEnv, "HADOOP_INPUTFILE", job_.get("map.input.file"));
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4233) Streaming scripts need more
information
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12633034#action_12633034 ]
Arun C Murthy commented on HADOOP-4233:
---------------------------------------
I believe all parameters in JobConf are converted to env. variables already:
map.input.file == env['map_input_file']
In general dots are converted to underscores... could you please check?
> Streaming scripts need more information
> ---------------------------------------
>
> Key: HADOOP-4233
> URL: https://issues.apache.org/jira/browse/HADOOP-4233
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/streaming
> Reporter: Andrey Gladyshev
>
> Streaming scripts are lack of useful information.
> For example we need job.get("map.input.file")) in script.
> Information can be provide by environment variable.
> It's easy to implement by adding in PipeMapRed.configure() something like:
> // add HADOOP_INPUTFILE environment variable with the value of input filename
> envPut(childEnv, "HADOOP_INPUTFILE", job_.get("map.input.file"));
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.