You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Hans Uhlig (JIRA)" <ji...@apache.org> on 2014/06/26 19:05:25 UTC
[jira] [Commented] (MAPREDUCE-1743) conf.get("map.input.file")
returns null when using MultipleInputs in Hadoop 0.20
[ https://issues.apache.org/jira/browse/MAPREDUCE-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044863#comment-14044863 ]
Hans Uhlig commented on MAPREDUCE-1743:
---------------------------------------
Has this been applied upstream?
> conf.get("map.input.file") returns null when using MultipleInputs in Hadoop 0.20
> --------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1743
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1743
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.2
> Reporter: Yuanyuan Tian
> Assignee: Liyin Liang
> Attachments: mr-1743.diff
>
>
> There is a problem in getting the input file name in the mapper when uisng MultipleInputs in Hadoop 0.20. I need to use MultipleInputs to support different formats for my inputs to the my MapReduce job. And inside each mapper, I also need to know the exact input file that the mapper is processing. However, conf.get("map.input.file") returns null. Can anybody help me solve this problem? Thanks in advance.
> public class Test extends Configured implements Tool{
> static class InnerMapper extends MapReduceBase implements Mapper<Writable, Writable, NullWritable, Text>
> {
> ................
> ................
> public void configure(JobConf conf)
> {
> String inputName=conf.get("map.input.file"));
> .......................................
> }
>
> }
>
> public int run(String[] arg0) throws Exception {
> JonConf job;
> job = new JobConf(Test.class);
> ...........................................
>
> MultipleInputs.addInputPath(conf, new Path("A"), TextInputFormat.class);
> MultipleInputs.addInputPath(conf, new Path("B"), SequenceFileFormat.class);
> ...........................................
> }
> }
--
This message was sent by Atlassian JIRA
(v6.2#6252)