You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Pallavi P <pa...@gmail.com> on 2007/07/16 15:07:47 UTC
[URGENT] Help with using extra information while processing input data using map technique
Hi All,
I am new to hadoop and learning how to use it. I have a problem which can
be solvable using map-reduce technique. But, in my map step, I need to
consider some extra information which depends on the input key,value pair.
Can some one please help me what is the good way of taking this data? I am
thinking of storing it in some HDFS and map code try to load it whenever it
is processing a particular key, value pair. any other better approaches,
please let me know.
Thanks & Regards
Pallavi
RE: [URGENT] Help with using extra information while processing input data using map technique
Posted by Hairong Kuang <ha...@yahoo-inc.com>.
MapReducerBase has a method configure(JobConf jobconf). You might use the
method to initialize the extra information that your map needs.
Hairong
-----Original Message-----
From: Pallavi P [mailto:pallavi.p@gmail.com]
Sent: Monday, July 16, 2007 6:08 AM
To: hadoop-user@lucene.apache.org
Subject: [URGENT] Help with using extra information while processing input
data using map technique
Hi All,
I am new to hadoop and learning how to use it. I have a problem which can
be solvable using map-reduce technique. But, in my map step, I need to
consider some extra information which depends on the input key,value pair.
Can some one please help me what is the good way of taking this data? I am
thinking of storing it in some HDFS and map code try to load it whenever it
is processing a particular key, value pair. any other better approaches,
please let me know.
Thanks & Regards
Pallavi