You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by forbbs forbbs <bb...@gmail.com> on 2008/12/23 09:33:41 UTC

how to pass an object to mapper

It seems that JobConf doesn't help. Do I have to write the object into DFS?

Re: how to pass an object to mapper

Posted by Enis Soztutar <en...@gmail.com>.

There are several ways you can pass static information to tasks in 
Hadoop. The first is to store it in conf via DefaultStringifier, which 
needs the object to be serialized either through Writable or 
Serializable interfaces. Second way would be to save/serialize the data 
to a file and send it via DistributedCache. Another way would be to save 
the file in the jar, and read from there.

forbbs forbbs wrote:
> It seems that JobConf doesn't help. Do I have to write the object into DFS?
>
>