You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Joris Poort <gp...@gmail.com> on 2011/09/03 02:29:47 UTC

Calling external code from within mapper

Hi,

I'm using a hadoop streaming with a python mapper and am trying to
execute an external code that has been imaged onto the worker nodes.
What is the best way to accomplish this?

I've tried to use the same commands that I can run when I ssh into the
node, but unfortunately this doesn't work.  I'm assuming that its
because the external code isn't loaded into the hdfs.  Since its a
large installation and its already imaged onto the nodes - is there
any way to call the external code from within my mapper?

Thanks in advance for any help on this!

Joris