You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Pasquale Salza <pa...@gmail.com> on 2015/05/12 10:42:04 UTC
Execute an external command with Hadoop 2.6.0
Hi there,
I have a Hadoop 2.6.0 cluster running on CentOS, Hortonworks distribution.
I'm trying to execute an external command within a Mapper execution, but I
did't manage to invoke a script neither with Shell.ShellCommandExecutor nor
with ProcessBuilder. It is like it can't read from the host local
filesystem.
I tried with a simple:
touch /root/test.txt
because I'm executing the job with the root user. I found this output in
the logs:
Cannot run program "touch /root/test.txt"
I have a sensation there is a sort of isolation of map task in Yarn. Am I
right? Is there a way to disable it?
Thanks in advance,
Pasquale
--
Pasquale Salza
e-mail: pasquale.salza@gmail.com
phone: +39 393 4415978
fax: +39 089 8422939
skype: pasquale.salza
linkedin: http://it.linkedin.com/in/psalza/