You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by gw...@orange.com on 2014/04/22 10:24:03 UTC

Oozie cannot execute shell

Hello !

I currently have a problem with Oozie.

I have an hadoop cluster (Horton Works distribution) on a CentOs operating system, with 2 master nodes with namenodes, 1 edge node with oozie server, hive server etc... and 4 data nodes.
The coordinator is able to launch the workflow without any problem, but as soon as a shell script needs to be launched, even a very small script like the one below, I have an error message and the job fails :

#################
#!/bin/bash
echo "hello world"
#################

Here is the error message :
2014-04-18 19:00:05,047  WARN ShellActionExecutor:542 - USER[applicative_user] GROUP[-] TOKEN[] APP[myWorkflow] JOB[0000015-140418185613138-oozie-oozi-W] ACTION[0000015-140418185613138-oozie-oozi-W@dispatchAction] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "myShell.sh" (in directory "/var/opt/data/flat/data012/hadoop/yarn/local/usercache/applicative_user/appcache/application_1397725822170_4730/container_1397725822170_4730_01_000001"): error=13, Permission denied

Here is the version of Oozie client that I have :
Oozie client build version: 4.0.0.2.0.6.0-102

And here is the version of the Oozie server :
4.0.0.2.0.6.0

Solution I already tried :

1.     Check the rights in each of my data nodes in /var/opt/data/flat/data*, everything is normal with 755 permissions

2.     Try to launch only a small script I wrote on the Linux filesystem and put by myself on the HDFS, and, as described above, I got the same error "Permission denied".

I'm currently running an HDP 2.0 secured by Kerberos.

I was wondering if someone had any advice to "where to look", "where to investigate".
I already check the logs in /var/log/oozie/ and except this error I cannot see anything else.

Where can I investigate ?

Best regards.

[cid:image001.gif@01CF5E12.BD77EFD0]<http://www.orange.com/>

Gwenael Le Barzic
Expert technique Plateforme du Centre de Compétence Web-Analytics
FT/OF/DSI FRANCE/DSI RCGP/DS BI/CC BI
tél. 01 55 88 60 91
mob. 06 48 70 85 75
gwenael.lebarzic@orange.com<ma...@orange.com>
Mon adresse email a changé. Avez-vous pensé à réactualiser votre carnet d'adresses ?
My mail adress has changed. Please update your adress book.

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.