You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Miguel Angel Martin junquera <mi...@gmail.com> on 2014/04/22 18:59:24 UTC
can I run sqoop export command in a Oozie shell script action ?
hi all,
I need to create a shell script action with sqoop export command but
when I try I see the error in the logs of tasktracker and The action
info status is SUCCEEDED.
-----
..
*stderr logs*
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 14 100 14 0 0 1828 0 --:--:-- --:--:-- --:--:-- 2000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 22 100 22 0 0 1343 0 --:--:-- --:--:--
--:--:-- 1375*./scriptTest.sh: line 9: sqoop: command not found*
-----
D
Is it posible?
how can I add or run or use sqoop command in a shell script action ?
Thanks in advance and regards
Re: can I run sqoop export command in a Oozie shell script action ?
Posted by Miguel Angel Martin junquera <mi...@gmail.com>.
Hi A,
I try diferents types of configurations: export environment var in the
script, in the workflow file configure with env-var, file,etc.... change
the script to load env-var or hardcode the sqoop path in the local
Filesystem (and replicating the path in hdfs) BUT I can not get to run
the shell with sqoop command.
I did that you say but the ozzie action has this error,
..
...
*stderr logs*
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 14 100 14 0 0 1715 0 --:--:-- --:--:-- --:--:-- 1750
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 22 100 22 0 0 271 0 --:--:-- --:--:-- --:--:-- 271
100 22 100 22 0 0 271 0 --:--:-- --:--:-- --:--:-- 271
./scriptTest.sh: line 9: /home/ec2-user/apache-sqoop/bin/sqoop: No
such file or directory
This is the path in the instance of ec2 where I run Oozie, hadoop
namenode/jobtracker and sqoop.
I tried to upload this file in the same path to hdfs with and without the
url of namenode in the path but I have the same error.
I not sure if this path is refered to local or hdfs Filesystem, and I am
not aware of oozie context works.
The export sqoop command run fine in the instance shell...
I appreciate any help
Many thanks.
2014-04-22 19:40 GMT+02:00 Amit Patil <ar...@skyhighnetworks.com>:
> Try giving full path to sqoop exe in your script.
>
>
> On Tue, Apr 22, 2014 at 9:59 AM, Miguel Angel Martin junquera <
> mianmarjun.mailinglist@gmail.com> wrote:
>
> > hi all,
> >
> > I need to create a shell script action with sqoop export command but
> > when I try I see the error in the logs of tasktracker and The action
> > info status is SUCCEEDED.
> >
> > -----
> >
> >
> >
> > ..
> > *stderr logs*
> >
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> >
> > 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
> > 0
> > 100 14 100 14 0 0 1828 0 --:--:-- --:--:-- --:--:--
> > 2000
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> >
> > 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
> > 0
> > 100 22 100 22 0 0 1343 0 --:--:-- --:--:--
> > --:--:-- 1375*./scriptTest.sh: line 9: sqoop: command not found*
> >
> >
> > -----
> >
> > D
> >
> > Is it posible?
> >
> > how can I add or run or use sqoop command in a shell script action ?
> >
> >
> > Thanks in advance and regards
> >
>
Re: can I run sqoop export command in a Oozie shell script action ?
Posted by Amit Patil <ar...@skyhighnetworks.com>.
Try giving full path to sqoop exe in your script.
On Tue, Apr 22, 2014 at 9:59 AM, Miguel Angel Martin junquera <
mianmarjun.mailinglist@gmail.com> wrote:
> hi all,
>
> I need to create a shell script action with sqoop export command but
> when I try I see the error in the logs of tasktracker and The action
> info status is SUCCEEDED.
>
> -----
>
>
>
> ..
> *stderr logs*
>
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
>
> 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
> 0
> 100 14 100 14 0 0 1828 0 --:--:-- --:--:-- --:--:--
> 2000
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
>
> 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:--
> 0
> 100 22 100 22 0 0 1343 0 --:--:-- --:--:--
> --:--:-- 1375*./scriptTest.sh: line 9: sqoop: command not found*
>
>
> -----
>
> D
>
> Is it posible?
>
> how can I add or run or use sqoop command in a shell script action ?
>
>
> Thanks in advance and regards
>