Sqoop on AWS EMR

[venkatanathen kannan <ve...@yahoo.com>]

Hello all, 
Can any suggest documentation how to install Sqoop in AWS EMR for oracle, postgreSQL connectivity.
Thanks,VK

Re: Sqoop on AWS EMR

[Juan Martin Pampliega <jp...@gmail.com>]

Hi Venkatanathen,

Some instruction on how I have achieved this:

In your home download and uncompress the latest Sqoop release:
wget
http://mirrors.dcarsat.com.ar/apache/sqoop/1.4.5/sqoop-1.4.5.bin__hadoop-1.0.0.tar.gz
tar -xvzf sqoop-1.4.5.bin__hadoop-1.0.0.tar.gz

Install ant if you don't have it already:
sudo yum install -y ant

Move into the Sqoop directory and compile it with ant for hadoop 2:
cd sqoop-1.4.5.bin__hadoop-1.0.0
ant clean package -Dhadoopversion=200

Replace the old jars with the new compiled jars:
mkdir old-jars/
mv sqoop-1.4.5.jar old-jars/
mv sqoop-test-1.4.5.jar old-jars/
cp build/sqoop-1.4.5.jar .
cp build/sqoop-test-1.4.5.jar .

Optionally, you can add a symbolic link to have the sqoop directory in you
user home and replace accordingly with the new folder if you upgrade sqoop:
ln -s /home/hadoop/sqoop-1.4.5.bin__hadoop-1.0.0 /home/hadoop/sqoop

Also, if you are going to use sqoop to access data in MySQL you should add
a symbolic link for the MySQL connector jar:
ln -s /home/hadoop/hive/lib/mysql-connector-java-5.1.30.jar
/home/hadoop/sqoop-1.4.5.bin__hadoop-1.0.0/lib/mysql-connector-java.jar

Cheers,
Juan.


On Sat, Mar 28, 2015 at 10:34 PM, venkatanathen kannan <
venkatanathen@yahoo.com> wrote:

> Hello all,
>
> Can any suggest documentation how to install Sqoop in AWS EMR for oracle,
> postgreSQL connectivity.
>
> Thanks,
> VK
>