You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Nauman Zahid <na...@gmail.com> on 2014/05/01 19:22:35 UTC

Sqoop Import Using Java Code

Hello!
I am using the following code to try to import data from mysql database to
Hbase:
SqoopOptions options = new SqoopOptions();
        options.setConnectString("jdbc:mysql://localhost:3306/testDb");
        options.setTableName("student");
        //options.setWhereClause("id>10");     // this where clause works
when importing whole table, ie when setTableName() is used
        options.setUsername("root");
        options.setPassword("");
        //options.setDirectMode(true);    // Make sure the direct mode is
off when importing data to HBase
        options.setNumMappers(8);         // Default value is 4


        // HBase options
        options.setHBaseTable("HBASE_student");
        options.setHBaseColFamily("colFamily");
        options.setCreateHBaseTable(true);    // Create HBase table, if it
does not exist
        options.setHBaseRowKeyColumn("stdId");

        @SuppressWarnings({ "unused" })
        int ret = new ImportTool().run(options);

Could you please tell me which jars (plz be specific with the versions) I
have to include in my class path. I have tried a number of combination but
in the end I end up in a conflict.

Regards.

Re: Sqoop Import Using Java Code

Posted by Jarek Jarcec Cecho <ja...@apache.org>.
Hi Nauman,
Sqoop 1 do not have supported Java API and hence there might be a lot of troubles on the way that you will have to sort out. We've addressed this in Sqoop 2 where we have first class client API [1].

Having said that, you can get execute Sqoop and get it's classpath to see what all jars you will need.

Jarcec

Links:
1: http://sqoop.apache.org/docs/1.99.3/ClientAPI.html

On Fri, May 02, 2014 at 03:01:51PM +0000, Ajay Chitre -X (achitre - PERSISTENT SYSTEMS INC at Cisco) wrote:
> If you're using Maven use a dependency such as this:
> 
> <dependency>
> 	<groupId>org.apache.sqoop</groupId>
> 	<artifactId>sqoop</artifactId>
> 	<version>1.4.4</version>
> </dependency>
>             
> 
> If you're not using Maven, consider using it.  It will help you tremendously in the long run.  Hope this helps.  Thanks.
> 
> 
> -----Original Message-----
> From: Nauman Zahid [mailto:nauman.goldsmith@gmail.com] 
> Sent: Thursday, May 01, 2014 10:23 AM
> To: dev@sqoop.apache.org
> Cc: shuja@pucit.edu.pk
> Subject: Sqoop Import Using Java Code
> 
> Hello!
> I am using the following code to try to import data from mysql database to
> Hbase:
> SqoopOptions options = new SqoopOptions();
>         options.setConnectString("jdbc:mysql://localhost:3306/testDb");
>         options.setTableName("student");
>         //options.setWhereClause("id>10");     // this where clause works
> when importing whole table, ie when setTableName() is used
>         options.setUsername("root");
>         options.setPassword("");
>         //options.setDirectMode(true);    // Make sure the direct mode is
> off when importing data to HBase
>         options.setNumMappers(8);         // Default value is 4
> 
> 
>         // HBase options
>         options.setHBaseTable("HBASE_student");
>         options.setHBaseColFamily("colFamily");
>         options.setCreateHBaseTable(true);    // Create HBase table, if it
> does not exist
>         options.setHBaseRowKeyColumn("stdId");
> 
>         @SuppressWarnings({ "unused" })
>         int ret = new ImportTool().run(options);
> 
> Could you please tell me which jars (plz be specific with the versions) I have to include in my class path. I have tried a number of combination but in the end I end up in a conflict.
> 
> Regards.

RE: Sqoop Import Using Java Code

Posted by "Ajay Chitre -X (achitre - PERSISTENT SYSTEMS INC at Cisco)" <ac...@cisco.com>.
If you're using Maven use a dependency such as this:

<dependency>
	<groupId>org.apache.sqoop</groupId>
	<artifactId>sqoop</artifactId>
	<version>1.4.4</version>
</dependency>
            

If you're not using Maven, consider using it.  It will help you tremendously in the long run.  Hope this helps.  Thanks.


-----Original Message-----
From: Nauman Zahid [mailto:nauman.goldsmith@gmail.com] 
Sent: Thursday, May 01, 2014 10:23 AM
To: dev@sqoop.apache.org
Cc: shuja@pucit.edu.pk
Subject: Sqoop Import Using Java Code

Hello!
I am using the following code to try to import data from mysql database to
Hbase:
SqoopOptions options = new SqoopOptions();
        options.setConnectString("jdbc:mysql://localhost:3306/testDb");
        options.setTableName("student");
        //options.setWhereClause("id>10");     // this where clause works
when importing whole table, ie when setTableName() is used
        options.setUsername("root");
        options.setPassword("");
        //options.setDirectMode(true);    // Make sure the direct mode is
off when importing data to HBase
        options.setNumMappers(8);         // Default value is 4


        // HBase options
        options.setHBaseTable("HBASE_student");
        options.setHBaseColFamily("colFamily");
        options.setCreateHBaseTable(true);    // Create HBase table, if it
does not exist
        options.setHBaseRowKeyColumn("stdId");

        @SuppressWarnings({ "unused" })
        int ret = new ImportTool().run(options);

Could you please tell me which jars (plz be specific with the versions) I have to include in my class path. I have tried a number of combination but in the end I end up in a conflict.

Regards.