You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Joshi Omkar <om...@scania.com> on 2015/06/05 16:35:52 UTC
Import SQL Server table via Sqoop
Hi,
I have HDP-2.2.4.2-2 running with Sqoop 1.4.5.2.2.4.2-2.
>From the Hortonworks Sqoop doc<http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.2.4/bk_dataintegration/content/ch_using-sqoop-intro.html>., I reached the Microsoft doc<https://www.microsoft.com/en-us/download/details.aspx?id=27584>. which says that 'The Microsoft SQL Server SQOOP Connector for Hadoop is now part of Apache SQOOP 1.4 and we are not providing a separate download anymore.'
When I execute the sqoop import :
sqoop import --connect jdbc:sqlserver://SESOCO1945/BigPUS2MONEY -- tb1 Stops --username somename -P
(OR even sqoop import --driver com.microsoft.jdbc.sqlserver.SQLServerDriver --connect jdbc:sqlserver://SESOCO1945/BigPUS2MONEY --table tb1 --direct --username somename -P
)
I get :
Warning: /usr/hdp/2.2.4.2-2/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
15/06/05 16:16:25 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5.2.2.4.2-2
Enter password:
15/06/05 16:16:33 INFO manager.SqlManager: Using default fetchSize of 1000
15/06/05 16:16:33 INFO tool.CodeGenTool: Beginning code generation
15/06/05 16:16:33 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.microsoft.sqlserver.jdbc.SQLServerDriver
java.lang.RuntimeException: Could not load db driver class: com.microsoft.sqlserver.jdbc.SQLServerDriver
at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:848)
at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:736)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:759)
at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:269)
at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:240)
at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:226)
at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295)
at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1773)
at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1578)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
Am I missing any parameters to sqoop import or do I need to install the driver ?
Regards,
Omkar Joshi
Re: Import SQL Server table via Sqoop
Posted by Artem Ervits <ar...@gmail.com>.
you need sqljdbc4.jar
On Fri, Jun 5, 2015 at 10:35 AM, Joshi Omkar <om...@scania.com> wrote:
> Hi,
>
>
>
> I have HDP-2.2.4.2-2 running with Sqoop 1.4.5.2.2.4.2-2.
>
>
>
> From the Hortonworks Sqoop doc
> <http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.2.4/bk_dataintegration/content/ch_using-sqoop-intro.html>.,
> I reached the Microsoft doc
> <https://www.microsoft.com/en-us/download/details.aspx?id=27584>. which
> says that ‘The Microsoft SQL Server SQOOP Connector for Hadoop is now part
> of Apache SQOOP 1.4 and we are not providing a separate download anymore.’
>
>
>
> When I execute the sqoop import :
>
>
>
> sqoop import --connect jdbc:sqlserver://SESOCO1945/BigPUS2MONEY -- tb1
> Stops --username somename –P
>
>
>
> (OR even sqoop import --driver
> com.microsoft.jdbc.sqlserver.SQLServerDriver --connect
> jdbc:sqlserver://SESOCO1945/BigPUS2MONEY --table tb1 --direct --username
> somename –P
>
> )
>
>
>
> I get :
>
>
>
> Warning: /usr/hdp/2.2.4.2-2/accumulo does not exist! Accumulo imports will
> fail.
>
> Please set $ACCUMULO_HOME to the root of your Accumulo installation.
>
> 15/06/05 16:16:25 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5.2.2.4.2-2
>
> Enter password:
>
> 15/06/05 16:16:33 INFO manager.SqlManager: Using default fetchSize of 1000
>
> 15/06/05 16:16:33 INFO tool.CodeGenTool: Beginning code generation
>
> 15/06/05 16:16:33 ERROR sqoop.Sqoop: Got exception running Sqoop:
> java.lang.RuntimeException: Could not load db driver class:
> com.microsoft.sqlserver.jdbc.SQLServerDriver
>
> java.lang.RuntimeException: Could not load db driver class:
> com.microsoft.sqlserver.jdbc.SQLServerDriver
>
> at
> org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:848)
>
> at
> org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
>
> at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:736)
>
> at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:759)
>
> at
> org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:269)
>
> at
> org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:240)
>
> at
> org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:226)
>
> at
> org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295)
>
> at
> org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1773)
>
> at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1578)
>
> at
> org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:96)
>
> at
> org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
>
> at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
>
> at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
>
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
>
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
>
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
>
> at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
>
>
>
>
>
> Am I missing any parameters to sqoop import or do I need to install the
> driver ?
>
>
>
> Regards,
>
> Omkar Joshi
>