You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Swapnil Shinde <sw...@gmail.com> on 2013/02/25 22:33:27 UTC

MS sql server hadoop connector

Hello
I am newly trying to work with SQL server hadoop connector. We have
installed sqoop and SQL server connector properly. but i m getting below
error while running import command.
I am not sure how to proceed with this so any help will be really great..

13/02/25 16:18:32 ERROR sqoop.ConnFactory: Error loading ManagerFactory
information from file
/opt/mapr/sqoop/sqoop-1.4.2/bin/../conf/managers.d/mssqoop-sqlserver:
java.io.IOException: the content of connector file must be in form of
key=value
 at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
at
org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
 at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
 at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:201)
 at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:464)
 at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
 at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
at org.apache.sqoop.Sqoop.main(Sqoop.java:238)

13/02/25 16:18:32 INFO manager.SqlManager: Using default fetchSize of 1000
13/02/25 16:18:32 INFO tool.CodeGenTool: Beginning code generation
Feb 25, 2013 4:18:32 PM com.microsoft.sqlserver.jdbc.SQLServerConnection
<init>
SEVERE: Java Runtime Environment (JRE) version 1.6 is not supported by this
driver. Use the sqljdbc4.jar class library, which provides support for JDBC
4.0.
13/02/25 16:18:32 ERROR sqoop.Sqoop: Got exception running Sqoop:
java.lang.UnsupportedOperationException: Java Runtime Environment (JRE)
version 1.6 is not supported by this driver. Use the sqljdbc4.jar class
library, which provides support for JDBC 4.0.
java.lang.UnsupportedOperationException: Java Runtime Environment (JRE)
version 1.6 is not supported by this driver. Use the sqljdbc4.jar class
library, which provides support for JDBC 4.0.
at
com.microsoft.sqlserver.jdbc.SQLServerConnection.<init>(SQLServerConnection.java:238)
 at
com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:841)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
 at java.sql.DriverManager.getConnection(DriverManager.java:207)
at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:663)
 at
org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525)
 at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548)
at
org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191)
 at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175)
at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262)
 at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235)
at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060)
 at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
 at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
 at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
 at org.apache.sqoop.Sqoop.main(Sqoop.java:238)

Re: MS sql server hadoop connector

Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
Hi,

+ users@sqoop.apache.org
- user@hadoop.apache.org

Hi,

I moved the thread to the sqoop mailing list.
The main error indicates whats going wrong:
> mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value

From sqoop 1.4.2 on we support NVARCHAR for im/export, but sqoop hasn't a valid splitter for this kind of datatype. We had such a thread in past, follow the instructions here: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121026221855.GG12835@jarcec-thinkpad%3E

- Alex


On Feb 25, 2013, at 10:33 PM, Swapnil Shinde <sw...@gmail.com> wrote:

> Hello
> I am newly trying to work with SQL server hadoop connector. We have installed sqoop and SQL server connector properly. but i m getting below error while running import command.
> I am not sure how to proceed with this so any help will be really great..
> 
> 13/02/25 16:18:32 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /opt/mapr/sqoop/sqoop-1.4.2/bin/../conf/managers.d/mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value
> 	at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
> 	at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
> 	at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
> 	at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
> 	at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
> 	at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:201)
> 	at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:464)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 13/02/25 16:18:32 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/02/25 16:18:32 INFO tool.CodeGenTool: Beginning code generation
> Feb 25, 2013 4:18:32 PM com.microsoft.sqlserver.jdbc.SQLServerConnection <init>
> SEVERE: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 13/02/25 16:18:32 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 	at com.microsoft.sqlserver.jdbc.SQLServerConnection.<init>(SQLServerConnection.java:238)
> 	at com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:841)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:582)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:207)
> 	at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:663)
> 	at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175)
> 	at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262)
> 	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235)
> 	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060)
> 	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 
> 
> 

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Re: MS sql server hadoop connector

Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
Hi,

+ users@sqoop.apache.org
- user@hadoop.apache.org

Hi,

I moved the thread to the sqoop mailing list.
The main error indicates whats going wrong:
> mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value

From sqoop 1.4.2 on we support NVARCHAR for im/export, but sqoop hasn't a valid splitter for this kind of datatype. We had such a thread in past, follow the instructions here: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121026221855.GG12835@jarcec-thinkpad%3E

- Alex


On Feb 25, 2013, at 10:33 PM, Swapnil Shinde <sw...@gmail.com> wrote:

> Hello
> I am newly trying to work with SQL server hadoop connector. We have installed sqoop and SQL server connector properly. but i m getting below error while running import command.
> I am not sure how to proceed with this so any help will be really great..
> 
> 13/02/25 16:18:32 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /opt/mapr/sqoop/sqoop-1.4.2/bin/../conf/managers.d/mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value
> 	at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
> 	at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
> 	at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
> 	at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
> 	at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
> 	at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:201)
> 	at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:464)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 13/02/25 16:18:32 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/02/25 16:18:32 INFO tool.CodeGenTool: Beginning code generation
> Feb 25, 2013 4:18:32 PM com.microsoft.sqlserver.jdbc.SQLServerConnection <init>
> SEVERE: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 13/02/25 16:18:32 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 	at com.microsoft.sqlserver.jdbc.SQLServerConnection.<init>(SQLServerConnection.java:238)
> 	at com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:841)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:582)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:207)
> 	at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:663)
> 	at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175)
> 	at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262)
> 	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235)
> 	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060)
> 	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 
> 
> 

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Re: MS sql server hadoop connector

Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
Hi,

+ users@sqoop.apache.org
- user@hadoop.apache.org

Hi,

I moved the thread to the sqoop mailing list.
The main error indicates whats going wrong:
> mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value

From sqoop 1.4.2 on we support NVARCHAR for im/export, but sqoop hasn't a valid splitter for this kind of datatype. We had such a thread in past, follow the instructions here: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121026221855.GG12835@jarcec-thinkpad%3E

- Alex


On Feb 25, 2013, at 10:33 PM, Swapnil Shinde <sw...@gmail.com> wrote:

> Hello
> I am newly trying to work with SQL server hadoop connector. We have installed sqoop and SQL server connector properly. but i m getting below error while running import command.
> I am not sure how to proceed with this so any help will be really great..
> 
> 13/02/25 16:18:32 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /opt/mapr/sqoop/sqoop-1.4.2/bin/../conf/managers.d/mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value
> 	at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
> 	at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
> 	at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
> 	at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
> 	at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
> 	at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:201)
> 	at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:464)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 13/02/25 16:18:32 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/02/25 16:18:32 INFO tool.CodeGenTool: Beginning code generation
> Feb 25, 2013 4:18:32 PM com.microsoft.sqlserver.jdbc.SQLServerConnection <init>
> SEVERE: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 13/02/25 16:18:32 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 	at com.microsoft.sqlserver.jdbc.SQLServerConnection.<init>(SQLServerConnection.java:238)
> 	at com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:841)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:582)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:207)
> 	at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:663)
> 	at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175)
> 	at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262)
> 	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235)
> 	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060)
> 	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 
> 
> 

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Re: MS sql server hadoop connector

Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
Hi,

+ users@sqoop.apache.org
- user@hadoop.apache.org

Hi,

I moved the thread to the sqoop mailing list.
The main error indicates whats going wrong:
> mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value

From sqoop 1.4.2 on we support NVARCHAR for im/export, but sqoop hasn't a valid splitter for this kind of datatype. We had such a thread in past, follow the instructions here: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121026221855.GG12835@jarcec-thinkpad%3E

- Alex


On Feb 25, 2013, at 10:33 PM, Swapnil Shinde <sw...@gmail.com> wrote:

> Hello
> I am newly trying to work with SQL server hadoop connector. We have installed sqoop and SQL server connector properly. but i m getting below error while running import command.
> I am not sure how to proceed with this so any help will be really great..
> 
> 13/02/25 16:18:32 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /opt/mapr/sqoop/sqoop-1.4.2/bin/../conf/managers.d/mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value
> 	at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
> 	at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
> 	at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
> 	at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
> 	at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
> 	at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:201)
> 	at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:464)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 13/02/25 16:18:32 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/02/25 16:18:32 INFO tool.CodeGenTool: Beginning code generation
> Feb 25, 2013 4:18:32 PM com.microsoft.sqlserver.jdbc.SQLServerConnection <init>
> SEVERE: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 13/02/25 16:18:32 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 	at com.microsoft.sqlserver.jdbc.SQLServerConnection.<init>(SQLServerConnection.java:238)
> 	at com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:841)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:582)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:207)
> 	at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:663)
> 	at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175)
> 	at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262)
> 	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235)
> 	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060)
> 	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 
> 
> 

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF


Re: MS sql server hadoop connector

Posted by Alexander Alten-Lorenz <wg...@gmail.com>.
Hi,

+ users@sqoop.apache.org
- user@hadoop.apache.org

Hi,

I moved the thread to the sqoop mailing list.
The main error indicates whats going wrong:
> mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value

From sqoop 1.4.2 on we support NVARCHAR for im/export, but sqoop hasn't a valid splitter for this kind of datatype. We had such a thread in past, follow the instructions here: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121026221855.GG12835@jarcec-thinkpad%3E

- Alex


On Feb 25, 2013, at 10:33 PM, Swapnil Shinde <sw...@gmail.com> wrote:

> Hello
> I am newly trying to work with SQL server hadoop connector. We have installed sqoop and SQL server connector properly. but i m getting below error while running import command.
> I am not sure how to proceed with this so any help will be really great..
> 
> 13/02/25 16:18:32 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /opt/mapr/sqoop/sqoop-1.4.2/bin/../conf/managers.d/mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value
> 	at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
> 	at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
> 	at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
> 	at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
> 	at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
> 	at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:201)
> 	at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:464)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 13/02/25 16:18:32 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/02/25 16:18:32 INFO tool.CodeGenTool: Beginning code generation
> Feb 25, 2013 4:18:32 PM com.microsoft.sqlserver.jdbc.SQLServerConnection <init>
> SEVERE: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 13/02/25 16:18:32 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> java.lang.UnsupportedOperationException: Java Runtime Environment (JRE) version 1.6 is not supported by this driver. Use the sqljdbc4.jar class library, which provides support for JDBC 4.0.
> 	at com.microsoft.sqlserver.jdbc.SQLServerConnection.<init>(SQLServerConnection.java:238)
> 	at com.microsoft.sqlserver.jdbc.SQLServerDriver.connect(SQLServerDriver.java:841)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:582)
> 	at java.sql.DriverManager.getConnection(DriverManager.java:207)
> 	at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:663)
> 	at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525)
> 	at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191)
> 	at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175)
> 	at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262)
> 	at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235)
> 	at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060)
> 	at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> 	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> 	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
> 	at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> 	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> 	at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> 
> 
> 
> 

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF