You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org> on 2012/04/02 19:51:24 UTC
[jira] [Commented] (SQOOP-473) Sqoop import-all-tables fails with
MySQL connector
[ https://issues.apache.org/jira/browse/SQOOP-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244375#comment-13244375 ]
jiraposter@reviews.apache.org commented on SQOOP-473:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/4584/
-----------------------------------------------------------
(Updated 2012-04-02 17:50:28.671860)
Review request for Sqoop.
Summary
-------
All-tables import fails with MySQL:
https://issues.apache.org/jira/browse/SQOOP-473
The change include:
1) Modify toJavaType(), toHiveType(), and toAvroType() methods.
2) Add new unit test for MySQL all-tables import (subclassing TestAllTables).
3) Minor changes to TestAllTables class to make it available for non-Hsqldb servers.
This addresses bug SQOOP-473.
https://issues.apache.org/jira/browse/SQOOP-473
Diffs (updated)
-----
src/java/org/apache/sqoop/hive/TableDefWriter.java bfac391
src/java/org/apache/sqoop/manager/ConnManager.java 26a2a82
src/java/org/apache/sqoop/manager/MySQLManager.java 3254a2c
src/java/org/apache/sqoop/manager/OracleManager.java 30401c5
src/java/org/apache/sqoop/mapreduce/JdbcExportJob.java a7ea834
src/java/org/apache/sqoop/orm/AvroSchemaGenerator.java ff39801
src/java/org/apache/sqoop/orm/ClassWriter.java 986934d
src/test/com/cloudera/sqoop/TestAllTables.java e6561e9
src/test/com/cloudera/sqoop/manager/MySQLAllTablesTest.java e69de29
Diff: https://reviews.apache.org/r/4584/diff
Testing
-------
1) Verified that MySQL all-tables import is fixed using new unit test.
2) Ran ant test, ant test -Dthirdparty=true, and ant checkstyle.
Thanks,
Cheolsoo
> Sqoop import-all-tables fails with MySQL connector
> --------------------------------------------------
>
> Key: SQOOP-473
> URL: https://issues.apache.org/jira/browse/SQOOP-473
> Project: Sqoop
> Issue Type: Bug
> Components: connectors
> Affects Versions: 1.4.1-incubating
> Reporter: Prashant Gokhale
> Assignee: Cheolsoo Park
>
> Sqoop command
> sqoop import-all-tables --connect jdbc:mysql://xxxx/mysqltestdb2 --username=xxxx --warehouse-dir output-dir/alltables
> Output:
> {noformat}
> 12/03/29 10:42:20 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
> 12/03/29 10:42:21 INFO tool.CodeGenTool: Beginning code generation
> 12/03/29 10:42:21 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `testtable` AS t LIMIT 1
> 12/03/29 10:42:21 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
> java.lang.NullPointerException
> at org.apache.sqoop.manager.ConnManager.getColumnTypeNames(ConnManager.java:306)
> at org.apache.sqoop.manager.MySQLManager.toJavaType(MySQLManager.java:237)
> at org.apache.sqoop.orm.ClassWriter.toJavaType(ClassWriter.java:253)
> at org.apache.sqoop.orm.ClassWriter.generateFields(ClassWriter.java:480)
> at org.apache.sqoop.orm.ClassWriter.generateClassForColumns(ClassWriter.java:1306)
> at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1138)
> at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:64)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> {noformat}
> I have not tested with other connectors.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira