You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Yulei Wang (JIRA)" <ji...@apache.org> on 2017/10/31 01:25:00 UTC

[jira] [Created] (SQOOP-3247) Sqoop doesn't handle unsigned bigints at least with MySQL

Yulei Wang created SQOOP-3247:
---------------------------------

             Summary: Sqoop doesn't handle unsigned bigints at least with MySQL
                 Key: SQOOP-3247
                 URL: https://issues.apache.org/jira/browse/SQOOP-3247
             Project: Sqoop
          Issue Type: Bug
          Components: connectors/mysql
    Affects Versions: 1.4.6
            Reporter: Yulei Wang
             Fix For: 1.4.7


mysql> desc mysql2hdfs;
+---------+---------------------+------+-----+---------+-------+
| Field   | Type                | Null | Key | Default | Extra |
+---------+---------------------+------+-----+---------+-------+
| id      | bigint(20) unsigned | YES  |     | NULL    |       |
| address | varchar(20)         | YES  |     | NULL    |       |
+---------+---------------------+------+-----+---------+-------+
2 rows in set (0.00 sec)

mysql> select * from mysql2hdfs;
+----------------------+---------+
| id                   | address |
+----------------------+---------+
| 18446744073709551615 | suzhou  |
| 18446744073709551615 | suzhou  |
+----------------------+---------+
2 rows in set (0.00 sec)

Get's the following error
17/10/30 15:05:01 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446744073709551615' in column '1' is outside valid range for the datatype BIGINT.
	at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:174)
	at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:608)
	at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:625)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:494)
	at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1326)
	at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1323)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1858)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1323)
	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1344)
	at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196)
	at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169)
	at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266)
	at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
	at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
	at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
	at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLDataException: '18446744073709551615' in column '1' is outside valid range for the datatype BIGINT.
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:409)
	at com.mysql.jdbc.Util.getInstance(Util.java:384)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1025)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:987)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:973)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:918)
	at com.mysql.jdbc.ResultSetImpl.throwRangeException(ResultSetImpl.java:7875)
	at com.mysql.jdbc.ResultSetImpl.parseLongAsDouble(ResultSetImpl.java:7092)
	at com.mysql.jdbc.ResultSetImpl.getLong(ResultSetImpl.java:2977)
	at com.mysql.jdbc.ResultSetImpl.getLong(ResultSetImpl.java:2942)
	at org.apache.sqoop.mapreduce.db.IntegerSplitter.split(IntegerSplitter.java:44)
	at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:171)
	... 23 more



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)