You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Abraham Elmahrek (JIRA)" <ji...@apache.org> on 2014/11/03 23:39:33 UTC
[jira] [Created] (SQOOP-1661) Sqoop2: Intermediate data format text
null handling
Abraham Elmahrek created SQOOP-1661:
---------------------------------------
Summary: Sqoop2: Intermediate data format text null handling
Key: SQOOP-1661
URL: https://issues.apache.org/jira/browse/SQOOP-1661
Project: Sqoop
Issue Type: Bug
Components: sqoop2-framework
Affects Versions: 1.99.4
Reporter: Abraham Elmahrek
Simple table:
{noformat}
+-------+-------------+------+-----+---------+-------+
| Field | Type | Null | Key | Default | Extra |
+-------+-------------+------+-----+---------+-------+
| id | int(11) | NO | PRI | 0 | |
| name | varchar(35) | YES | | NULL | |
+-------+-------------+------+-----+---------+-------+
{noformat}
Content:
{noformat}
+----+------+
| id | name |
+----+------+
| 1 | |
| 2 | test |
+----+------+
2 rows in set (0.00 sec)
{noformat}
Error:
{noformat}
Error: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor run at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:99) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write to the data writer at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:148) at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeArrayRecord(SqoopMapper.java:122) at org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:62) at org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:31) at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:94) ... 7 more Caused by: org.apache.sqoop.common.SqoopException: INTERMEDIATE_DATA_FORMAT_0002:An error has occurred while escaping a row. - null null 0 null at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.escapeStrings(CSVIntermediateDataFormat.java:332) at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.escapeArray(CSVIntermediateDataFormat.java:299) at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.setObjectData(CSVIntermediateDataFormat.java:243) at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:143) ... 11 more Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143
{noformat}
It seems like both NULL and EMPTY strings aren't handled properly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)