You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Joanne Chan <jc...@shutterstock.com> on 2014/12/18 06:12:50 UTC

Sqoop free form query import with invalid dates

I've noticed that invalid dates is causing the entire import to fail
when trying
to change an existing sqoop import to free form query import.

There's no issues on the same data set when not using free form query.

Is this a known issue?  Is there any workaround?

The error:
14/12/18 00:11:33 INFO mapred.JobClient: Task Id :
attempt_201412171757_0484_m_000000_1, Status : FAILED
java.io.IOException: SQLException in nextKeyValue
        at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:266)
        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:483)
        at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
        at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
        at
org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.sql


Thanks in advance!

Best,
Joanne

RE: Sqoop free form query import with invalid dates

Posted by "Xu, Qian A" <qi...@intel.com>.
Hi Joanne,

If you can query data from specified table with datetime fields translated, you can use `--query [QUERY]` instead of `--table [TABLE]`.

--Stanley (Qian) Xu

From: Joanne Chan [mailto:jchan@shutterstock.com]
Sent: Thursday, December 18, 2014 1:13 PM
To: user@sqoop.apache.org
Subject: Sqoop free form query import with invalid dates

I've noticed that invalid dates is causing the entire import to fail when trying to change an existing sqoop import to free form query import.

There's no issues on the same data set when not using free form query.

Is this a known issue?  Is there any workaround?

The error:
14/12/18 00:11:33 INFO mapred.JobClient: Task Id : attempt_201412171757_0484_m_000000_1, Status : FAILED
java.io.IOException: SQLException in nextKeyValue
        at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:266)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:483)
        at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
        at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.sql


Thanks in advance!

Best,
Joanne