You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Zhu Wayne <zh...@gmail.com> on 2013/09/09 21:46:53 UTC
sqoop merge exception
Version: 1.4.3-cdh4.3.0
I use sqoop import to load initial full snapshot and daily incremental data
and then merge them with sqoop merge to get daily snapshot. Merge works
fine for 12 of 17 tables. And I got the following for the rest:
*13/09/09 10:59:50 INFO mapred.JobClient: Task Id :
attempt_201308211622_0171_m_000033_0, Status : FAILED
java.util.NoSuchElementException
at java.util.AbstractList$Itr.next(AbstractList.java:350)
at ORDERITEMS.__loadFromFields(ORDERITEMS.java:1916)
at ORDERITEMS.parse(ORDERITEMS.java:1735)
at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:140)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
*
Is this a bug for merge tool? It seems to be data related since not all
table merges fail. All data are imported by sqoop import tool. Thanks.