You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@sqoop.apache.org by Zhu Wayne <zh...@gmail.com> on 2013/09/09 21:46:53 UTC

sqoop merge exception

Version:  1.4.3-cdh4.3.0

I use sqoop import to load initial full snapshot and daily incremental data
and then merge them with sqoop merge to get daily snapshot.  Merge works
fine for 12 of 17 tables. And I got the following for the rest:
*13/09/09 10:59:50 INFO mapred.JobClient: Task Id :
attempt_201308211622_0171_m_000033_0, Status : FAILED
java.util.NoSuchElementException
        at java.util.AbstractList$Itr.next(AbstractList.java:350)
        at ORDERITEMS.__loadFromFields(ORDERITEMS.java:1916)
        at ORDERITEMS.parse(ORDERITEMS.java:1735)
        at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
        at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:140)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
*
Is this a bug for merge tool? It seems to be data related since not all
table merges fail. All data are imported by sqoop import tool. Thanks.