Has anyone seen a 'SQLException in nextKeyValue' exception

["Munjuluri, Shyam" <Mu...@AETNA.com>]

I'm not sure what is causing this? 8 out of 18 connections to the DB2 database were killed and restarted. Any idea what may be causing this?

Error: java.io.IOException: SQLException in nextKeyValue at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157) Caused by: com.ibm.db2.jcc.am.DisconnectNonTransientConnectionException: [jcc][t4][2030][11211][4.16.53] A communication error occurred during operations on the connection's underlying socket, socket input stream, or socket output stream. Error location: Reply.fill() - insufficient data (-1). Message: Insufficient data. ERRORCODE=-4499, SQLSTATE=08001 at com.ibm.db2.jcc.am.fd.a(fd.java:320) at com.ibm.db2.jcc.t4.a.a(a.java:526) at com.ibm.db2.jcc.t4.a.a(a.java:510) at com.ibm.db2.jcc.t4.a.a(a.java:505) at com.ibm.db2.jcc.t4.x.b(x.java:294) at com.ibm.db2.jcc.t4.x.c(x.java:320) at com.ibm.db2.jcc.t4.x.c(x.java:433) at com.ibm.db2.jcc.t4.x.v(x.java:1201) at com.ibm.db2.jcc.t4.bb.c(bb.java:30) at com.ibm.db2.jcc.t4.p.a(p.java:32) at com.ibm.db2.jcc.t4.h.readFetch_(h.java:263) at com.ibm.db2.jcc.am.ResultSet.flowFetch(ResultSet.java:3863) at com.ibm.db2.jcc.t4.c.f(c.java:2406) at com.ibm.db2.jcc.am.jc.a(jc.java:210) at com.ibm.db2.jcc.t4.c.a(c.java:128) at com.ibm.db2.jcc.am.ResultSet.nextX(ResultSet.java:382) at com.ibm.db2.jcc.am.ResultSet.next(ResultSet.java:309) at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237) ... 12 more Container killed by the ApplicationMaster. Container killed on request. Exit code is 143

Error: java.io.IOException: SQLException in nextKeyValue at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:532) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157) Caused by: com.ibm.db2.jcc.am.ClientRerouteException: [jcc][t4][2027][11212][4.16.53] A connection failed but has been re-established. Special register settings have been replayed if necessary. Host name or IP address of the connection: DWPRODTST.WHOUSE. Service name or port number of the connection: 10,000. Reason code: 1. Failure code: 2, Error code: zero byte read from the server.. ERRORCODE=-4498, SQLSTATE=08506 at com.ibm.db2.jcc.am.fd.a(fd.java:304) at com.ibm.db2.jcc.am.fd.d(fd.java:419) at com.ibm.db2.jcc.t4.a.a(a.java:593) at com.ibm.db2.jcc.t4.a.b(a.java:1058) at com.ibm.db2.jcc.t4.a.o(a.java:946) at com.ibm.db2.jcc.t4.q.a(q.java:216) at com.ibm.db2.jcc.t4.a.a(a.java:940) at com.ibm.db2.jcc.t4.x.b(x.java:291) at com.ibm.db2.jcc.t4.x.c(x.java:320) at com.ibm.db2.jcc.t4.x.c(x.java:433) at com.ibm.db2.jcc.t4.x.v(x.java:1201) at com.ibm.db2.jcc.t4.bb.c(bb.java:30) at com.ibm.db2.jcc.t4.p.a(p.java:32) at com.ibm.db2.jcc.t4.h.readFetch_(h.java:263) at com.ibm.db2.jcc.am.ResultSet.flowFetch(ResultSet.java:3863) at com.ibm.db2.jcc.t4.c.f(c.java:2406) at com.ibm.db2.jcc.am.jc.a(jc.java:210) at com.ibm.db2.jcc.t4.c.a(c.java:128) at com.ibm.db2.jcc.am.ResultSet.nextX(ResultSet.java:382) at com.ibm.db2.jcc.am.ResultSet.next(ResultSet.java:309) at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237) ... 12 more Container killed by the ApplicationMaster. Container killed on request. Exit code is 143

Shyam Munjuluri
Integrated Systems Engineering
Office: (M, W, F) 860-273-0595
WAH:  (Tu, Th)  860-404-5219



This e-mail may contain confidential or privileged information. If
you think you have received this e-mail in error, please advise the
sender by reply e-mail and then delete this e-mail immediately.
Thank you. Aetna