Checksum failed

[Kamal Bahadur <ma...@gmail.com>]

Have any of you seen this exception?

011-09-14 15:25:02,070 DEBUG org.mortbay.log: Container
org.mortbay.jetty.webapp.WebAppContext@7f033a6f{/flumeagent,/usr/lib/flume/webapps/flumeagent.war}
+ ErrorPageErrorHandler@3d5311bd as error

2011-09-14 15:25:02,107 DEBUG org.mortbay.log: Container
org.mortbay.jetty.servlet.Context@39cf4a2c{/logs,file:/var/disys/flume_logs/}
+ ErrorHandler@7afaa550 as errorHandler

2011-09-14 15:25:02,108 DEBUG org.mortbay.log: starting
ErrorHandler@7afaa550

2011-09-14 15:25:02,108 DEBUG org.mortbay.log: started ErrorHandler@7afaa550

2011-09-14 15:25:02,109 DEBUG org.mortbay.log: Container
org.mortbay.jetty.servlet.Context@2b5575e0{/stacks,null} +
ErrorHandler@2ea45536 as errorHandler

2011-09-14 15:25:02,110 DEBUG org.mortbay.log: starting
ErrorHandler@2ea45536

2011-09-14 15:25:02,110 DEBUG org.mortbay.log: started ErrorHandler@2ea45536

2011-09-14 15:25:02,319 DEBUG org.mortbay.log: starting
ErrorPageErrorHandler@3d5311bd

2011-09-14 15:25:02,319 DEBUG org.mortbay.log: started
ErrorPageErrorHandler@3d5311bd

2011-09-14 15:25:25,304 ERROR
com.cloudera.flume.handlers.endtoend.AckChecksumChecker: checksum failed

2011-09-14 15:25:38,619 INFO
com.cloudera.flume.handlers.debug.StubbornAppendSink: append Interrupted
event ' [INFO Wed Sep 14 00:44:43 PDT 2011]{ eventId : Audit } { eventType :
fwDataAccess } { fiRelationship : PRIMARY } { guId :
c0a8f379023400fc4e705b6b14f67800 } { ipAddress : 153.69.203.240 } {
requestType : HISTORY } { timeStamp : (long)1315986283351  (string) '2f�'
(double)6.50183613002E-312 } { trnuid : ee13676c-2479-4dc9-9b4f-3e5008d6c4b5
}
\u001F\uFFFD\b\u0000\u0000\u0000\u0000\u0000\u0000\u0000}P\uFFFDn\uFFFD0\u0010\uFFFD\u0015\uFFFD\uFFFDH\uFFFD5~\uFFFD\uFFFDR\uFFFD$\uFFFD\uFFFD*JDsi\uFFFD\u001C\uFFFD,\uFFFD\uFFFD\u0000\uFFFD1J\u06EF\uFFFD\uFFFD\uFFFD{\uFFFD\uFFFD\uFFFDy\uFFFD\u0003\uFFFD\u2451\u0004\u0018\uFFFD@GL\u001C
]\n\uFFFD\u0014<\u64BD\uFFFD\uFFFD\u0006R\uFFFD\bWZ%R*R\u032D\uFFFD\uFFFD\uFFFD]7\uFFFD\uFFFD\u000Bcp\uFFFD\uFFFD\u0002\uFFFD\uFFFD\u001E\uFFFD\u0006]N9d\uFFFD\u0012{)\uFFFD\uFFFD\u0005:\uFFFDL\uFFFDX\uFFFD8\u0001\u001E'\u0002(q\uFFFD5\uFFFD\uFFFD\u000F?\u0017\uFFFD\uFFFDs\uFFFDz\uFFFDUo\uFFFDt\uFFFD\uFFFDs\uFFFD\uFFFD8L\uFFFD\uFFFD\uFFFD\uFFFD}Un\uFFFD\u001B\uFFFD\uFFFD0\uFFFD6\uFFFD\uFFFD\uFFFD\uFFFDT\uFFFD(\u0011\uFFFD\uFFFDDkt\uFFFD\u001B\uFFFDE\u001C%@
\uFFFD*#\u001AI\t:7\uFFFDm\uFFFD?\uFFFD\uFFFDb\uFFFD{Y,(1g\uFFFD\uFFFD\uFFFD\uFFFDz\uFFFD\uFFFD\u0623#\uFFFD\u0000]}\uFFFD'r\uFFFD\uFFFDq\uFFFD\uFFFD\uFFFD\uFFFD\uFFFD\uFFFD\uFFFD\uFFFD7C\u0003u\uFFFD\uFFFDTC\uFFFD\u0005@g\u0004\uFFFD
\u001B\uFFFD0\u04694\uFFFD\uFFFD$nL\u0019\u00167%\uFFFD\uFFFD\u0003\uFFFD't{7\uFFFD\uFFFD\t^\uFFFD*L\uFFFDyC\uFFFDm\uFFFD\uFFFD\uFFFD\u0010bF\uFFFD\u0006\uFFFD\uFFFD\u001F\uFFFD\uFFFD\u0002\u074D\u0001\u0000\u0000'
with error: Blocked append interrupted by rotation event

2011-09-14 15:25:38,620 ERROR
com.cloudera.flume.core.connector.DirectDriver: Closing down due to
exception during append calls

2011-09-14 15:25:38,621 INFO com.cloudera.flume.core.connector.DirectDriver:
Connector logicalNode strafe1b.web.prod.diginsite.com-19 exited with error:
null

2011-09-14 15:25:49,647 ERROR
com.cloudera.flume.core.connector.DirectDriver: Exiting driver logicalNode
strafe1b.web.prod.diginsite.com-19 in error state CollectorSource |
Collector because null





This is causing my collector to error out. Here is my setup:


agent1 --> collector1, collector2 (agentE2EChain)

agent 2 --> collector2, collector1(agentE2EChain)


Data rate is around 2000 records per second.


I am using a custom sink plugin to write data to cassandra.


Thanks,

Kamal