You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jignesh Dhruv (JIRA)" <ji...@apache.org> on 2010/07/20 18:45:50 UTC
[jira] Created: (CASSANDRA-1303) Cassandra Throws Exception During
Batch Insert - SVN
Cassandra Throws Exception During Batch Insert - SVN
-----------------------------------------------------
Key: CASSANDRA-1303
URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
Project: Cassandra
Issue Type: Bug
Components: Core
Reporter: Jignesh Dhruv
Hello,
The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
I am working with svn revision 965880 (latest source code as of 07/20/2010).
I am getting following exceptions randomly during batch inserts
-----------------------------------------------------------------------------------------
ERROR 09:40:49,306 Thrift error occurred during processing of message.
org.apache.thrift.TException: Message length exceeded: 8
at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
at org.apache.cassandra.thrift.Column.read(Column.java:491)
at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
-----------------------------------------------------------------------------------
Let me know if you need more information.
Thanks,
Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1303) Cassandra Throws Exception
During Batch Insert - SVN
Posted by "Jignesh Dhruv (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12890752#action_12890752 ]
Jignesh Dhruv commented on CASSANDRA-1303:
------------------------------------------
One more thing.
Before I did a SVN update this morning, I checkout thrift and applied the patch suggested by Nate in bug THRIFT-820 https://issues.apache.org/jira/browse/THRIFT-820. When I rebuild thrift jar file and used it, I had no crashes or exceptions yesterday.
But today with/without thrift patch, I am getting exceptions mentioned above.
Jignesh
> Cassandra Throws Exception During Batch Insert - SVN
> -----------------------------------------------------
>
> Key: CASSANDRA-1303
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jignesh Dhruv
> Attachments: TestSuperColumnTTL.java
>
>
> Hello,
> The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
> I am working with svn revision 965880 (latest source code as of 07/20/2010).
> I am getting following exceptions randomly during batch inserts
> -----------------------------------------------------------------------------------------
> ERROR 09:40:49,306 Thrift error occurred during processing of message.
> org.apache.thrift.TException: Message length exceeded: 8
> at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
> at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
> at org.apache.cassandra.thrift.Column.read(Column.java:491)
> at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
> at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
> at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
> at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
> at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> -----------------------------------------------------------------------------------
> Let me know if you need more information.
> Thanks,
> Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CASSANDRA-1303) Cassandra Throws Exception During
Batch Insert - SVN
Posted by "Jignesh Dhruv (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jignesh Dhruv updated CASSANDRA-1303:
-------------------------------------
Attachment: TestSuperColumnTTL.java
Attached is a test java file which will demonstrate the problem. Right after inserting 127566 records an exception is being thrown on batch inserts.
> Cassandra Throws Exception During Batch Insert - SVN
> -----------------------------------------------------
>
> Key: CASSANDRA-1303
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jignesh Dhruv
> Attachments: TestSuperColumnTTL.java
>
>
> Hello,
> The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
> I am working with svn revision 965880 (latest source code as of 07/20/2010).
> I am getting following exceptions randomly during batch inserts
> -----------------------------------------------------------------------------------------
> ERROR 09:40:49,306 Thrift error occurred during processing of message.
> org.apache.thrift.TException: Message length exceeded: 8
> at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
> at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
> at org.apache.cassandra.thrift.Column.read(Column.java:491)
> at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
> at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
> at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
> at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
> at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> -----------------------------------------------------------------------------------
> Let me know if you need more information.
> Thanks,
> Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (CASSANDRA-1303) Cassandra Throws Exception During
Batch Insert - SVN
Posted by "Jignesh Dhruv (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jignesh Dhruv reopened CASSANDRA-1303:
--------------------------------------
Hello,
This bug was marked duplicate of CASSANDRA-475. But that bug has now being marked resolved and I am still having trouble with batch inserts.
I am using the latest source code from trunk. SVN 961952
After few hundred thousand inserts cassandra crashes and is throwing 2 different types of exceptions:
The first one being:
org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
at org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:101)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:369)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:295)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:202)
at org.apache.cassandra.thrift.Cassandra$Client.recv_batch_mutate(Cassandra.java:960)
at org.apache.cassandra.thrift.Cassandra$Client.batch_mutate(Cassandra.java:944)
at com.cbsi.pi.rtss.data.cassandra.CassandraDataManager.insert(CassandraDataManager.java:107)
at com.cbsi.pi.rtss.service.bulk.BulkThread.run(BulkThread.java:59)
at java.lang.Thread.run(Unknown Source)
and the second one being:
org.apache.thrift.transport.TTransportException: java.net.SocketException: Software caused connection abort: socket write error
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:147)
at org.apache.thrift.transport.TFramedTransport.flush(TFramedTransport.java:156)
at org.apache.cassandra.thrift.Cassandra$Client.send_set_keyspace(Cassandra.java:441)
at org.apache.cassandra.thrift.Cassandra$Client.set_keyspace(Cassandra.java:430)
at com.cbsi.pi.rtss.data.cassandra.CassandraDataManager.insert(CassandraDataManager.java:106)
at com.cbsi.pi.rtss.service.bulk.BulkThread.run(BulkThread.java:59)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketException: Software caused connection abort: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
at java.io.BufferedOutputStream.write(Unknown Source)
at org.apache.thrift.transport.TIOStreamTransport.write(TIOStreamTransport.java:145)
... 6 more
I was not getting this error yesterday but this morning when I updated my svn trunk I got update for following 2 files:
U src/java/org/apache/cassandra/thrift/CustomTThreadPoolServer.java
U src/java/org/apache/cassandra/scheduler/RoundRobinScheduler.java
and that is causing the problem.
> Cassandra Throws Exception During Batch Insert - SVN
> -----------------------------------------------------
>
> Key: CASSANDRA-1303
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jignesh Dhruv
> Attachments: TestSuperColumnTTL.java
>
>
> Hello,
> The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
> I am working with svn revision 965880 (latest source code as of 07/20/2010).
> I am getting following exceptions randomly during batch inserts
> -----------------------------------------------------------------------------------------
> ERROR 09:40:49,306 Thrift error occurred during processing of message.
> org.apache.thrift.TException: Message length exceeded: 8
> at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
> at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
> at org.apache.cassandra.thrift.Column.read(Column.java:491)
> at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
> at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
> at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
> at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
> at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> -----------------------------------------------------------------------------------
> Let me know if you need more information.
> Thanks,
> Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (CASSANDRA-1303) Cassandra Throws Exception During
Batch Insert - SVN
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-1303.
---------------------------------------
Resolution: Duplicate
Please keep comments in the relevant issue (CASSANDRA-475) instead of spreading them across multiple tickets.
> Cassandra Throws Exception During Batch Insert - SVN
> -----------------------------------------------------
>
> Key: CASSANDRA-1303
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jignesh Dhruv
> Attachments: TestSuperColumnTTL.java
>
>
> Hello,
> The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
> I am working with svn revision 965880 (latest source code as of 07/20/2010).
> I am getting following exceptions randomly during batch inserts
> -----------------------------------------------------------------------------------------
> ERROR 09:40:49,306 Thrift error occurred during processing of message.
> org.apache.thrift.TException: Message length exceeded: 8
> at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
> at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
> at org.apache.cassandra.thrift.Column.read(Column.java:491)
> at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
> at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
> at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
> at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
> at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> -----------------------------------------------------------------------------------
> Let me know if you need more information.
> Thanks,
> Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CASSANDRA-1303) Cassandra Throws Exception
During Batch Insert - SVN
Posted by "Jignesh Dhruv (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12890761#action_12890761 ]
Jignesh Dhruv commented on CASSANDRA-1303:
------------------------------------------
OK. I will reopen ticket CASSANDRA-475 with the exception that I am getting.
Thanks.
> Cassandra Throws Exception During Batch Insert - SVN
> -----------------------------------------------------
>
> Key: CASSANDRA-1303
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jignesh Dhruv
> Attachments: TestSuperColumnTTL.java
>
>
> Hello,
> The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
> I am working with svn revision 965880 (latest source code as of 07/20/2010).
> I am getting following exceptions randomly during batch inserts
> -----------------------------------------------------------------------------------------
> ERROR 09:40:49,306 Thrift error occurred during processing of message.
> org.apache.thrift.TException: Message length exceeded: 8
> at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
> at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
> at org.apache.cassandra.thrift.Column.read(Column.java:491)
> at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
> at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
> at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
> at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
> at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> -----------------------------------------------------------------------------------
> Let me know if you need more information.
> Thanks,
> Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (CASSANDRA-1303) Cassandra Throws Exception During
Batch Insert - SVN
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Ellis resolved CASSANDRA-1303.
---------------------------------------
Resolution: Duplicate
This is a known problem introduced in CASSANDRA-475. We're working on it.
> Cassandra Throws Exception During Batch Insert - SVN
> -----------------------------------------------------
>
> Key: CASSANDRA-1303
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1303
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Reporter: Jignesh Dhruv
> Attachments: TestSuperColumnTTL.java
>
>
> Hello,
> The latest source code in trunk throws exceptions on batch_mutate after a connection is open and few thousands records are inserted.
> I am working with svn revision 965880 (latest source code as of 07/20/2010).
> I am getting following exceptions randomly during batch inserts
> -----------------------------------------------------------------------------------------
> ERROR 09:40:49,306 Thrift error occurred during processing of message.
> org.apache.thrift.TException: Message length exceeded: 8
> at org.apache.thrift.protocol.TBinaryProtocol.checkReadLength(TBinaryProtocol.java:384)
> at org.apache.thrift.protocol.TBinaryProtocol.readBinary(TBinaryProtocol.java:361)
> at org.apache.cassandra.thrift.Column.read(Column.java:491)
> at org.apache.cassandra.thrift.SuperColumn.read(SuperColumn.java:390)
> at org.apache.cassandra.thrift.ColumnOrSuperColumn.read(ColumnOrSuperColumn.java:359)
> at org.apache.cassandra.thrift.Mutation.read(Mutation.java:346)
> at org.apache.cassandra.thrift.Cassandra$batch_mutate_args.read(Cassandra.java:16780)
> at org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3041)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2531)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:619)
> -----------------------------------------------------------------------------------
> Let me know if you need more information.
> Thanks,
> Jignesh
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.