You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (JIRA)" <ji...@apache.org> on 2009/10/08 17:46:31 UTC

[jira] Created: (CASSANDRA-478) NPE during read repair

NPE during read repair
----------------------

                 Key: CASSANDRA-478
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
             Project: Cassandra
          Issue Type: Bug
            Reporter: Jonathan Ellis
            Assignee: Jonathan Ellis
             Fix For: 0.4
         Attachments: 478-logging.patch

>From Teodor Sigaev:

ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
java.lang.NullPointerException
       at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
       at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
       at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
       at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
       at java.lang.Thread.run(Thread.java:636)
ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
java.lang.NullPointerException
       at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
       at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
       at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
       at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Teodor Sigaev (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764777#action_12764777 ] 

Teodor Sigaev commented on CASSANDRA-478:
-----------------------------------------

Ok, will apply

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Teodor Sigaev (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764772#action_12764772 ] 

Teodor Sigaev commented on CASSANDRA-478:
-----------------------------------------

No, it works 

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765054#action_12765054 ] 

Hudson commented on CASSANDRA-478:
----------------------------------

Integrated in Cassandra #226 (See [http://hudson.zones.apache.org/hudson/job/Cassandra/226/])
    move callback synchronization into ResponseVerbHandler where it's less likely to be a maintenance problem
patch by jbellis for 
r/m unused attachContext.
patch by jbellis for 
cleanup Message; add asserts
patch by jbellis for 
logging & cleanup in ConsistencyManager
patch by jbellis for 


> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-fix.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Eric Evans (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764788#action_12764788 ] 

Eric Evans commented on CASSANDRA-478:
--------------------------------------

Nice. :) +1

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-fix.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (CASSANDRA-478) NPE during read repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis resolved CASSANDRA-478.
--------------------------------------

    Resolution: Fixed

committed to 0.4 and trunk

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-fix.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Teodor Sigaev (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12765453#action_12765453 ] 

Teodor Sigaev commented on CASSANDRA-478:
-----------------------------------------

Thank you a lot!

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-fix.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (CASSANDRA-478) NPE during read repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-478:
-------------------------------------

    Attachment: 478-fix.patch

aha, it's a race condition :)

here's a fix.

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-fix.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764766#action_12764766 ] 

Jonathan Ellis commented on CASSANDRA-478:
------------------------------------------

is it reproducible when you re-run the query on that key? (00000000000176799500)

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (CASSANDRA-478) NPE during read repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-478:
-------------------------------------

    Attachment: 478-asserts.patch

asserts to find where the null Message body is coming from

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (CASSANDRA-478) NPE during read repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-478:
-------------------------------------

    Attachment: 478-logging.patch

Patch to log the Row that encounters this error

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Teodor Sigaev (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764754#action_12764754 ] 

Teodor Sigaev commented on CASSANDRA-478:
-----------------------------------------

Got it again:
ERROR [RESPONSE-STAGE:2] 2009-10-12 21:17:44,256 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
java.lang.RuntimeException: Error handling responses for Row(00000000000176799500 [)]
        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:82)
        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.NullPointerException
        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:70)
        ... 6 more
ERROR [RESPONSE-STAGE:2] 2009-10-12 21:17:44,256 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:2,5,main]
java.lang.RuntimeException: Error handling responses for Row(00000000000176799500 [)]
        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:82)
        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.NullPointerException
        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:70)
        ... 6 more


> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (CASSANDRA-478) NPE during read repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764787#action_12764787 ] 

Jonathan Ellis commented on CASSANDRA-478:
------------------------------------------

(there's no way for a null Message to be passed to response() -- see ResponseVerbHandler for details.  but it could see a null in the List if there is another thread modifying it concurrently.)

> NPE during read repair
> ----------------------
>
>                 Key: CASSANDRA-478
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-478
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jonathan Ellis
>            Assignee: Jonathan Ellis
>             Fix For: 0.4
>
>         Attachments: 478-asserts.patch, 478-fix.patch, 478-logging.patch
>
>
> From Teodor Sigaev:
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,864 DebuggableThreadPoolExecutor.java (line 110) Error in ThreadPoolExecutor
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:636)
> ERROR [RESPONSE-STAGE:1] 2009-10-08 17:05:25,916 CassandraDaemon.java (line 71) Fatal exception in thread Thread[RESPONSE-STAGE:1,5,main]
> java.lang.NullPointerException
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.handleDigestResponses(ConsistencyManager.java:68)
>        at org.apache.cassandra.service.ConsistencyManager$DigestResponseHandler.response(ConsistencyManager.java:55)
>        at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:35)
>        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:39)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.