[jira] [Commented] (CASSANDRA-8014) NPE in Message.java line 324

["Peter Haggerty (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245041#comment-14245041 ] 

Peter Haggerty commented on CASSANDRA-8014:
-------------------------------------------

We've seen this in a 2.0.9 instance when running "nodetool disablethrift". It throws a half dozen of the "Unexpected throwable", then proceeds to:

{code}
ERROR [pool-6-thread-2] 2014-12-12 23:43:13,643 CassandraDaemon.java (line 199) Exception in thread Thread[pool-6-thread-2,5,main]
java.lang.RuntimeException: java.lang.NullPointerException
        at com.lmax.disruptor.FatalExceptionHandler.handleEventException(FatalExceptionHandler.java:45)
        at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:126)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
        at com.thinkaurelius.thrift.Message.getInputTransport(Message.java:338)
        at com.thinkaurelius.thrift.Message.invoke(Message.java:308)
        at com.thinkaurelius.thrift.Message$Invocation.execute(Message.java:90)
        at com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:638)
        at com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:632)
        at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:112)
        ... 3 more
{code}

The "nodetool disablethrift" appears to hang until killed.


> NPE in Message.java line 324
> ----------------------------
>
>                 Key: CASSANDRA-8014
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8014
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: Cassandra 2.0.9
>            Reporter: Peter Haggerty
>            Assignee: Pavel Yaskevich
>         Attachments: NPE_Message.java_line-324.txt
>
>
> We received this when a server was rebooting and attempted to shut Cassandra down while it was still quite busy. While it's normal for us to have a handful of the RejectedExecution exceptions on a sudden shutdown like this these NPEs in Message.java are new.
> The attached file include the logs from "StorageServiceShutdownHook" to the "Logging initialized" after the server restarts and Cassandra comes back up.
> {code}ERROR [pool-10-thread-2] 2014-09-29 08:33:44,055 Message.java (line 324) Unexpected throwable while invoking!
> java.lang.NullPointerException
>         at com.thinkaurelius.thrift.util.mem.Buffer.size(Buffer.java:83)
>         at com.thinkaurelius.thrift.util.mem.FastMemoryOutputTransport.expand(FastMemoryOutputTransport.java:84)
>         at com.thinkaurelius.thrift.util.mem.FastMemoryOutputTransport.write(FastMemoryOutputTransport.java:167)
>         at org.apache.thrift.transport.TFramedTransport.flush(TFramedTransport.java:156)
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:55)
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>         at com.thinkaurelius.thrift.Message.invoke(Message.java:314)
>         at com.thinkaurelius.thrift.Message$Invocation.execute(Message.java:90)
>         at com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:638)
>         at com.thinkaurelius.thrift.TDisruptorServer$InvocationHandler.onEvent(TDisruptorServer.java:632)
>         at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:112)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)