You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jackson Chung (Created) (JIRA)" <ji...@apache.org> on 2011/10/04 07:09:34 UTC

[jira] [Created] (CASSANDRA-3302) stop Cassandra hang

stop Cassandra hang
-------------------

                 Key: CASSANDRA-3302
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
             Project: Cassandra
          Issue Type: Bug
    Affects Versions: 1.0.1
            Reporter: Jackson Chung
            Assignee: T Jake Luciani


testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)

When calling service cassandra stop, the Cassandra process hang:

http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/

The following logs is observed in the C* log:

 INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
 INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients

Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:

 INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
 INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
 INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
 INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
 INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.


could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Jackson Chung (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jackson Chung updated CASSANDRA-3302:
-------------------------------------

    Summary: stop Cassandra result in hang  (was: stop Cassandra hang)
    
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Jackson Chung (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134655#comment-13134655 ] 

Jackson Chung commented on CASSANDRA-3302:
------------------------------------------

still happen in 1.0 branch, so NOT OK to close.

stack trace looks the same as in the earlier link
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>             Fix For: 1.0.1
>
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Jonathan Ellis (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13126808#comment-13126808 ] 

Jonathan Ellis commented on CASSANDRA-3302:
-------------------------------------------

Jackson, if I remember correctly, this is broken in trunk but not 1.0.0?  Hence the suspicion of CASSANDRA-3261.
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "T Jake Luciani (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134099#comment-13134099 ] 

T Jake Luciani commented on CASSANDRA-3302:
-------------------------------------------

Jackson is this still happening? Or is it ok to close?
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>             Fix For: 1.0.1
>
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Sylvain Lebresne (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sylvain Lebresne updated CASSANDRA-3302:
----------------------------------------

    Fix Version/s: 1.0.1
    
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>             Fix For: 1.0.1
>
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Jackson Chung (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127041#comment-13127041 ] 

Jackson Chung commented on CASSANDRA-3302:
------------------------------------------

smoke test quickly repeating the same step except swaps with 1.0.0 jars cannot reproduce the problem
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Sylvain Lebresne (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sylvain Lebresne updated CASSANDRA-3302:
----------------------------------------

    Attachment: 3302.patch

This is indeed a bug from CASSANDRA-3261 that forgot to override the interrupt method.
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>             Fix For: 1.0.1
>
>         Attachments: 3302.patch
>
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "T Jake Luciani (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13137052#comment-13137052 ] 

T Jake Luciani commented on CASSANDRA-3302:
-------------------------------------------

+1
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: Sylvain Lebresne
>             Fix For: 1.0.1
>
>         Attachments: 3302.patch
>
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3302) stop Cassandra result in hang

Posted by "Jackson Chung (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13126858#comment-13126858 ] 

Jackson Chung commented on CASSANDRA-3302:
------------------------------------------

indeed i was testing on trunk but not 1.0.0

but i have not tried to test using 1.0.0 to see if it fails there. i could give it a quick try
                
> stop Cassandra result in hang
> -----------------------------
>
>                 Key: CASSANDRA-3302
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3302
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 1.0.1
>            Reporter: Jackson Chung
>            Assignee: T Jake Luciani
>
> testing this under trunk via a hacked package (replacing jars from 0.8.6 deb installation)
> When calling service cassandra stop, the Cassandra process hang:
> http://aep.appspot.com/display/i6aIUCkt4kz0HG5l2VszMM7QvLo/
> The following logs is observed in the C* log:
>  INFO [main] 2011-10-03 23:20:46,434 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-03 23:20:46,434 CassandraDaemon.java (line 218) Stop listening to thrift clients
> Re-run this using 1.0.0 branch, (following the same "hack" procedure), C* stop properly, and the following is observed in the log:
>  INFO [main] 2011-10-04 05:02:08,048 AbstractCassandraDaemon.java (line 270) Cassandra shutting down...
>  INFO [main] 2011-10-04 05:02:08,049 CassandraDaemon.java (line 218) Stop listening to thrift clients
>  INFO [Thread-2] 2011-10-04 05:02:08,318 MessagingService.java (line 482) Shutting down MessageService...
>  INFO [Thread-2] 2011-10-04 05:02:08,319 MessagingService.java (line 497) Waiting for in-progress requests to complete
>  INFO [ACCEPT-/10.83.77.171] 2011-10-04 05:02:08,319 MessagingService.java (line 637) MessagingService shutting down server thread.
> could this be related to CASSANDRA-3261 ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira