You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jonathan Ellis (Created) (JIRA)" <ji...@apache.org> on 2012/02/28 06:04:48 UTC

[jira] [Created] (CASSANDRA-3970) JVM crash in streamingTransferTest on Windows

JVM crash in streamingTransferTest on Windows
---------------------------------------------

                 Key: CASSANDRA-3970
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3970
             Project: Cassandra
          Issue Type: Bug
          Components: Tests
            Reporter: Jonathan Ellis
             Fix For: 1.1.0


{noformat}
$ ant test -Dtest.name=StreamingTransferTest
...
[junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
[junit] #
[junit] # A fatal error has been detected by the Java Runtime Environment:
[junit] #
[junit] #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006da5ccca, pid=95744, tid=94924
[junit] #
[junit] # JRE version: 6.0_27-b07
[junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode windows-amd64 compressed oops)
[junit] # Problematic frame:
[junit] # V  [jvm.dll+0x1cccca]
[junit] #
[junit] # An error report file with more information is saved as:
[junit] # c:\Users\Jonathan\projects\cassandra\git\hs_err_pid95744.log
[junit] #
[junit] # If you would like to submit a bug report, please visit:
[junit] #   http://java.sun.com/webapps/bugreport/crash.jsp
[junit] #
[junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
[junit]
[junit] Testcase: org.apache.cassandra.streaming.StreamingTransferTest:testTransferTable:   Caused an ERROR
[junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
[junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
[junit]
[junit]
[junit] Test org.apache.cassandra.streaming.StreamingTransferTest FAILED (crashed)
{noformat}


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3970) JVM crash in streamingTransferTest on Windows

Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-3970:
--------------------------------------

    Attachment: hs_err_pid95744.log

The error log is always Unsafe.getByte in DirectByteBuffer in MappedFileDataInput, which seems to point to using a mmap'd buffer after it's unmapped.

Commenting out the "cleaner" unmapping in MmappedSegmentedFile makes the access violation crash go away, which supports this theory.  (It does cause the test to fail with EOFException later on, however.)
                
> JVM crash in streamingTransferTest on Windows
> ---------------------------------------------
>
>                 Key: CASSANDRA-3970
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3970
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jonathan Ellis
>             Fix For: 1.1.0
>
>         Attachments: hs_err_pid95744.log
>
>
> {noformat}
> $ ant test -Dtest.name=StreamingTransferTest
> ...
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] #
> [junit] # A fatal error has been detected by the Java Runtime Environment:
> [junit] #
> [junit] #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006da5ccca, pid=95744, tid=94924
> [junit] #
> [junit] # JRE version: 6.0_27-b07
> [junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode windows-amd64 compressed oops)
> [junit] # Problematic frame:
> [junit] # V  [jvm.dll+0x1cccca]
> [junit] #
> [junit] # An error report file with more information is saved as:
> [junit] # c:\Users\Jonathan\projects\cassandra\git\hs_err_pid95744.log
> [junit] #
> [junit] # If you would like to submit a bug report, please visit:
> [junit] #   http://java.sun.com/webapps/bugreport/crash.jsp
> [junit] #
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit]
> [junit] Testcase: org.apache.cassandra.streaming.StreamingTransferTest:testTransferTable:   Caused an ERROR
> [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit]
> [junit]
> [junit] Test org.apache.cassandra.streaming.StreamingTransferTest FAILED (crashed)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3970) (100% reproducible) JVM crash in streamingTransferTest on Windows

Posted by "Jonathan Ellis (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-3970:
--------------------------------------

    Summary: (100% reproducible) JVM crash in streamingTransferTest on Windows  (was: JVM crash in streamingTransferTest on Windows)

Note that the patch on CASSANDRA-3967 is required or the test errors out before getting to the part that makes it crash.
                
> (100% reproducible) JVM crash in streamingTransferTest on Windows
> -----------------------------------------------------------------
>
>                 Key: CASSANDRA-3970
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3970
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jonathan Ellis
>            Assignee: Sylvain Lebresne
>             Fix For: 1.1.0
>
>         Attachments: hs_err_pid95744.log
>
>
> {noformat}
> $ ant test -Dtest.name=StreamingTransferTest
> ...
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] #
> [junit] # A fatal error has been detected by the Java Runtime Environment:
> [junit] #
> [junit] #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006da5ccca, pid=95744, tid=94924
> [junit] #
> [junit] # JRE version: 6.0_27-b07
> [junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode windows-amd64 compressed oops)
> [junit] # Problematic frame:
> [junit] # V  [jvm.dll+0x1cccca]
> [junit] #
> [junit] # An error report file with more information is saved as:
> [junit] # c:\Users\Jonathan\projects\cassandra\git\hs_err_pid95744.log
> [junit] #
> [junit] # If you would like to submit a bug report, please visit:
> [junit] #   http://java.sun.com/webapps/bugreport/crash.jsp
> [junit] #
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit]
> [junit] Testcase: org.apache.cassandra.streaming.StreamingTransferTest:testTransferTable:   Caused an ERROR
> [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit]
> [junit]
> [junit] Test org.apache.cassandra.streaming.StreamingTransferTest FAILED (crashed)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (CASSANDRA-3970) JVM crash in streamingTransferTest on Windows

Posted by "Jonathan Ellis (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis reassigned CASSANDRA-3970:
-----------------------------------------

    Assignee: Sylvain Lebresne
    
> JVM crash in streamingTransferTest on Windows
> ---------------------------------------------
>
>                 Key: CASSANDRA-3970
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3970
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jonathan Ellis
>            Assignee: Sylvain Lebresne
>             Fix For: 1.1.0
>
>         Attachments: hs_err_pid95744.log
>
>
> {noformat}
> $ ant test -Dtest.name=StreamingTransferTest
> ...
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] #
> [junit] # A fatal error has been detected by the Java Runtime Environment:
> [junit] #
> [junit] #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006da5ccca, pid=95744, tid=94924
> [junit] #
> [junit] # JRE version: 6.0_27-b07
> [junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode windows-amd64 compressed oops)
> [junit] # Problematic frame:
> [junit] # V  [jvm.dll+0x1cccca]
> [junit] #
> [junit] # An error report file with more information is saved as:
> [junit] # c:\Users\Jonathan\projects\cassandra\git\hs_err_pid95744.log
> [junit] #
> [junit] # If you would like to submit a bug report, please visit:
> [junit] #   http://java.sun.com/webapps/bugreport/crash.jsp
> [junit] #
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit]
> [junit] Testcase: org.apache.cassandra.streaming.StreamingTransferTest:testTransferTable:   Caused an ERROR
> [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit]
> [junit]
> [junit] Test org.apache.cassandra.streaming.StreamingTransferTest FAILED (crashed)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (CASSANDRA-3970) (100% reproducible) JVM crash in streamingTransferTest on Windows

Posted by "Jonathan Ellis (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis resolved CASSANDRA-3970.
---------------------------------------

       Resolution: Invalid
    Fix Version/s:     (was: 1.1.0)
         Assignee:     (was: Sylvain Lebresne)

Looks like you're right, with my second patch on CASSANDRA-3967 this doesn't happen.
                
> (100% reproducible) JVM crash in streamingTransferTest on Windows
> -----------------------------------------------------------------
>
>                 Key: CASSANDRA-3970
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3970
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jonathan Ellis
>         Attachments: hs_err_pid95744.log
>
>
> {noformat}
> $ ant test -Dtest.name=StreamingTransferTest
> ...
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] #
> [junit] # A fatal error has been detected by the Java Runtime Environment:
> [junit] #
> [junit] #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006da5ccca, pid=95744, tid=94924
> [junit] #
> [junit] # JRE version: 6.0_27-b07
> [junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode windows-amd64 compressed oops)
> [junit] # Problematic frame:
> [junit] # V  [jvm.dll+0x1cccca]
> [junit] #
> [junit] # An error report file with more information is saved as:
> [junit] # c:\Users\Jonathan\projects\cassandra\git\hs_err_pid95744.log
> [junit] #
> [junit] # If you would like to submit a bug report, please visit:
> [junit] #   http://java.sun.com/webapps/bugreport/crash.jsp
> [junit] #
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit]
> [junit] Testcase: org.apache.cassandra.streaming.StreamingTransferTest:testTransferTable:   Caused an ERROR
> [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit]
> [junit]
> [junit] Test org.apache.cassandra.streaming.StreamingTransferTest FAILED (crashed)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3970) (100% reproducible) JVM crash in streamingTransferTest on Windows

Posted by "Sylvain Lebresne (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218020#comment-13218020 ] 

Sylvain Lebresne commented on CASSANDRA-3970:
---------------------------------------------

I believe CASSANDRA-3967 actually create the error by making CFS.clearUnsafe() remove the sstable. The way the test work, it creates a sstable (inserting data the usual way then flushing), and then use clearUnsafe to unreference it. It then use streaming to transfer that now non-referenced sstable to the node (thus the sstable should *not* have be deleted from disk). It's arguably a bit of a hack to allow testing streaming in a single node setting and we could copy the initial sstable to a temporary location before calling clearUnsafe (but since it's not the only thing the patch for CASSANDRA-3967 breaks, let's first see what we do for CASSANDRA-3967). 
                
> (100% reproducible) JVM crash in streamingTransferTest on Windows
> -----------------------------------------------------------------
>
>                 Key: CASSANDRA-3970
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3970
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jonathan Ellis
>            Assignee: Sylvain Lebresne
>             Fix For: 1.1.0
>
>         Attachments: hs_err_pid95744.log
>
>
> {noformat}
> $ ant test -Dtest.name=StreamingTransferTest
> ...
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] #
> [junit] # A fatal error has been detected by the Java Runtime Environment:
> [junit] #
> [junit] #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006da5ccca, pid=95744, tid=94924
> [junit] #
> [junit] # JRE version: 6.0_27-b07
> [junit] # Java VM: Java HotSpot(TM) 64-Bit Server VM (20.2-b06 mixed mode windows-amd64 compressed oops)
> [junit] # Problematic frame:
> [junit] # V  [jvm.dll+0x1cccca]
> [junit] #
> [junit] # An error report file with more information is saved as:
> [junit] # c:\Users\Jonathan\projects\cassandra\git\hs_err_pid95744.log
> [junit] #
> [junit] # If you would like to submit a bug report, please visit:
> [junit] #   http://java.sun.com/webapps/bugreport/crash.jsp
> [junit] #
> [junit] Testsuite: org.apache.cassandra.streaming.StreamingTransferTest
> [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
> [junit]
> [junit] Testcase: org.apache.cassandra.streaming.StreamingTransferTest:testTransferTable:   Caused an ERROR
> [junit] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit]
> [junit]
> [junit] Test org.apache.cassandra.streaming.StreamingTransferTest FAILED (crashed)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira