You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jason Harvey (JIRA)" <ji...@apache.org> on 2011/03/12 08:13:59 UTC

[jira] Created: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

NoSuchElement exception on node which is streaming a repair
-----------------------------------------------------------

                 Key: CASSANDRA-2316
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
             Project: Cassandra
          Issue Type: Bug
    Affects Versions: 0.7.3
            Reporter: Jason Harvey
            Priority: Minor


Running latest SVN snapshot of 0.7.

When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.

{code}
 INFO 23:43:44,358 Streaming to /10.251.166.15
ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
java.util.NoSuchElementException
        at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
        at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
        at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
        at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
        at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)
{code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis resolved CASSANDRA-2316.
---------------------------------------

    Resolution: Fixed
      Reviewer: stu
      Assignee: Jonathan Ellis  (was: Stu Hood)

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Jonathan Ellis
>              Labels: repair
>             Fix For: 0.7.5
>
>         Attachments: 2316-assert.txt
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2316:
--------------------------------------

    Attachment: 2316-assert.txt

proposed assert attached

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>         Attachments: 2316-assert.txt
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008094#comment-13008094 ] 

Stu Hood commented on CASSANDRA-2316:
-------------------------------------

"Invalid" ranges in the tree are ranges that need to be hashed. The idea was that the tree could be persisted between repair sessions, and ranges would be invalidated as writes arrived: then the validation compaction would only need to compact invalid ranges of the tree.

In the current implementation, the tree will only contain invalid ranges, since it is being created from scratch for every repair.

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2316:
--------------------------------------

    Reviewer: stuhood  (was: stu)

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Jonathan Ellis
>              Labels: repair
>             Fix For: 0.7.5
>
>         Attachments: 2316-assert.txt
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2316:
--------------------------------------

          Component/s: Core
             Priority: Major  (was: Minor)
    Affects Version/s:     (was: 0.7.3)
                       0.6
        Fix Version/s: 0.7.5

Looks like this dates back to 0.6.

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008291#comment-13008291 ] 

Jonathan Ellis commented on CASSANDRA-2316:
-------------------------------------------

Since we iterate over each key in the CF, order shouldn't actually matter should it?

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008096#comment-13008096 ] 

Stu Hood commented on CASSANDRA-2316:
-------------------------------------

I wonder if this is a keys-out-of-order problem?

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008367#comment-13008367 ] 

Stu Hood commented on CASSANDRA-2316:
-------------------------------------

Order matters, because there will be up to 2^16 invalid ranges. If keys arrive out of order we will consume ranges that should have contained keys, possibly leading us to consume all invalid ranges.

Either way, an assert that keys are arriving in order would be handy here.

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021593#comment-13021593 ] 

Hudson commented on CASSANDRA-2316:
-----------------------------------

Integrated in Cassandra-0.7 #447 (See [https://hudson.apache.org/hudson/job/Cassandra-0.7/447/])
    

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Jonathan Ellis
>              Labels: repair
>             Fix For: 0.7.5
>
>         Attachments: 2316-assert.txt
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Stu Hood (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021309#comment-13021309 ] 

Stu Hood commented on CASSANDRA-2316:
-------------------------------------

+1 For the assert.

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.6
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>              Labels: repair
>             Fix For: 0.7.5
>
>         Attachments: 2316-assert.txt
>
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Assigned: (CASSANDRA-2316) NoSuchElement exception on node which is streaming a repair

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis reassigned CASSANDRA-2316:
-----------------------------------------

    Assignee: Stu Hood

The loop in validator.add apparently assumes that _some_ range will contain any given row. But

- ranges is supposed to be "invalid" ranges not all ranges
- comments in validator.add say it is called for each row in the CF
- so any rows that are not part of an "invalid" range will cause this exception

So either my superficial understanding of what "invalid" ranges are is broken, or the comments are wrong, or I'm surprised we're not hitting this a lot more frequently.

> NoSuchElement exception on node which is streaming a repair
> -----------------------------------------------------------
>
>                 Key: CASSANDRA-2316
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2316
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.7.3
>            Reporter: Jason Harvey
>            Assignee: Stu Hood
>            Priority: Minor
>              Labels: repair
>
> Running latest SVN snapshot of 0.7.
> When I ran a repair on a node, that node's neighbor threw the following exception. Let me know what other info could be helpful.
> {code}
>  INFO 23:43:44,358 Streaming to /10.251.166.15
> ERROR 23:50:21,321 Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.util.NoSuchElementException
>         at com.google.common.collect.AbstractIterator.next(AbstractIterator.java:146)
>         at org.apache.cassandra.service.AntiEntropyService$Validator.add(AntiEntropyService.java:366)
>         at org.apache.cassandra.db.CompactionManager.doValidationCompaction(CompactionManager.java:825)
>         at org.apache.cassandra.db.CompactionManager.access$800(CompactionManager.java:56)
>         at org.apache.cassandra.db.CompactionManager$6.call(CompactionManager.java:358)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira