You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Todd Nine <to...@spidertracks.com> on 2011/01/24 06:22:09 UTC

Invalid token errors when all nodes appear to have tokens.

Hi all,
  I'm getting some strange invalid token errors.   I'm on Cassandra 0.7.0.
Using the JMX console, each node has a valid token.   Also, each node shows
as a live node in the cluster.  Any ideas why I'm getting this error?  I've
restarted the entire cluster and I can't seem to resolve the problem.  I'm
using 3 nodes, with a replication factor of 2 and simple replication
strategy with ByteOrder partitioning.

Thanks,
Todd


ERROR [pool-1-thread-891] 2011-01-24 05:04:35,664 Cassandra.java (line 3044)
Internal error processing batch_mutate
java.lang.RuntimeException: The provided key was not UTF8 encoded.
        at
org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:159)
        at
org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:36)
        at
org.apache.cassandra.service.StorageService.getNaturalEndpoints(StorageService.java:1337)
        at
org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:109)
        at
org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:412)
        at
org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:385)
        at
org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3036)
        at
org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2555)
        at
org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.nio.charset.MalformedInputException: Input length = 1
        at java.nio.charset.CoderResult.throwException(CoderResult.java:260)
        at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:781)
        at
org.apache.cassandra.utils.FBUtilities.decodeToUTF8(FBUtilities.java:510)
        at
org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:155)
        ... 11 more

Re: Invalid token errors when all nodes appear to have tokens.

Posted by Todd Nine <to...@spidertracks.com>.
Gah!  I can't believe I missed that.  I had 2 nodes that didn't have updated
attributes in chef.  They were using my old config with
OrderPreservingPartitioner.  Thanks for the help man, been starting at this
one for way too long.

On 24 January 2011 18:46, Jonathan Ellis <jb...@gmail.com> wrote:

> It sure seems to think it's using OPP and not BOP...
>
> On Sun, Jan 23, 2011 at 11:22 PM, Todd Nine <to...@spidertracks.com> wrote:
> > Hi all,
> >   I'm getting some strange invalid token errors.   I'm on Cassandra
> 0.7.0.
> > Using the JMX console, each node has a valid token.   Also, each node
> shows
> > as a live node in the cluster.  Any ideas why I'm getting this error?
> I've
> > restarted the entire cluster and I can't seem to resolve the problem.
> I'm
> > using 3 nodes, with a replication factor of 2 and simple replication
> > strategy with ByteOrder partitioning.
> >
> > Thanks,
> > Todd
> >
> >
> > ERROR [pool-1-thread-891] 2011-01-24 05:04:35,664 Cassandra.java (line
> 3044)
> > Internal error processing batch_mutate
> > java.lang.RuntimeException: The provided key was not UTF8 encoded.
> >         at
> >
> org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:159)
> >         at
> >
> org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:36)
> >         at
> >
> org.apache.cassandra.service.StorageService.getNaturalEndpoints(StorageService.java:1337)
> >         at
> > org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:109)
> >         at
> >
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:412)
> >         at
> >
> org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:385)
> >         at
> >
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3036)
> >         at
> >
> org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2555)
> >         at
> >
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
> >         at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> >         at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >         at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.nio.charset.MalformedInputException: Input length = 1
> >         at
> java.nio.charset.CoderResult.throwException(CoderResult.java:260)
> >         at
> java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:781)
> >         at
> > org.apache.cassandra.utils.FBUtilities.decodeToUTF8(FBUtilities.java:510)
> >         at
> >
> org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:155)
> >         ... 11 more
> >
> >
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>

Re: Invalid token errors when all nodes appear to have tokens.

Posted by Jonathan Ellis <jb...@gmail.com>.
It sure seems to think it's using OPP and not BOP...

On Sun, Jan 23, 2011 at 11:22 PM, Todd Nine <to...@spidertracks.com> wrote:
> Hi all,
>   I'm getting some strange invalid token errors.   I'm on Cassandra 0.7.0.
> Using the JMX console, each node has a valid token.   Also, each node shows
> as a live node in the cluster.  Any ideas why I'm getting this error?  I've
> restarted the entire cluster and I can't seem to resolve the problem.  I'm
> using 3 nodes, with a replication factor of 2 and simple replication
> strategy with ByteOrder partitioning.
>
> Thanks,
> Todd
>
>
> ERROR [pool-1-thread-891] 2011-01-24 05:04:35,664 Cassandra.java (line 3044)
> Internal error processing batch_mutate
> java.lang.RuntimeException: The provided key was not UTF8 encoded.
>         at
> org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:159)
>         at
> org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:36)
>         at
> org.apache.cassandra.service.StorageService.getNaturalEndpoints(StorageService.java:1337)
>         at
> org.apache.cassandra.service.StorageProxy.mutate(StorageProxy.java:109)
>         at
> org.apache.cassandra.thrift.CassandraServer.doInsert(CassandraServer.java:412)
>         at
> org.apache.cassandra.thrift.CassandraServer.batch_mutate(CassandraServer.java:385)
>         at
> org.apache.cassandra.thrift.Cassandra$Processor$batch_mutate.process(Cassandra.java:3036)
>         at
> org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2555)
>         at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:167)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.nio.charset.MalformedInputException: Input length = 1
>         at java.nio.charset.CoderResult.throwException(CoderResult.java:260)
>         at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:781)
>         at
> org.apache.cassandra.utils.FBUtilities.decodeToUTF8(FBUtilities.java:510)
>         at
> org.apache.cassandra.dht.OrderPreservingPartitioner.getToken(OrderPreservingPartitioner.java:155)
>         ... 11 more
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com