You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Evgeniy Ryabitskiy <ev...@wikimart.ru> on 2011/09/05 17:04:04 UTC

UnavailableException while storing with EACH_QUORUM and RF=3

Hi,

I'am trying to store record with EACH_QUORUM consistency and RF=3. While
same thing with RF=2 is working.
Could some one tell me why EACH_QUORUM is working with RF=2 but not with RF
>=3

I have 7 nodes cluster. All nodes are UP.

Here is simple CLI script:

create keyspace kspace3
with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
and strategy_options = [{datacenter1:3}];

use kspace3;
create column family User with comparator = UTF8Type;

consistencylevel as LOCAL_QUORUM;
set User[1]['name'] = 'Smith';
consistencylevel as EACH_QUORUM;
set User[2]['name'] = 'Smith';
list User;


In result is only one record, EACH_QUORUM is failed:

[default@unknown] create keyspace kspace3
...    with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
...    and strategy_options = [{datacenter1:3}];
dd350870-d7ce-11e0-0000-5025568f27ff
Waiting for schema agreement...
... schemas agree across the cluster
[default@unknown]
[default@unknown] use kspace3;
Authenticated to keyspace: kspace3
[default@kspace3] create column family User with comparator = UTF8Type;
dd45f860-d7ce-11e0-0000-5025568f27ff
Waiting for schema agreement...
... schemas agree across the cluster
[default@kspace3]
[default@kspace3] consistencylevel as LOCAL_QUORUM;
Consistency level is set to 'LOCAL_QUORUM'.
[default@kspace3] set User[1]['name'] = 'Smith';
Value inserted.
[default@kspace3] consistencylevel as EACH_QUORUM;
Consistency level is set to 'EACH_QUORUM'.
[default@kspace3] set User[2]['name'] = 'Smith';
null
[default@kspace3] list User;
Using default limit of 100
-------------------
RowKey: 01
=> (column=name, value=536d697468, timestamp=1315234443834000)

1 Row Returned.


While same thing with RF=2 is working:

[default@kspace3] create keyspace kspace2
...    with placement_strategy =
'org.apache.cassandra.locator.NetworkTopologyStrategy'
...    and strategy_options = [{datacenter1:2}];
Keyspace already exists.
[default@kspace3]
[default@kspace3] use kspace2;
Authenticated to keyspace: kspace2
[default@kspace2] create column family User with comparator = UTF8Type;
User already exists in keyspace kspace2
[default@kspace2]
[default@kspace2] set User[1]['name'] = 'Smith';
Value inserted.
[default@kspace2] consistencylevel as EACH_QUORUM;
Consistency level is set to 'EACH_QUORUM'.
[default@kspace2] set User[2]['name'] = 'Smith';
Value inserted.
[default@kspace2] list User;
Using default limit of 100
-------------------
RowKey: 01
=> (column=name, value=536d697468, timestamp=1315234997189000)
-------------------
RowKey: 02
=> (column=name, value=536d697468, timestamp=1315234997198000)

2 Rows Returned.

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Evgeniy Ryabitskiy <ev...@wikimart.ru>.
One more thing, Cassandra version is 0.8.4.
And if I try same thing from Pelops(thrift), I get UnavailableException.

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Anthony Ikeda <an...@gmail.com>.
Thanks Jonathan.

On Tue, Sep 6, 2011 at 3:53 PM, Jonathan Ellis <jb...@gmail.com> wrote:

> It's linked from the vote thread:
>
> http://mail-archives.apache.org/mod_mbox/cassandra-dev/201109.mbox/%3CCAKkz8Q12k2o7ZM5Uy9hxNk7kYEsQidwcyXbq_uZFnA+YaTYXLA@mail.gmail.com%3E
>
> On Tue, Sep 6, 2011 at 5:41 PM, Anthony Ikeda
> <an...@gmail.com> wrote:
> > Do you have a link to the downloadable?
> > Anthony
> >
> > On Tue, Sep 6, 2011 at 3:38 PM, Anthony Ikeda <
> anthony.ikeda.dev@gmail.com>
> > wrote:
> >>
> >> Thanks Jonathan, I'll consult with the team.
> >> Anthony
> >>
> >> On Tue, Sep 6, 2011 at 3:34 PM, Jonathan Ellis <jb...@gmail.com>
> wrote:
> >>>
> >>> 0.8.5 is being voted on now on the dev list.  I'd encourage you to test
> >>> it.
> >>>
> >>> I do not recommend running trunk.
> >>>
> >>> On Tue, Sep 6, 2011 at 5:32 PM, Anthony Ikeda
> >>> <an...@gmail.com> wrote:
> >>> > Jonathan, do you know when 0.8.5 will be released? We are looking at
> a
> >>> > production deployment soon and this fix is something that we would
> >>> > need.
> >>> > Alternatively, what is the stability of the trunk for a production
> >>> > deployment.
> >>> > Anthony
> >>> > On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy
> >>> > <ev...@wikimart.ru> wrote:
> >>> >>
> >>> >> great thanks!
> >>> >>
> >>> >> Evgeny.
> >>> >
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Jonathan Ellis
> >>> Project Chair, Apache Cassandra
> >>> co-founder of DataStax, the source for professional Cassandra support
> >>> http://www.datastax.com
> >>
> >
> >
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of DataStax, the source for professional Cassandra support
> http://www.datastax.com
>

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Jonathan Ellis <jb...@gmail.com>.
It's linked from the vote thread:
http://mail-archives.apache.org/mod_mbox/cassandra-dev/201109.mbox/%3CCAKkz8Q12k2o7ZM5Uy9hxNk7kYEsQidwcyXbq_uZFnA+YaTYXLA@mail.gmail.com%3E

On Tue, Sep 6, 2011 at 5:41 PM, Anthony Ikeda
<an...@gmail.com> wrote:
> Do you have a link to the downloadable?
> Anthony
>
> On Tue, Sep 6, 2011 at 3:38 PM, Anthony Ikeda <an...@gmail.com>
> wrote:
>>
>> Thanks Jonathan, I'll consult with the team.
>> Anthony
>>
>> On Tue, Sep 6, 2011 at 3:34 PM, Jonathan Ellis <jb...@gmail.com> wrote:
>>>
>>> 0.8.5 is being voted on now on the dev list.  I'd encourage you to test
>>> it.
>>>
>>> I do not recommend running trunk.
>>>
>>> On Tue, Sep 6, 2011 at 5:32 PM, Anthony Ikeda
>>> <an...@gmail.com> wrote:
>>> > Jonathan, do you know when 0.8.5 will be released? We are looking at a
>>> > production deployment soon and this fix is something that we would
>>> > need.
>>> > Alternatively, what is the stability of the trunk for a production
>>> > deployment.
>>> > Anthony
>>> > On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy
>>> > <ev...@wikimart.ru> wrote:
>>> >>
>>> >> great thanks!
>>> >>
>>> >> Evgeny.
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Jonathan Ellis
>>> Project Chair, Apache Cassandra
>>> co-founder of DataStax, the source for professional Cassandra support
>>> http://www.datastax.com
>>
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Anthony Ikeda <an...@gmail.com>.
Do you have a link to the downloadable?

Anthony


On Tue, Sep 6, 2011 at 3:38 PM, Anthony Ikeda
<an...@gmail.com>wrote:

> Thanks Jonathan, I'll consult with the team.
>
> Anthony
>
>
> On Tue, Sep 6, 2011 at 3:34 PM, Jonathan Ellis <jb...@gmail.com> wrote:
>
>> 0.8.5 is being voted on now on the dev list.  I'd encourage you to test
>> it.
>>
>> I do not recommend running trunk.
>>
>> On Tue, Sep 6, 2011 at 5:32 PM, Anthony Ikeda
>> <an...@gmail.com> wrote:
>> > Jonathan, do you know when 0.8.5 will be released? We are looking at a
>> > production deployment soon and this fix is something that we would need.
>> > Alternatively, what is the stability of the trunk for a production
>> > deployment.
>> > Anthony
>> > On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy
>> > <ev...@wikimart.ru> wrote:
>> >>
>> >> great thanks!
>> >>
>> >> Evgeny.
>> >
>> >
>>
>>
>>
>> --
>> Jonathan Ellis
>> Project Chair, Apache Cassandra
>> co-founder of DataStax, the source for professional Cassandra support
>> http://www.datastax.com
>>
>
>

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Anthony Ikeda <an...@gmail.com>.
Thanks Jonathan, I'll consult with the team.

Anthony

On Tue, Sep 6, 2011 at 3:34 PM, Jonathan Ellis <jb...@gmail.com> wrote:

> 0.8.5 is being voted on now on the dev list.  I'd encourage you to test it.
>
> I do not recommend running trunk.
>
> On Tue, Sep 6, 2011 at 5:32 PM, Anthony Ikeda
> <an...@gmail.com> wrote:
> > Jonathan, do you know when 0.8.5 will be released? We are looking at a
> > production deployment soon and this fix is something that we would need.
> > Alternatively, what is the stability of the trunk for a production
> > deployment.
> > Anthony
> > On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy
> > <ev...@wikimart.ru> wrote:
> >>
> >> great thanks!
> >>
> >> Evgeny.
> >
> >
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of DataStax, the source for professional Cassandra support
> http://www.datastax.com
>

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Jonathan Ellis <jb...@gmail.com>.
0.8.5 is being voted on now on the dev list.  I'd encourage you to test it.

I do not recommend running trunk.

On Tue, Sep 6, 2011 at 5:32 PM, Anthony Ikeda
<an...@gmail.com> wrote:
> Jonathan, do you know when 0.8.5 will be released? We are looking at a
> production deployment soon and this fix is something that we would need.
> Alternatively, what is the stability of the trunk for a production
> deployment.
> Anthony
> On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy
> <ev...@wikimart.ru> wrote:
>>
>> great thanks!
>>
>> Evgeny.
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Anthony Ikeda <an...@gmail.com>.
Jonathan, do you know when 0.8.5 will be released? We are looking at a
production deployment soon and this fix is something that we would need.

Alternatively, what is the stability of the trunk for a production
deployment.

Anthony

On Mon, Sep 5, 2011 at 3:35 PM, Evgeniy Ryabitskiy <
evgeniy.ryabitskiy@wikimart.ru> wrote:

> great thanks!
>
> Evgeny.
>

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Evgeniy Ryabitskiy <ev...@wikimart.ru>.
great thanks!

Evgeny.

Re: UnavailableException while storing with EACH_QUORUM and RF=3

Posted by Jonathan Ellis <jb...@gmail.com>.
https://issues.apache.org/jira/browse/CASSANDRA-3082

On Mon, Sep 5, 2011 at 10:04 AM, Evgeniy Ryabitskiy
<ev...@wikimart.ru> wrote:
> Hi,
>
> I'am trying to store record with EACH_QUORUM consistency and RF=3. While
> same thing with RF=2 is working.
> Could some one tell me why EACH_QUORUM is working with RF=2 but not with RF
>>=3
>
> I have 7 nodes cluster. All nodes are UP.
>
> Here is simple CLI script:
>
> create keyspace kspace3
> with placement_strategy =
> 'org.apache.cassandra.locator.NetworkTopologyStrategy'
> and strategy_options = [{datacenter1:3}];
>
> use kspace3;
> create column family User with comparator = UTF8Type;
>
> consistencylevel as LOCAL_QUORUM;
> set User[1]['name'] = 'Smith';
> consistencylevel as EACH_QUORUM;
> set User[2]['name'] = 'Smith';
> list User;
>
>
> In result is only one record, EACH_QUORUM is failed:
>
> [default@unknown] create keyspace kspace3
> ...    with placement_strategy =
> 'org.apache.cassandra.locator.NetworkTopologyStrategy'
> ...    and strategy_options = [{datacenter1:3}];
> dd350870-d7ce-11e0-0000-5025568f27ff
> Waiting for schema agreement...
> ... schemas agree across the cluster
> [default@unknown]
> [default@unknown] use kspace3;
> Authenticated to keyspace: kspace3
> [default@kspace3] create column family User with comparator = UTF8Type;
> dd45f860-d7ce-11e0-0000-5025568f27ff
> Waiting for schema agreement...
> ... schemas agree across the cluster
> [default@kspace3]
> [default@kspace3] consistencylevel as LOCAL_QUORUM;
> Consistency level is set to 'LOCAL_QUORUM'.
> [default@kspace3] set User[1]['name'] = 'Smith';
> Value inserted.
> [default@kspace3] consistencylevel as EACH_QUORUM;
> Consistency level is set to 'EACH_QUORUM'.
> [default@kspace3] set User[2]['name'] = 'Smith';
> null
> [default@kspace3] list User;
> Using default limit of 100
> -------------------
> RowKey: 01
> => (column=name, value=536d697468, timestamp=1315234443834000)
>
> 1 Row Returned.
>
>
> While same thing with RF=2 is working:
>
> [default@kspace3] create keyspace kspace2
> ...    with placement_strategy =
> 'org.apache.cassandra.locator.NetworkTopologyStrategy'
> ...    and strategy_options = [{datacenter1:2}];
> Keyspace already exists.
> [default@kspace3]
> [default@kspace3] use kspace2;
> Authenticated to keyspace: kspace2
> [default@kspace2] create column family User with comparator = UTF8Type;
> User already exists in keyspace kspace2
> [default@kspace2]
> [default@kspace2] set User[1]['name'] = 'Smith';
> Value inserted.
> [default@kspace2] consistencylevel as EACH_QUORUM;
> Consistency level is set to 'EACH_QUORUM'.
> [default@kspace2] set User[2]['name'] = 'Smith';
> Value inserted.
> [default@kspace2] list User;
> Using default limit of 100
> -------------------
> RowKey: 01
> => (column=name, value=536d697468, timestamp=1315234997189000)
> -------------------
> RowKey: 02
> => (column=name, value=536d697468, timestamp=1315234997198000)
>
> 2 Rows Returned.
>
>
>
>
>
>



-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com