You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by mo...@gmail.com on 2009/07/14 08:14:46 UTC
one server or more servers?
I have 3 productions servers, is it better to
A. start the cassandra in one node and add other seeds later
or
B. Start cassandra in all the 3 nodes
if i do A, when i later add 2 nodes ,will cassandra pick up the other two
nodes and start distributing the loads fairly
Rephrasing the question, does cassandra do the dynamic networks properly
Thanks for the input
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Michael Greene <mi...@gmail.com>.
Cassandra borrows many concepts from Dynamo, and its paper describes
this well: http://s3.amazonaws.com/AllThingsDistributed/sosp/amazon-dynamo-sosp2007.pdf
http://wiki.apache.org/cassandra/DataModelAndOperations contains some
documentation that references block_for, but this documentation needs
to be expanded.
Michael
On Tue, Jul 14, 2009 at 9:33 AM, Matt Revelle<mr...@gmail.com> wrote:
> Is that documented anywhere? I've been wondering how block_for should be
> used...
>
> On Jul 14, 2009, at 10:26 AM, Jonathan Ellis wrote:
>
>> There are several interesting values you can pass to block_for:
>>
>> 0: fire-and-forget. minimizes latency when that is more important
>> than robustness
>> 1: wait for at least one node to fully ack the write before returning
>> (the other replicas will be finished in the background)
>> N/2 + 1, where N is the number of replicas: this is a quorum write;
>> combined with quorum reads, it means you can tolerate up to N - (N/2 +
>> 1) nodes failing before you can get inconsistent results. (which is
>> usually better than no results at all.)
>> N: guarantees consistent reads without having to wait for a quorum, so
>> you trade write latency and availability (since the write will fail if
>> one of the target nodes is down) for 100% consistency and reduced read
>> latency
>>
>> -Jonathan
>>
>> On Tue, Jul 14, 2009 at 9:18 AM, Mark Robson<ma...@gmail.com> wrote:
>>>
>>>
>>> 2009/7/14 Jonathan Ellis <jb...@gmail.com>
>>>>
>>>> On Tue, Jul 14, 2009 at 8:33 AM, Mark Robson<ma...@gmail.com> wrote:
>>>>>
>>>>> Cassandra doesn't provide the guarantees about the latest changes being
>>>>> available from any given node, so you can't really use it in such an
>>>>> application.
>>>>>
>>>>> I don't know if the "blocking" variants of the write operations make
>>>>> any
>>>>> more guarantees, if they do then it might be suitable.
>>>>
>>>> Yes, quorum write/read would work just fine here.
>>>
>>> Are those the type of writes which you get by setting the "block"
>>> parameter
>>> to 1?
>>>
>>> Mark
>>>
>
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Matt Revelle <mr...@gmail.com>.
Is that documented anywhere? I've been wondering how block_for should
be used...
On Jul 14, 2009, at 10:26 AM, Jonathan Ellis wrote:
> There are several interesting values you can pass to block_for:
>
> 0: fire-and-forget. minimizes latency when that is more important
> than robustness
> 1: wait for at least one node to fully ack the write before returning
> (the other replicas will be finished in the background)
> N/2 + 1, where N is the number of replicas: this is a quorum write;
> combined with quorum reads, it means you can tolerate up to N - (N/2 +
> 1) nodes failing before you can get inconsistent results. (which is
> usually better than no results at all.)
> N: guarantees consistent reads without having to wait for a quorum, so
> you trade write latency and availability (since the write will fail if
> one of the target nodes is down) for 100% consistency and reduced read
> latency
>
> -Jonathan
>
> On Tue, Jul 14, 2009 at 9:18 AM, Mark Robson<ma...@gmail.com> wrote:
>>
>>
>> 2009/7/14 Jonathan Ellis <jb...@gmail.com>
>>>
>>> On Tue, Jul 14, 2009 at 8:33 AM, Mark Robson<ma...@gmail.com>
>>> wrote:
>>>> Cassandra doesn't provide the guarantees about the latest changes
>>>> being
>>>> available from any given node, so you can't really use it in such
>>>> an
>>>> application.
>>>>
>>>> I don't know if the "blocking" variants of the write operations
>>>> make any
>>>> more guarantees, if they do then it might be suitable.
>>>
>>> Yes, quorum write/read would work just fine here.
>>
>> Are those the type of writes which you get by setting the "block"
>> parameter
>> to 1?
>>
>> Mark
>>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Vijay <vi...@gmail.com>.
Thanks Jonathan for the clarification... i still dont see a place where
write will fail when A Node goes down.... Just wanted to make sure my
concepts are right... coz I am building an application around quorum write's
and a non blocking read.
Regards,
</VJ>
On Fri, Jul 17, 2009 at 2:10 PM, Jonathan Ellis <jb...@gmail.com> wrote:
> tolerate node failures w/o losing
> availability.)
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Jonathan Ellis <jb...@gmail.com>.
On Fri, Jul 17, 2009 at 3:58 PM, Vijay<vi...@gmail.com> wrote:
> Still confused,
>
> If i have a Quorum Write with block for to be 3 and 2 of them are alive i
> will write to 3 nodes with HH right?
yes, but only 2 will be available for reads, so the 3rd can't count
towards fulfulling block_for.
the semantics of block_for on read (R) and write (W) are that you have
strong consistency if R + W >= N where N is number of replicas. (see
http://www.allthingsdistributed.com/2007/12/eventually_consistent.html)
For this to hold in cassandra, we need to provide consistency where
(for instance) W = N and R = 1. Remember that a HH write is not
available for reads. This means that we need to fail the write if we
can't write the full N replicas to the right nodes.
(This is why quorum write + quorum read is often a better tradeoff in
practice since you can tolerate node failures w/o losing
availability.)
-Jonathan
> During query it will fail if i only have block for to be 3?
>
> Regards,
> </VJ>
>
>
>
>
> On Fri, Jul 17, 2009 at 1:36 PM, Jonathan Ellis <jb...@gmail.com> wrote:
>>
>> ck_for to zero, then writes will indeed never fail
>> (unless the node the client is ta
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Vijay <vi...@gmail.com>.
Still confused,
If i have a Quorum Write with block for to be 3 and 2 of them are alive i
will write to 3 nodes with HH right?
During query it will fail if i only have block for to be 3?
Regards,
</VJ>
On Fri, Jul 17, 2009 at 1:36 PM, Jonathan Ellis <jb...@gmail.com> wrote:
> ck_for to zero, then writes will indeed never fail
> (unless the node the client is ta
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Jonathan Ellis <jb...@gmail.com>.
HH is a mechanism to reduce inconsistency, but a node holding a HH row
while waiting for the "right" node to recover won't be part of the
group that is queried for it (since it could be anywhere). So if you
set block_for to M and less than M of the actual replica destinations
are up, Cassandra will fail the write.
If you set block_for to zero, then writes will indeed never fail
(unless the node the client is talking to dies mid-action, of course).
-Jonathan
On Fri, Jul 17, 2009 at 3:01 PM, Vijay<vi...@gmail.com> wrote:
> "since the write will fail if one of the target nodes is down"
> I thought Hinted handoff will take care of this Right? Write will never fail
> insted it will write to another node right?
>
> correct me if i am wrong.
>
> Thanks and Regards,
> </VJ>
>
>
>
>
> On Tue, Jul 14, 2009 at 7:26 AM, Jonathan Ellis <jb...@gmail.com> wrote:
>>
>> N: guarantees consistent reads without having to wait for a quorum, so
>> you trade write latency and availability (since the write will fail if
>> one of the target nodes is down) for 100% consistency and reduced read
>> latency
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Vijay <vi...@gmail.com>.
"since the write will fail if one of the target nodes is down"
I thought Hinted handoff will take care of this Right? Write will never fail
insted it will write to another node right?
correct me if i am wrong.
Thanks and Regards,
</VJ>
On Tue, Jul 14, 2009 at 7:26 AM, Jonathan Ellis <jb...@gmail.com> wrote:
> N: guarantees consistent reads without having to wait for a quorum, so
> you trade write latency and availability (since the write will fail if
> one of the target nodes is down) for 100% consistency and reduced read
> latency
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Jonathan Ellis <jb...@gmail.com>.
There are several interesting values you can pass to block_for:
0: fire-and-forget. minimizes latency when that is more important
than robustness
1: wait for at least one node to fully ack the write before returning
(the other replicas will be finished in the background)
N/2 + 1, where N is the number of replicas: this is a quorum write;
combined with quorum reads, it means you can tolerate up to N - (N/2 +
1) nodes failing before you can get inconsistent results. (which is
usually better than no results at all.)
N: guarantees consistent reads without having to wait for a quorum, so
you trade write latency and availability (since the write will fail if
one of the target nodes is down) for 100% consistency and reduced read
latency
-Jonathan
On Tue, Jul 14, 2009 at 9:18 AM, Mark Robson<ma...@gmail.com> wrote:
>
>
> 2009/7/14 Jonathan Ellis <jb...@gmail.com>
>>
>> On Tue, Jul 14, 2009 at 8:33 AM, Mark Robson<ma...@gmail.com> wrote:
>> > Cassandra doesn't provide the guarantees about the latest changes being
>> > available from any given node, so you can't really use it in such an
>> > application.
>> >
>> > I don't know if the "blocking" variants of the write operations make any
>> > more guarantees, if they do then it might be suitable.
>>
>> Yes, quorum write/read would work just fine here.
>
> Are those the type of writes which you get by setting the "block" parameter
> to 1?
>
> Mark
>
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 Jonathan Ellis <jb...@gmail.com>
> On Tue, Jul 14, 2009 at 8:33 AM, Mark Robson<ma...@gmail.com> wrote:
> > Cassandra doesn't provide the guarantees about the latest changes being
> > available from any given node, so you can't really use it in such an
> > application.
> >
> > I don't know if the "blocking" variants of the write operations make any
> > more guarantees, if they do then it might be suitable.
>
> Yes, quorum write/read would work just fine here.
Are those the type of writes which you get by setting the "block" parameter
to 1?
Mark
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Jonathan Ellis <jb...@gmail.com>.
On Tue, Jul 14, 2009 at 8:33 AM, Mark Robson<ma...@gmail.com> wrote:
> Cassandra doesn't provide the guarantees about the latest changes being
> available from any given node, so you can't really use it in such an
> application.
>
> I don't know if the "blocking" variants of the write operations make any
> more guarantees, if they do then it might be suitable.
Yes, quorum write/read would work just fine here.
-Jonathan
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Johan Stuyts <j....@zybber.nl>.
> Cassandra doesn't provide the guarantees about the latest changes being
> available from any given node, so you can't really use it in such an
> application.
>
> I don't know if the "blocking" variants of the write operations make any
> more guarantees, if they do then it might be suitable.
I will look into this. Thanks for your help.
Regards,
Johan
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 Johan Stuyts <j....@zybber.nl>
> One of the purposes I want to use Cassandra for is custom HTTP session
> replication. Instead of storing the values in the session of the servlet
> container I want to store them individually using unique keys in Cassandra.
> I was hoping Cassandra would be fast enough for this.
Fast enough - yes. Consistent enough - probably not.
As it's a http session application, you really, really want writes to be
visible from anywhere immediately. If you're using it for authentication
(for example "keep me logged in for today" type function), then you'll need
to get the absolute latest value from the session.
The user will log on and expect to be logged on immediately, and be able to
switch to different web servers transparently without being asked to log on
again.
Cassandra doesn't provide the guarantees about the latest changes being
available from any given node, so you can't really use it in such an
application.
I don't know if the "blocking" variants of the write operations make any
more guarantees, if they do then it might be suitable.
Mark
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Johan Stuyts <j....@zybber.nl>.
> If you are not sure whether N will ever be reached, then you don't need
> to deploy Cassandra until you reach a point where you're sure it will be
> reached.
No, I am not sure I will even get past one, just hopeful.
> If your application's scale is planned (i.e. by management who do
> planning-type things) to exceed what you can reasonably get out of a
> conventional database (with or without various types of scale-out
> solution), then Cassandra might be the right solution for you.
I am not only interested in Cassandra because of its load balancing,
scaling and failover properties. If I understand correctly it is also an
extremely fast datastore. Wouldn't I save a lot of effort to design and
build a data access layer (sharding, replication and caching) by using
Cassandra?
One of the purposes I want to use Cassandra for is custom HTTP session
replication. Instead of storing the values in the session of the servlet
container I want to store them individually using unique keys in
Cassandra. I was hoping Cassandra would be fast enough for this.
> I feel that developing an application for Cassandra is a lot more
> difficult than a "traditional" database, ...
What is a lot more difficult to do using Cassandra? I intend to use a SQL
database for all the really important stuff (credentials and stuff
involving money), and use Cassandra for less important information. I
understand I have to think about doing things without transactions and
designing things to be idempotent.
Regards,
Johan
Re: Scaling from 1 to x (was: one server or more servers?)
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 Johan Stuyts <j....@zybber.nl>
> Is it unwise to use Cassandra in production if you use less than n servers?
> I.e. is it better to use another solution for <n servers and switch to
> Cassandra once n is reached?
If you are not sure whether N will ever be reached, then you don't need to
deploy Cassandra until you reach a point where you're sure it will be
reached.
If your application's scale is planned (i.e. by management who do
planning-type things) to exceed what you can reasonably get out of a
conventional database (with or without various types of scale-out solution),
then Cassandra might be the right solution for you.
I feel that developing an application for Cassandra is a lot more difficult
than a "traditional" database, and it's also a fairly immature product.
There are many drawbacks, such as lack of visibility of storage usage.
I think that Cassandra is likely to become a very compelling system for
large scale problems quite soon, but I don't think it's there yet.
Mark
Scaling from 1 to x (was: one server or more servers?)
Posted by Johan Stuyts <j....@zybber.nl>.
> 1. If you only have 3 production servers, Cassandra may not do much for
> you.
> You will probably only care if you have lots more servers. 3 servers is a
> reasonable minimum for a test / dev environment.
I suspect I will use 1 Cassandra-server when I start deploying my
application. I want to prevent having to change my application code when
the need arises to scale to x servers.
Is it unwise to use Cassandra in production if you use less than n
servers? I.e. is it better to use another solution for <n servers and
switch to Cassandra once n is reached?
Regards,
Johan Stuyts
Re: one server or more servers?
Posted by Jonathan Ellis <jb...@gmail.com>.
the new servers contact the seeds, not the other way around
On Tue, Jul 14, 2009 at 10:10 AM, <mo...@gmail.com> wrote:
> Mark and Jonathan
> I m lost here
> Dont we need to specify atleast the server ip address in the conf file. How
> would cassandra know which ips they are running in ie the other servers.
> I can see there is a way to specify seed but how would the seeds pick up the
> other servers if they do not know their ip address
> Also given the unlimited # of ips it cannot jus go thru each one of the ips
> and ping 7001
> Servers other than seeds are automatically picked up by the cluster when
> they start up; the nodes talk amongst themselves to figure out who's there.
> On Tue, Jul 14, 2009 at 8:06 AM, Mark Robson <ma...@gmail.com> wrote:
>>
>>
>> 2009/7/14 <mo...@gmail.com>
>>>
>>> How do we add servers other than Seeds as there is no such place in conf
>>> file
>>
>> Servers other than seeds are automatically picked up by the cluster when
>> they start up; the nodes talk amongst themselves to figure out who's there.
>>
>> Only the seeds need to be explicitly configured.
>>
>> This is a Good Thing :)
>>
>> Mark
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
Re: one server or more servers?
Posted by mo...@gmail.com.
genius - why didnt someone think of a p2p datastore before seems so
intuitive
On Tue, Jul 14, 2009 at 8:12 AM, Matt Revelle <mr...@gmail.com> wrote:
> Your new node will contact a seed.
>
> On Jul 14, 2009, at 11:10 AM, mobiledreamers@gmail.com wrote:
>
> Mark and JonathanI m lost here
>
> Dont we need to specify atleast the server ip address in the conf file.
> How would cassandra know which ips they are running in ie the other servers.
>
> I can see there is a way to specify seed but how would the seeds pick up
> the other servers if they do not know their ip address
>
> Also given the unlimited # of ips it cannot jus go thru each one of the ips
> and ping 7001
>
> *Servers other than seeds are automatically picked up by the cluster when
> they start up; the nodes talk amongst themselves to figure out who's there.
> *On Tue, Jul 14, 2009 at 8:06 AM, Mark Robson <ma...@gmail.com> wrote:
>
>>
>>
>> 2009/7/14 <mo...@gmail.com>
>>
>>> How do we add servers other than Seeds as there is no such place in conf
>>> file
>>
>>
>> Servers other than seeds are automatically picked up by the cluster when
>> they start up; the nodes talk amongst themselves to figure out who's there.
>>
>> Only the seeds need to be explicitly configured.
>>
>> This is a Good Thing :)
>>
>> Mark
>>
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
>
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Matt Revelle <mr...@gmail.com>.
Your new node will contact a seed.
On Jul 14, 2009, at 11:10 AM, mobiledreamers@gmail.com wrote:
> Mark and Jonathan
> I m lost here
>
> Dont we need to specify atleast the server ip address in the conf
> file. How would cassandra know which ips they are running in ie the
> other servers.
>
> I can see there is a way to specify seed but how would the seeds
> pick up the other servers if they do not know their ip address
>
> Also given the unlimited # of ips it cannot jus go thru each one of
> the ips and ping 7001
>
> Servers other than seeds are automatically picked up by the cluster
> when they start up; the nodes talk amongst themselves to figure out
> who's there.
> On Tue, Jul 14, 2009 at 8:06 AM, Mark Robson <ma...@gmail.com> wrote:
>
>
> 2009/7/14 <mo...@gmail.com>
> How do we add servers other than Seeds as there is no such place in
> conf file
>
> Servers other than seeds are automatically picked up by the cluster
> when they start up; the nodes talk amongst themselves to figure out
> who's there.
>
> Only the seeds need to be explicitly configured.
>
> This is a Good Thing :)
>
> Mark
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
Re: one server or more servers?
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 <mo...@gmail.com>
> thanks a lotmakes sense kinda like limewire, shareaza and gnutella
> networks
>
Yes Cassandra does some stuff that is similar to the file-sharing networks,
but it is intended for private use not on the public internet. I wouldn't
expose an instance to the internet or allow untrusted hosts to join a
cluster.
Mark
Re: one server or more servers?
Posted by mo...@gmail.com.
thanks a lotmakes sense kinda like limewire, shareaza and gnutella networks
On Tue, Jul 14, 2009 at 8:15 AM, Mark Robson <ma...@gmail.com> wrote:
>
>
> 2009/7/14 <mo...@gmail.com>
>
>> But since the other servers join the cluster?
>> is there a limitation of where reads/writes can go ie.,
>>
>> reads can go to all servers - seeds+nonseeds?
>>
>> writes can go only to seeds?
>>
>
> No, there is not.
>
> Reads and writes may go to any node, seed or not.
>
> The seeds are ONLY used for discovery of other nodes, not anything else.
>
> Mark
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 <mo...@gmail.com>
> But since the other servers join the cluster?
> is there a limitation of where reads/writes can go ie.,
>
> reads can go to all servers - seeds+nonseeds?
>
> writes can go only to seeds?
>
No, there is not.
Reads and writes may go to any node, seed or not.
The seeds are ONLY used for discovery of other nodes, not anything else.
Mark
Re: one server or more servers?
Posted by mo...@gmail.com.
But since the other servers join the cluster
is there a limitation of where reads/writes can go ie.,
reads can go to all servers - seeds+nonseeds
writes can go only to seeds
On Tue, Jul 14, 2009 at 8:11 AM, <mo...@gmail.com> wrote:
> i think i get it
> the other servers specify the seeds so they join the cluster
>
> On Tue, Jul 14, 2009 at 8:10 AM, <mo...@gmail.com> wrote:
>
>> Mark and JonathanI m lost here
>>
>> Dont we need to specify atleast the server ip address in the conf file.
>> How would cassandra know which ips they are running in ie the other servers.
>>
>> I can see there is a way to specify seed but how would the seeds pick up
>> the other servers if they do not know their ip address
>>
>> Also given the unlimited # of ips it cannot jus go thru each one of the
>> ips and ping 7001
>>
>> *Servers other than seeds are automatically picked up by the cluster when
>> they start up; the nodes talk amongst themselves to figure out who's there.
>> *
>> On Tue, Jul 14, 2009 at 8:06 AM, Mark Robson <ma...@gmail.com> wrote:
>>
>>>
>>>
>>> 2009/7/14 <mo...@gmail.com>
>>>
>>>> How do we add servers other than Seeds as there is no such place in conf
>>>> file
>>>
>>>
>>> Servers other than seeds are automatically picked up by the cluster when
>>> they start up; the nodes talk amongst themselves to figure out who's there.
>>>
>>> Only the seeds need to be explicitly configured.
>>>
>>> This is a Good Thing :)
>>>
>>> Mark
>>>
>>
>>
>>
>> --
>> Bidegg worlds best auction site
>> http://bidegg.com
>>
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by mo...@gmail.com.
i think i get it
the other servers specify the seeds so they join the cluster
On Tue, Jul 14, 2009 at 8:10 AM, <mo...@gmail.com> wrote:
> Mark and JonathanI m lost here
>
> Dont we need to specify atleast the server ip address in the conf file.
> How would cassandra know which ips they are running in ie the other servers.
>
> I can see there is a way to specify seed but how would the seeds pick up
> the other servers if they do not know their ip address
>
> Also given the unlimited # of ips it cannot jus go thru each one of the ips
> and ping 7001
>
> *Servers other than seeds are automatically picked up by the cluster when
> they start up; the nodes talk amongst themselves to figure out who's there.
> *
> On Tue, Jul 14, 2009 at 8:06 AM, Mark Robson <ma...@gmail.com> wrote:
>
>>
>>
>> 2009/7/14 <mo...@gmail.com>
>>
>>> How do we add servers other than Seeds as there is no such place in conf
>>> file
>>
>>
>> Servers other than seeds are automatically picked up by the cluster when
>> they start up; the nodes talk amongst themselves to figure out who's there.
>>
>> Only the seeds need to be explicitly configured.
>>
>> This is a Good Thing :)
>>
>> Mark
>>
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by mo...@gmail.com.
Mark and JonathanI m lost here
Dont we need to specify atleast the server ip address in the conf file. How
would cassandra know which ips they are running in ie the other servers.
I can see there is a way to specify seed but how would the seeds pick up the
other servers if they do not know their ip address
Also given the unlimited # of ips it cannot jus go thru each one of the ips
and ping 7001
*Servers other than seeds are automatically picked up by the cluster when
they start up; the nodes talk amongst themselves to figure out who's there.
*On Tue, Jul 14, 2009 at 8:06 AM, Mark Robson <ma...@gmail.com> wrote:
>
>
> 2009/7/14 <mo...@gmail.com>
>
>> How do we add servers other than Seeds as there is no such place in conf
>> file
>
>
> Servers other than seeds are automatically picked up by the cluster when
> they start up; the nodes talk amongst themselves to figure out who's there.
>
> Only the seeds need to be explicitly configured.
>
> This is a Good Thing :)
>
> Mark
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 <mo...@gmail.com>
> How do we add servers other than Seeds as there is no such place in conf
> file
Servers other than seeds are automatically picked up by the cluster when
they start up; the nodes talk amongst themselves to figure out who's there.
Only the seeds need to be explicitly configured.
This is a Good Thing :)
Mark
Re: one server or more servers?
Posted by Jonathan Ellis <jb...@gmail.com>.
gossip distributes the cluster status.
the seeds are there to be an initial contact point.
On Tue, Jul 14, 2009 at 10:04 AM, <mo...@gmail.com> wrote:
> Hey mark
> thanks for the detailed reply explaining the example of Seeds
>
> How do we add servers other than Seeds as there is no such place in conf
> file
>
> thanks
Re: one server or more servers?
Posted by mo...@gmail.com.
*2. All of your servers should have static IPs. You should make sure that at
least 2-3 of them are unlikely to go away, and put those in as seeds, the
other servers can come and go and change IP address etc.
I would set up 2-3 servers which I expected to be unlikely to go away (i.e.
they won't be taken out any time soon), and code their IPs into the seeds.
The other servers can use those to find each other.*
Hey mark
thanks for the detailed reply explaining the example of Seeds
How do we add servers other than Seeds as there is no such place in conf
file
thanks
On Tue, Jul 14, 2009 at 3:00 AM, Mark Robson <ma...@gmail.com> wrote:
>
>
> 2009/7/14 <mo...@gmail.com>
>
>> I have 3 productions servers, is it better to
>>
>> A. start the cassandra in one node and add other seeds later
>> or
>> B. Start cassandra in all the 3 nodes
>>
>> if i do A, when i later add 2 nodes ,will cassandra pick up the other two
>> nodes and start distributing the loads fairly
>
>
> My guess would be:
>
> 1. If you only have 3 production servers, Cassandra may not do much for
> you. You will probably only care if you have lots more servers. 3 servers is
> a reasonable minimum for a test / dev environment.
>
> 2. All of your servers should have static IPs. You should make sure that at
> least 2-3 of them are unlikely to go away, and put those in as seeds, the
> other servers can come and go and change IP address etc.
>
> I would set up 2-3 servers which I expected to be unlikely to go away (i.e.
> they won't be taken out any time soon), and code their IPs into the seeds.
> The other servers can use those to find each other.
>
> Also your ops team should then be aware, that if they get rid of those
> "seed" servers, at some point new boxes should be deployed to take over
> those IPs so there are always at least two actively running Cassandra, that
> way your other nodes can find one another.
>
> Having only one seed server would place a single point of failure, which
> you don't want.
>
> If you have a segmented network (e.g. routed, different racks, different
> datacentres with VPN between them etc), you could put two seeds in each
> segment, which would make discovery tolerant of a partition.
>
> But having said that, it's relatively inconvenient to have a large number
> of seeds as you'd need to keep deploying new config files to all your nodes.
>
> Mark
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Eric Evans <ee...@rackspace.com>.
On Wed, 2009-07-15 at 20:51 -0700, mobiledreamers@gmail.com wrote:
>
> cassandra]$ bin/nodeprobe -host 127.0.0.1 ring
> DEBUG - Loading settings from bin/../conf/storage-conf.xml
> Token(14446472026035954629218078815970965332) 1 0.0.0.0 |<--|
>
>
> none of the servers r picking up the ring -
> all 4 servers are on the seeds!
>
> how do i make them pick the other 4 in the ring should listen be made
> blank
> right now listen addres is 0.0.0.0
> <ListenAddress>0.0.0.0</ListenAddress>
You can't do this, it won't work. See
http://wiki.apache.org/cassandra/FAQ for the reason why.
--
Eric Evans
eevans@rackspace.com
Re: one server or more servers?
Posted by mo...@gmail.com.
cassandra]$ bin/nodeprobe -host 127.0.0.1 ring
DEBUG - Loading settings from bin/../conf/storage-conf.xml
Token(14446472026035954629218078815970965332) 1 0.0.0.0 |<--|
none of the servers r picking up the ring -
all 4 servers are on the seeds!
how do i make them pick the other 4 in the ring should listen be made blank
right now listen addres is 0.0.0.0
<ListenAddress>0.0.0.0</ListenAddress>
On Wed, Jul 15, 2009 at 8:49 PM, <mo...@gmail.com> wrote:
> bin/nodeprobe -host 127.0.0.1 ring
> DEBUG - Loading settings from bin/../conf/storage-conf.xml
> Token(24598770870836697279577556965837538135) 1 0.0.0.0 |<--|
>
>
> this means the ring is not working?
>
>
> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com> wrote:
>
>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
>> blank (auto-discover). Dunno if that has changed.
>>
>> Looks like this if you're successful:
>>
>> $ bin/nodeprobe --host 10.224.17.13 ring
>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
>> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
>> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>>
>> Evan
>>
>> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<mi...@gmail.com>
>> wrote:
>> > The port you're looking for is typically 8080, but if you only specify
>> > the host and not the port it shoudl work just fine.
>> >
>> > bin/nodeprobe -host localhost
>> >
>> > Michael
>> >
>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
>> >> bin]$ ./nodeprobe -host localhost -port 8888
>> >> Error connecting to remote JMX agent!
>> >> java.io.IOException: Failed to retrieve RMIServer stub:
>> >> javax.naming.CommunicationException [Root exception is
>> >> java.rmi.ConnectIOException: error during JRMP connection
>> establishment;
>> >> nested exception is:
>> >> java.io.EOFException]
>> >> at
>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
>> >> at
>> >>
>> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
>> >> at
>> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
>> >> at
>> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
>> >> at
>> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
>> >> Caused by: javax.naming.CommunicationException [Root exception is
>> >> java.rmi.ConnectIOException: error during JRMP connection
>> establishment;
>> >> nested exception is:
>> >> java.io.EOFException]
>> >> at
>> >>
>> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
>> >> at
>> >>
>> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
>> >> at javax.naming.InitialContext.lookup(InitialContext.java:409)
>> >> at
>> >>
>> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
>> >> at
>> >>
>> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
>> >> at
>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
>> >> ... 4 more
>> >> Caused by: java.rmi.ConnectIOException: error during JRMP connection
>> >> establishment; nested exception is:
>> >> java.io.EOFException
>> >> at
>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
>> >> at
>> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
>> >> at
>> >>
>> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
>> >> ... 9 more
>> >> Caused by: java.io.EOFException
>> >> at java.io.DataInputStream.readByte(DataInputStream.java:267)
>> >> at
>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
>> >> ... 13 more
>> >>
>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>> >>>
>> >>> port 7002 doesnt trying nodeprobe
>> >>>
>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>> >>> <an...@alumni.caltech.edu> wrote:
>> >>>>
>> >>>> Alternatively if you are using the 0.3 release you can point a
>> browser
>> >>>> at port 7002 of one of the boxes and should see all the nodes in the
>> >>>> list.
>> >>>>
>> >>>> -Anthony
>> >>>>
>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>> >>>> > You can use the nodeprobe utility in bin/ to contact each node and
>> >>>> > make sure they see the same information. Run it with no arguments
>> to
>> >>>> > see the commands you can pass it.
>> >>>> >
>> >>>> > There is also an open issue at
>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making
>> this a
>> >>>> > little more automatic (instead of having to run nodeprobe on each
>> node
>> >>>> > and check the results by hand, you can just pass in all the servers
>> >>>> > that you think should be able to see each other) but there's no
>> code
>> >>>> > for this yet.
>> >>>> >
>> >>>> > Michael
>> >>>> >
>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
>> >>>> > > Mark and Jonathan
>> >>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
>> >>>> > > how do i know all 4 are now part of the datastore
>> >>>> > > are there ways to test this
>> >>>> > > thanks a lot
>> >>>> > >
>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
>> >>>> > > wrote:
>> >>>> > >>
>> >>>> > >> 2009/7/14 <mo...@gmail.com>
>> >>>> > >>>
>> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not do
>> much
>> >>>> > >>> for
>> >>>> > >>> you. You will probably only care if you have lots more servers.
>> 3
>> >>>> > >>> servers is
>> >>>> > >>> a reasonable minimum for a test / dev environment
>> >>>> > >>> At How many servers does cassandra start really performing?
>> >>>> > >>> or how many servers is an ideal setup say for a game 10?
>> >>>> > >>
>> >>>> > >> It can use any number, three is probably a reasonable minimum, I
>> >>>> > >> don't
>> >>>> > >> know what the maximum is.
>> >>>> > >>
>> >>>> > >> If you have a small number of servers, there is probably no
>> reason
>> >>>> > >> to use
>> >>>> > >> Cassandra; you can more usefully use a conventional database
>> with
>> >>>> > >> replication or sharding.
>> >>>> > >>
>> >>>> > >> The reason you might want to use Cassandra is to scale writes a
>> lot,
>> >>>> > >> to
>> >>>> > >> levels you couldn't reach with more "conventional" databases.
>> >>>> > >>
>> >>>> > >> In all likelihood, an application would use Cassandra to store
>> >>>> > >> high-volume
>> >>>> > >> high-write data alongside a more conventional database to store
>> >>>> > >> smaller,
>> >>>> > >> less frequently changing stuff.
>> >>>> > >>
>> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
>> running
>> >>>> > >> on a
>> >>>> > >> homogenous cluster of dedicated servers with reasonable amounts
>> of
>> >>>> > >> memory /
>> >>>> > >> storage (But not necessarily high spec servers of CPU, IO speed
>> or
>> >>>> > >> internal
>> >>>> > >> redundancy).
>> >>>> > >>
>> >>>> > >> Once the load balancing is implemented in 0.5 (according to
>> current
>> >>>> > >> plans)
>> >>>> > >> it will become more useful for heterogenous environments.
>> >>>> > >>
>> >>>> > >> Mark
>> >>>> > >
>> >>>> > >
>> >>>> > >
>> >>>> > > --
>> >>>> > > Bidegg worlds best auction site
>> >>>> > > http://bidegg.com
>> >>>> > >
>> >>>>
>> >>>> --
>> >>>>
>> ------------------------------------------------------------------------
>> >>>> Anthony Molinaro <
>> anthonym@alumni.caltech.edu>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Bidegg worlds best auction site
>> >>> http://bidegg.com
>> >>
>> >>
>> >>
>> >> --
>> >> Bidegg worlds best auction site
>> >> http://bidegg.com
>> >>
>> >
>>
>>
>>
>> --
>> Evan Weaver
>>
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by mo...@gmail.com.
bin/nodeprobe -host 127.0.0.1 ring
DEBUG - Loading settings from bin/../conf/storage-conf.xml
Token(24598770870836697279577556965837538135) 1 0.0.0.0 |<--|
this means the ring is not working?
On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com> wrote:
> I sometimes have to use 127.0.0.1, at least when ListenAddress is
> blank (auto-discover). Dunno if that has changed.
>
> Looks like this if you're successful:
>
> $ bin/nodeprobe --host 10.224.17.13 ring
> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>
> Evan
>
> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<mi...@gmail.com>
> wrote:
> > The port you're looking for is typically 8080, but if you only specify
> > the host and not the port it shoudl work just fine.
> >
> > bin/nodeprobe -host localhost
> >
> > Michael
> >
> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
> >> bin]$ ./nodeprobe -host localhost -port 8888
> >> Error connecting to remote JMX agent!
> >> java.io.IOException: Failed to retrieve RMIServer stub:
> >> javax.naming.CommunicationException [Root exception is
> >> java.rmi.ConnectIOException: error during JRMP connection establishment;
> >> nested exception is:
> >> java.io.EOFException]
> >> at
> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> >> at
> >>
> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> >> at
> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
> >> at
> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
> >> at org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
> >> Caused by: javax.naming.CommunicationException [Root exception is
> >> java.rmi.ConnectIOException: error during JRMP connection establishment;
> >> nested exception is:
> >> java.io.EOFException]
> >> at
> >>
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> >> at
> >>
> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> >> at javax.naming.InitialContext.lookup(InitialContext.java:409)
> >> at
> >>
> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> >> at
> >>
> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> >> at
> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> >> ... 4 more
> >> Caused by: java.rmi.ConnectIOException: error during JRMP connection
> >> establishment; nested exception is:
> >> java.io.EOFException
> >> at
> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
> >> at
> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> >> at
> >>
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> >> ... 9 more
> >> Caused by: java.io.EOFException
> >> at java.io.DataInputStream.readByte(DataInputStream.java:267)
> >> at
> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
> >> ... 13 more
> >>
> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
> >>>
> >>> port 7002 doesnt trying nodeprobe
> >>>
> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
> >>> <an...@alumni.caltech.edu> wrote:
> >>>>
> >>>> Alternatively if you are using the 0.3 release you can point a browser
> >>>> at port 7002 of one of the boxes and should see all the nodes in the
> >>>> list.
> >>>>
> >>>> -Anthony
> >>>>
> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
> >>>> > You can use the nodeprobe utility in bin/ to contact each node and
> >>>> > make sure they see the same information. Run it with no arguments
> to
> >>>> > see the commands you can pass it.
> >>>> >
> >>>> > There is also an open issue at
> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this
> a
> >>>> > little more automatic (instead of having to run nodeprobe on each
> node
> >>>> > and check the results by hand, you can just pass in all the servers
> >>>> > that you think should be able to see each other) but there's no code
> >>>> > for this yet.
> >>>> >
> >>>> > Michael
> >>>> >
> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
> >>>> > > Mark and Jonathan
> >>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
> >>>> > > how do i know all 4 are now part of the datastore
> >>>> > > are there ways to test this
> >>>> > > thanks a lot
> >>>> > >
> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
> >>>> > > wrote:
> >>>> > >>
> >>>> > >> 2009/7/14 <mo...@gmail.com>
> >>>> > >>>
> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not do
> much
> >>>> > >>> for
> >>>> > >>> you. You will probably only care if you have lots more servers.
> 3
> >>>> > >>> servers is
> >>>> > >>> a reasonable minimum for a test / dev environment
> >>>> > >>> At How many servers does cassandra start really performing?
> >>>> > >>> or how many servers is an ideal setup say for a game 10?
> >>>> > >>
> >>>> > >> It can use any number, three is probably a reasonable minimum, I
> >>>> > >> don't
> >>>> > >> know what the maximum is.
> >>>> > >>
> >>>> > >> If you have a small number of servers, there is probably no
> reason
> >>>> > >> to use
> >>>> > >> Cassandra; you can more usefully use a conventional database with
> >>>> > >> replication or sharding.
> >>>> > >>
> >>>> > >> The reason you might want to use Cassandra is to scale writes a
> lot,
> >>>> > >> to
> >>>> > >> levels you couldn't reach with more "conventional" databases.
> >>>> > >>
> >>>> > >> In all likelihood, an application would use Cassandra to store
> >>>> > >> high-volume
> >>>> > >> high-write data alongside a more conventional database to store
> >>>> > >> smaller,
> >>>> > >> less frequently changing stuff.
> >>>> > >>
> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
> running
> >>>> > >> on a
> >>>> > >> homogenous cluster of dedicated servers with reasonable amounts
> of
> >>>> > >> memory /
> >>>> > >> storage (But not necessarily high spec servers of CPU, IO speed
> or
> >>>> > >> internal
> >>>> > >> redundancy).
> >>>> > >>
> >>>> > >> Once the load balancing is implemented in 0.5 (according to
> current
> >>>> > >> plans)
> >>>> > >> it will become more useful for heterogenous environments.
> >>>> > >>
> >>>> > >> Mark
> >>>> > >
> >>>> > >
> >>>> > >
> >>>> > > --
> >>>> > > Bidegg worlds best auction site
> >>>> > > http://bidegg.com
> >>>> > >
> >>>>
> >>>> --
> >>>>
> ------------------------------------------------------------------------
> >>>> Anthony Molinaro <
> anthonym@alumni.caltech.edu>
> >>>
> >>>
> >>>
> >>> --
> >>> Bidegg worlds best auction site
> >>> http://bidegg.com
> >>
> >>
> >>
> >> --
> >> Bidegg worlds best auction site
> >> http://bidegg.com
> >>
> >
>
>
>
> --
> Evan Weaver
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Chris Goffinet <go...@digg.com>.
Could you please use IRC instead of flooding the mailing list every
few minutes?
On Jul 15, 2009, at 11:49 PM, mobiledreamers@gmail.com wrote:
> if i make listenaddress blank
> i get in oneserver
> binding to 127.0.0.1
> in 2nd server
> sometimes to the ip address of the server
> in 3rd server
> WARN - Exception was generated at : 07/16/2009 02:39:37 on thread
> GMFD:1
> Network is unreachable
> java.net.SocketException: Network is unreachable
> at sun.nio.ch.DatagramChannelImpl.send0(Native Method)
> at
> sun
> .nio
> .ch
> .DatagramChannelImpl.sendFromNativeBuffer(DatagramChannelImpl.java:
> 319)
> at
> sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:299)
> at
> sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:268)
> at
> org.apache.cassandra.net.UdpConnection.write(UdpConnection.java:88)
> at
> org
> .apache
> .cassandra.net.MessagingService.sendUdpOneWay(MessagingService.java:
> 469)
> at
> org
> .apache
> .cassandra.gms.GossipDigestSynVerbHandler.doVerb(Gossiper.java:984)
> at
> org
> .apache
> .cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:44)
> at
> java
> .util
> .concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor
> $Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:636)
>
> On Wed, Jul 15, 2009 at 11:31 PM, <mo...@gmail.com> wrote:
> some one in the group said a min of 2 seeds is necessary.
>
> i ll set the listenAddress to blank
>
> but i think it might be a problem of ports being blocked by fedora
>
> Can someone please list the ports used by cassandra to access the
> outside seeds and find the ring network?
>
> And if there are any users using fedora - can you show me how to
> open those ports so cassandra can gossip its way into a ring network
>
> right now i have 4 island cassandra nodes :(
>
>
> On Wed, Jul 15, 2009 at 9:24 PM, Evan Weaver <ew...@gmail.com>
> wrote:
> Oh, yeah, definitely set ListenAddress to blank. 0.0.0.0 doesn't mean
> "all interfaces" for some reason I forget.
>
> Evan
>
> On Wed, Jul 15, 2009 at 9:23 PM, Evan Weaver<ew...@gmail.com> wrote:
> > Try with only one seed. Not every host has to be in the seeds.
> >
> > Evan
> >
> > On Wed, Jul 15, 2009 at 8:52 PM, <mo...@gmail.com> wrote:
> >> in Seeds
> >> can we specify domain name instead of ip address
> >> right now seeds is specifying ip address
> >>
> >> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com>
> wrote:
> >>>
> >>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
> >>> blank (auto-discover). Dunno if that has changed.
> >>>
> >>> Looks like this if you're successful:
> >>>
> >>> $ bin/nodeprobe --host 10.224.17.13 ring
> >>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |
> <--|
> >>> Token(106858063638814585506848525974047690568) 3 10.224.17.19
> | ^
> >>> Token(141130545721235451315477340120224986045) 3 10.224.17.14
> |-->|
> >>>
> >>> Evan
> >>>
> >>> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<michael.greene@gmail.com
> >
> >>> wrote:
> >>> > The port you're looking for is typically 8080, but if you only
> specify
> >>> > the host and not the port it shoudl work just fine.
> >>> >
> >>> > bin/nodeprobe -host localhost
> >>> >
> >>> > Michael
> >>> >
> >>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com>
> wrote:
> >>> >> bin]$ ./nodeprobe -host localhost -port 8888
> >>> >> Error connecting to remote JMX agent!
> >>> >> java.io.IOException: Failed to retrieve RMIServer stub:
> >>> >> javax.naming.CommunicationException [Root exception is
> >>> >> java.rmi.ConnectIOException: error during JRMP connection
> >>> >> establishment;
> >>> >> nested exception is:
> >>> >> java.io.EOFException]
> >>> >> at
> >>> >>
> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:
> 342)
> >>> >> at
> >>> >>
> >>> >>
> javax
> .management
> .remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> >>> >> at
> >>> >> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:
> 149)
> >>> >> at
> >>> >> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
> >>> >> at
> >>> >> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
> >>> >> Caused by: javax.naming.CommunicationException [Root
> exception is
> >>> >> java.rmi.ConnectIOException: error during JRMP connection
> >>> >> establishment;
> >>> >> nested exception is:
> >>> >> java.io.EOFException]
> >>> >> at
> >>> >>
> >>> >>
> com
> .sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:
> 118)
> >>> >> at
> >>> >>
> >>> >>
> com
> .sun
> .jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> >>> >> at
> javax.naming.InitialContext.lookup(InitialContext.java:409)
> >>> >> at
> >>> >>
> >>> >>
> javax
> .management
> .remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> >>> >> at
> >>> >>
> >>> >>
> javax
> .management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:
> 1871)
> >>> >> at
> >>> >>
> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:
> 276)
> >>> >> ... 4 more
> >>> >> Caused by: java.rmi.ConnectIOException: error during JRMP
> connection
> >>> >> establishment; nested exception is:
> >>> >> java.io.EOFException
> >>> >> at
> >>> >>
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
> >>> >> at
> >>> >>
> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> >>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:
> 340)
> >>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown
> Source)
> >>> >> at
> >>> >>
> >>> >>
> com
> .sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:
> 114)
> >>> >> ... 9 more
> >>> >> Caused by: java.io.EOFException
> >>> >> at
> java.io.DataInputStream.readByte(DataInputStream.java:267)
> >>> >> at
> >>> >>
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
> >>> >> ... 13 more
> >>> >>
> >>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com>
> wrote:
> >>> >>>
> >>> >>> port 7002 doesnt trying nodeprobe
> >>> >>>
> >>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
> >>> >>> <an...@alumni.caltech.edu> wrote:
> >>> >>>>
> >>> >>>> Alternatively if you are using the 0.3 release you can
> point a
> >>> >>>> browser
> >>> >>>> at port 7002 of one of the boxes and should see all the
> nodes in the
> >>> >>>> list.
> >>> >>>>
> >>> >>>> -Anthony
> >>> >>>>
> >>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene
> wrote:
> >>> >>>> > You can use the nodeprobe utility in bin/ to contact each
> node and
> >>> >>>> > make sure they see the same information. Run it with no
> arguments
> >>> >>>> > to
> >>> >>>> > see the commands you can pass it.
> >>> >>>> >
> >>> >>>> > There is also an open issue at
> >>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for
> making this
> >>> >>>> > a
> >>> >>>> > little more automatic (instead of having to run nodeprobe
> on each
> >>> >>>> > node
> >>> >>>> > and check the results by hand, you can just pass in all
> the servers
> >>> >>>> > that you think should be able to see each other) but
> there's no
> >>> >>>> > code
> >>> >>>> > for this yet.
> >>> >>>> >
> >>> >>>> > Michael
> >>> >>>> >
> >>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM,
> <mo...@gmail.com> wrote:
> >>> >>>> > > Mark and Jonathan
> >>> >>>> > > I have started cassandra on 4 servers with all 4 of
> them as seeds
> >>> >>>> > > how do i know all 4 are now part of the datastore
> >>> >>>> > > are there ways to test this
> >>> >>>> > > thanks a lot
> >>> >>>> > >
> >>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <markxr@gmail.com
> >
> >>> >>>> > > wrote:
> >>> >>>> > >>
> >>> >>>> > >> 2009/7/14 <mo...@gmail.com>
> >>> >>>> > >>>
> >>> >>>> > >>> 1. If you only have 3 production servers, Cassandra
> may not do
> >>> >>>> > >>> much
> >>> >>>> > >>> for
> >>> >>>> > >>> you. You will probably only care if you have lots
> more servers.
> >>> >>>> > >>> 3
> >>> >>>> > >>> servers is
> >>> >>>> > >>> a reasonable minimum for a test / dev environment
> >>> >>>> > >>> At How many servers does cassandra start really
> performing?
> >>> >>>> > >>> or how many servers is an ideal setup say for a game
> 10?
> >>> >>>> > >>
> >>> >>>> > >> It can use any number, three is probably a reasonable
> minimum, I
> >>> >>>> > >> don't
> >>> >>>> > >> know what the maximum is.
> >>> >>>> > >>
> >>> >>>> > >> If you have a small number of servers, there is
> probably no
> >>> >>>> > >> reason
> >>> >>>> > >> to use
> >>> >>>> > >> Cassandra; you can more usefully use a conventional
> database
> >>> >>>> > >> with
> >>> >>>> > >> replication or sharding.
> >>> >>>> > >>
> >>> >>>> > >> The reason you might want to use Cassandra is to scale
> writes a
> >>> >>>> > >> lot,
> >>> >>>> > >> to
> >>> >>>> > >> levels you couldn't reach with more "conventional"
> databases.
> >>> >>>> > >>
> >>> >>>> > >> In all likelihood, an application would use Cassandra
> to store
> >>> >>>> > >> high-volume
> >>> >>>> > >> high-write data alongside a more conventional database
> to store
> >>> >>>> > >> smaller,
> >>> >>>> > >> less frequently changing stuff.
> >>> >>>> > >>
> >>> >>>> > >> It appears to me that Cassandra 0.3 is only really
> useful if
> >>> >>>> > >> running
> >>> >>>> > >> on a
> >>> >>>> > >> homogenous cluster of dedicated servers with
> reasonable amounts
> >>> >>>> > >> of
> >>> >>>> > >> memory /
> >>> >>>> > >> storage (But not necessarily high spec servers of CPU,
> IO speed
> >>> >>>> > >> or
> >>> >>>> > >> internal
> >>> >>>> > >> redundancy).
> >>> >>>> > >>
> >>> >>>> > >> Once the load balancing is implemented in 0.5
> (according to
> >>> >>>> > >> current
> >>> >>>> > >> plans)
> >>> >>>> > >> it will become more useful for heterogenous
> environments.
> >>> >>>> > >>
> >>> >>>> > >> Mark
> >>> >>>> > >
> >>> >>>> > >
> >>> >>>> > >
> >>> >>>> > > --
> >>> >>>> > > Bidegg worlds best auction site
> >>> >>>> > > http://bidegg.com
> >>> >>>> > >
> >>> >>>>
> >>> >>>> --
> >>> >>>>
> >>> >>>>
> ------------------------------------------------------------------------
> >>> >>>> Anthony Molinaro
> >>> >>>> <an...@alumni.caltech.edu>
> >>> >>>
> >>> >>>
> >>> >>>
> >>> >>> --
> >>> >>> Bidegg worlds best auction site
> >>> >>> http://bidegg.com
> >>> >>
> >>> >>
> >>> >>
> >>> >> --
> >>> >> Bidegg worlds best auction site
> >>> >> http://bidegg.com
> >>> >>
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Evan Weaver
> >>
> >>
> >>
> >> --
> >> Bidegg worlds best auction site
> >> http://bidegg.com
> >>
> >
> >
> >
> > --
> > Evan Weaver
> >
>
>
>
> --
> Evan Weaver
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
Re: one server or more servers?
Posted by Jonathan Ellis <jb...@gmail.com>.
the FAQ talks about using listenaddress: http://wiki.apache.org/cassandra/FAQ
On Thu, Jul 16, 2009 at 1:49 AM, <mo...@gmail.com> wrote:
> if i make listenaddress blank
> i get in oneserver
> binding to 127.0.0.1
> in 2nd server
> sometimes to the ip address of the server
> in 3rd server
> WARN - Exception was generated at : 07/16/2009 02:39:37 on thread GMFD:1
> Network is unreachable
> java.net.SocketException: Network is unreachable
> at sun.nio.ch.DatagramChannelImpl.send0(Native Method)
> at
> sun.nio.ch.DatagramChannelImpl.sendFromNativeBuffer(DatagramChannelImpl.java:319)
> at sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:299)
> at sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:268)
> at
> org.apache.cassandra.net.UdpConnection.write(UdpConnection.java:88)
> at
> org.apache.cassandra.net.MessagingService.sendUdpOneWay(MessagingService.java:469)
> at
> org.apache.cassandra.gms.GossipDigestSynVerbHandler.doVerb(Gossiper.java:984)
> at
> org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:44)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:636)
>
> On Wed, Jul 15, 2009 at 11:31 PM, <mo...@gmail.com> wrote:
>>
>> some one in the group said a min of 2 seeds is necessary.
>>
>> i ll set the listenAddress to blank
>>
>> but i think it might be a problem of ports being blocked by fedora
>>
>> Can someone please list the ports used by cassandra to access the outside
>> seeds and find the ring network?
>>
>> And if there are any users using fedora - can you show me how to open
>> those ports so cassandra can gossip its way into a ring network
>>
>> right now i have 4 island cassandra nodes :(
>>
>> On Wed, Jul 15, 2009 at 9:24 PM, Evan Weaver <ew...@gmail.com> wrote:
>>>
>>> Oh, yeah, definitely set ListenAddress to blank. 0.0.0.0 doesn't mean
>>> "all interfaces" for some reason I forget.
>>>
>>> Evan
>>>
>>> On Wed, Jul 15, 2009 at 9:23 PM, Evan Weaver<ew...@gmail.com> wrote:
>>> > Try with only one seed. Not every host has to be in the seeds.
>>> >
>>> > Evan
>>> >
>>> > On Wed, Jul 15, 2009 at 8:52 PM, <mo...@gmail.com> wrote:
>>> >> in Seeds
>>> >> can we specify domain name instead of ip address
>>> >> right now seeds is specifying ip address
>>> >>
>>> >> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com>
>>> >> wrote:
>>> >>>
>>> >>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
>>> >>> blank (auto-discover). Dunno if that has changed.
>>> >>>
>>> >>> Looks like this if you're successful:
>>> >>>
>>> >>> $ bin/nodeprobe --host 10.224.17.13 ring
>>> >>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
>>> >>> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
>>> >>> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>>> >>>
>>> >>> Evan
>>> >>>
>>> >>> On Wed, Jul 15, 2009 at 4:24 PM, Michael
>>> >>> Greene<mi...@gmail.com>
>>> >>> wrote:
>>> >>> > The port you're looking for is typically 8080, but if you only
>>> >>> > specify
>>> >>> > the host and not the port it shoudl work just fine.
>>> >>> >
>>> >>> > bin/nodeprobe -host localhost
>>> >>> >
>>> >>> > Michael
>>> >>> >
>>> >>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
>>> >>> >> bin]$ ./nodeprobe -host localhost -port 8888
>>> >>> >> Error connecting to remote JMX agent!
>>> >>> >> java.io.IOException: Failed to retrieve RMIServer stub:
>>> >>> >> javax.naming.CommunicationException [Root exception is
>>> >>> >> java.rmi.ConnectIOException: error during JRMP connection
>>> >>> >> establishment;
>>> >>> >> nested exception is:
>>> >>> >> java.io.EOFException]
>>> >>> >> at
>>> >>> >>
>>> >>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
>>> >>> >> at
>>> >>> >>
>>> >>> >>
>>> >>> >> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
>>> >>> >> at
>>> >>> >> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
>>> >>> >> at
>>> >>> >> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
>>> >>> >> at
>>> >>> >> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
>>> >>> >> Caused by: javax.naming.CommunicationException [Root exception is
>>> >>> >> java.rmi.ConnectIOException: error during JRMP connection
>>> >>> >> establishment;
>>> >>> >> nested exception is:
>>> >>> >> java.io.EOFException]
>>> >>> >> at
>>> >>> >>
>>> >>> >>
>>> >>> >> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
>>> >>> >> at
>>> >>> >>
>>> >>> >>
>>> >>> >> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
>>> >>> >> at
>>> >>> >> javax.naming.InitialContext.lookup(InitialContext.java:409)
>>> >>> >> at
>>> >>> >>
>>> >>> >>
>>> >>> >> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
>>> >>> >> at
>>> >>> >>
>>> >>> >>
>>> >>> >> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
>>> >>> >> at
>>> >>> >>
>>> >>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
>>> >>> >> ... 4 more
>>> >>> >> Caused by: java.rmi.ConnectIOException: error during JRMP
>>> >>> >> connection
>>> >>> >> establishment; nested exception is:
>>> >>> >> java.io.EOFException
>>> >>> >> at
>>> >>> >>
>>> >>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
>>> >>> >> at
>>> >>> >>
>>> >>> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
>>> >>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
>>> >>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown
>>> >>> >> Source)
>>> >>> >> at
>>> >>> >>
>>> >>> >>
>>> >>> >> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
>>> >>> >> ... 9 more
>>> >>> >> Caused by: java.io.EOFException
>>> >>> >> at
>>> >>> >> java.io.DataInputStream.readByte(DataInputStream.java:267)
>>> >>> >> at
>>> >>> >>
>>> >>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
>>> >>> >> ... 13 more
>>> >>> >>
>>> >>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>>> >>> >>>
>>> >>> >>> port 7002 doesnt trying nodeprobe
>>> >>> >>>
>>> >>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>>> >>> >>> <an...@alumni.caltech.edu> wrote:
>>> >>> >>>>
>>> >>> >>>> Alternatively if you are using the 0.3 release you can point a
>>> >>> >>>> browser
>>> >>> >>>> at port 7002 of one of the boxes and should see all the nodes in
>>> >>> >>>> the
>>> >>> >>>> list.
>>> >>> >>>>
>>> >>> >>>> -Anthony
>>> >>> >>>>
>>> >>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>>> >>> >>>> > You can use the nodeprobe utility in bin/ to contact each node
>>> >>> >>>> > and
>>> >>> >>>> > make sure they see the same information. Run it with no
>>> >>> >>>> > arguments
>>> >>> >>>> > to
>>> >>> >>>> > see the commands you can pass it.
>>> >>> >>>> >
>>> >>> >>>> > There is also an open issue at
>>> >>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making
>>> >>> >>>> > this
>>> >>> >>>> > a
>>> >>> >>>> > little more automatic (instead of having to run nodeprobe on
>>> >>> >>>> > each
>>> >>> >>>> > node
>>> >>> >>>> > and check the results by hand, you can just pass in all the
>>> >>> >>>> > servers
>>> >>> >>>> > that you think should be able to see each other) but there's
>>> >>> >>>> > no
>>> >>> >>>> > code
>>> >>> >>>> > for this yet.
>>> >>> >>>> >
>>> >>> >>>> > Michael
>>> >>> >>>> >
>>> >>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com>
>>> >>> >>>> > wrote:
>>> >>> >>>> > > Mark and Jonathan
>>> >>> >>>> > > I have started cassandra on 4 servers with all 4 of them as
>>> >>> >>>> > > seeds
>>> >>> >>>> > > how do i know all 4 are now part of the datastore
>>> >>> >>>> > > are there ways to test this
>>> >>> >>>> > > thanks a lot
>>> >>> >>>> > >
>>> >>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson
>>> >>> >>>> > > <ma...@gmail.com>
>>> >>> >>>> > > wrote:
>>> >>> >>>> > >>
>>> >>> >>>> > >> 2009/7/14 <mo...@gmail.com>
>>> >>> >>>> > >>>
>>> >>> >>>> > >>> 1. If you only have 3 production servers, Cassandra may
>>> >>> >>>> > >>> not do
>>> >>> >>>> > >>> much
>>> >>> >>>> > >>> for
>>> >>> >>>> > >>> you. You will probably only care if you have lots more
>>> >>> >>>> > >>> servers.
>>> >>> >>>> > >>> 3
>>> >>> >>>> > >>> servers is
>>> >>> >>>> > >>> a reasonable minimum for a test / dev environment
>>> >>> >>>> > >>> At How many servers does cassandra start really
>>> >>> >>>> > >>> performing?
>>> >>> >>>> > >>> or how many servers is an ideal setup say for a game 10?
>>> >>> >>>> > >>
>>> >>> >>>> > >> It can use any number, three is probably a reasonable
>>> >>> >>>> > >> minimum, I
>>> >>> >>>> > >> don't
>>> >>> >>>> > >> know what the maximum is.
>>> >>> >>>> > >>
>>> >>> >>>> > >> If you have a small number of servers, there is probably no
>>> >>> >>>> > >> reason
>>> >>> >>>> > >> to use
>>> >>> >>>> > >> Cassandra; you can more usefully use a conventional
>>> >>> >>>> > >> database
>>> >>> >>>> > >> with
>>> >>> >>>> > >> replication or sharding.
>>> >>> >>>> > >>
>>> >>> >>>> > >> The reason you might want to use Cassandra is to scale
>>> >>> >>>> > >> writes a
>>> >>> >>>> > >> lot,
>>> >>> >>>> > >> to
>>> >>> >>>> > >> levels you couldn't reach with more "conventional"
>>> >>> >>>> > >> databases.
>>> >>> >>>> > >>
>>> >>> >>>> > >> In all likelihood, an application would use Cassandra to
>>> >>> >>>> > >> store
>>> >>> >>>> > >> high-volume
>>> >>> >>>> > >> high-write data alongside a more conventional database to
>>> >>> >>>> > >> store
>>> >>> >>>> > >> smaller,
>>> >>> >>>> > >> less frequently changing stuff.
>>> >>> >>>> > >>
>>> >>> >>>> > >> It appears to me that Cassandra 0.3 is only really useful
>>> >>> >>>> > >> if
>>> >>> >>>> > >> running
>>> >>> >>>> > >> on a
>>> >>> >>>> > >> homogenous cluster of dedicated servers with reasonable
>>> >>> >>>> > >> amounts
>>> >>> >>>> > >> of
>>> >>> >>>> > >> memory /
>>> >>> >>>> > >> storage (But not necessarily high spec servers of CPU, IO
>>> >>> >>>> > >> speed
>>> >>> >>>> > >> or
>>> >>> >>>> > >> internal
>>> >>> >>>> > >> redundancy).
>>> >>> >>>> > >>
>>> >>> >>>> > >> Once the load balancing is implemented in 0.5 (according to
>>> >>> >>>> > >> current
>>> >>> >>>> > >> plans)
>>> >>> >>>> > >> it will become more useful for heterogenous environments.
>>> >>> >>>> > >>
>>> >>> >>>> > >> Mark
>>> >>> >>>> > >
>>> >>> >>>> > >
>>> >>> >>>> > >
>>> >>> >>>> > > --
>>> >>> >>>> > > Bidegg worlds best auction site
>>> >>> >>>> > > http://bidegg.com
>>> >>> >>>> > >
>>> >>> >>>>
>>> >>> >>>> --
>>> >>> >>>>
>>> >>> >>>>
>>> >>> >>>> ------------------------------------------------------------------------
>>> >>> >>>> Anthony Molinaro
>>> >>> >>>> <an...@alumni.caltech.edu>
>>> >>> >>>
>>> >>> >>>
>>> >>> >>>
>>> >>> >>> --
>>> >>> >>> Bidegg worlds best auction site
>>> >>> >>> http://bidegg.com
>>> >>> >>
>>> >>> >>
>>> >>> >>
>>> >>> >> --
>>> >>> >> Bidegg worlds best auction site
>>> >>> >> http://bidegg.com
>>> >>> >>
>>> >>> >
>>> >>>
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Evan Weaver
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Bidegg worlds best auction site
>>> >> http://bidegg.com
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > Evan Weaver
>>> >
>>>
>>>
>>>
>>> --
>>> Evan Weaver
>>
>>
>>
>> --
>> Bidegg worlds best auction site
>> http://bidegg.com
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
Re: one server or more servers?
Posted by mo...@gmail.com.
if i make listenaddress blank
i get in oneserver
binding to 127.0.0.1
*in 2nd server*
sometimes to the ip address of the server
in 3rd server
WARN - Exception was generated at : 07/16/2009 02:39:37 on thread GMFD:1
Network is unreachable
java.net.SocketException: Network is unreachable
at sun.nio.ch.DatagramChannelImpl.send0(Native Method)
at
sun.nio.ch.DatagramChannelImpl.sendFromNativeBuffer(DatagramChannelImpl.java:319)
at sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:299)
at sun.nio.ch.DatagramChannelImpl.send(DatagramChannelImpl.java:268)
at
org.apache.cassandra.net.UdpConnection.write(UdpConnection.java:88)
at
org.apache.cassandra.net.MessagingService.sendUdpOneWay(MessagingService.java:469)
at
org.apache.cassandra.gms.GossipDigestSynVerbHandler.doVerb(Gossiper.java:984)
at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:44)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
On Wed, Jul 15, 2009 at 11:31 PM, <mo...@gmail.com> wrote:
> some one in the group said a min of 2 seeds is necessary.
>
> i ll set the listenAddress to blank
>
> but i think it might be a problem of ports being blocked by fedora
>
> Can someone please list the ports used by cassandra to access the outside
> seeds and find the ring network?
>
> And if there are any users using fedora - can you show me how to open those
> ports so cassandra can gossip its way into a ring network
>
> right now i have 4 island cassandra nodes :(
>
>
> On Wed, Jul 15, 2009 at 9:24 PM, Evan Weaver <ew...@gmail.com> wrote:
>
>> Oh, yeah, definitely set ListenAddress to blank. 0.0.0.0 doesn't mean
>> "all interfaces" for some reason I forget.
>>
>> Evan
>>
>> On Wed, Jul 15, 2009 at 9:23 PM, Evan Weaver<ew...@gmail.com> wrote:
>> > Try with only one seed. Not every host has to be in the seeds.
>> >
>> > Evan
>> >
>> > On Wed, Jul 15, 2009 at 8:52 PM, <mo...@gmail.com> wrote:
>> >> in Seeds
>> >> can we specify domain name instead of ip address
>> >> right now seeds is specifying ip address
>> >>
>> >> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com>
>> wrote:
>> >>>
>> >>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
>> >>> blank (auto-discover). Dunno if that has changed.
>> >>>
>> >>> Looks like this if you're successful:
>> >>>
>> >>> $ bin/nodeprobe --host 10.224.17.13 ring
>> >>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
>> >>> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
>> >>> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>> >>>
>> >>> Evan
>> >>>
>> >>> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<
>> michael.greene@gmail.com>
>> >>> wrote:
>> >>> > The port you're looking for is typically 8080, but if you only
>> specify
>> >>> > the host and not the port it shoudl work just fine.
>> >>> >
>> >>> > bin/nodeprobe -host localhost
>> >>> >
>> >>> > Michael
>> >>> >
>> >>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
>> >>> >> bin]$ ./nodeprobe -host localhost -port 8888
>> >>> >> Error connecting to remote JMX agent!
>> >>> >> java.io.IOException: Failed to retrieve RMIServer stub:
>> >>> >> javax.naming.CommunicationException [Root exception is
>> >>> >> java.rmi.ConnectIOException: error during JRMP connection
>> >>> >> establishment;
>> >>> >> nested exception is:
>> >>> >> java.io.EOFException]
>> >>> >> at
>> >>> >>
>> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
>> >>> >> at
>> >>> >>
>> >>> >>
>> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
>> >>> >> at
>> >>> >> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
>> >>> >> at
>> >>> >> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
>> >>> >> at
>> >>> >> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
>> >>> >> Caused by: javax.naming.CommunicationException [Root exception is
>> >>> >> java.rmi.ConnectIOException: error during JRMP connection
>> >>> >> establishment;
>> >>> >> nested exception is:
>> >>> >> java.io.EOFException]
>> >>> >> at
>> >>> >>
>> >>> >>
>> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
>> >>> >> at
>> >>> >>
>> >>> >>
>> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
>> >>> >> at
>> javax.naming.InitialContext.lookup(InitialContext.java:409)
>> >>> >> at
>> >>> >>
>> >>> >>
>> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
>> >>> >> at
>> >>> >>
>> >>> >>
>> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
>> >>> >> at
>> >>> >>
>> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
>> >>> >> ... 4 more
>> >>> >> Caused by: java.rmi.ConnectIOException: error during JRMP
>> connection
>> >>> >> establishment; nested exception is:
>> >>> >> java.io.EOFException
>> >>> >> at
>> >>> >>
>> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
>> >>> >> at
>> >>> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
>> >>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
>> >>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown
>> Source)
>> >>> >> at
>> >>> >>
>> >>> >>
>> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
>> >>> >> ... 9 more
>> >>> >> Caused by: java.io.EOFException
>> >>> >> at
>> java.io.DataInputStream.readByte(DataInputStream.java:267)
>> >>> >> at
>> >>> >>
>> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
>> >>> >> ... 13 more
>> >>> >>
>> >>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>> >>> >>>
>> >>> >>> port 7002 doesnt trying nodeprobe
>> >>> >>>
>> >>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>> >>> >>> <an...@alumni.caltech.edu> wrote:
>> >>> >>>>
>> >>> >>>> Alternatively if you are using the 0.3 release you can point a
>> >>> >>>> browser
>> >>> >>>> at port 7002 of one of the boxes and should see all the nodes in
>> the
>> >>> >>>> list.
>> >>> >>>>
>> >>> >>>> -Anthony
>> >>> >>>>
>> >>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>> >>> >>>> > You can use the nodeprobe utility in bin/ to contact each node
>> and
>> >>> >>>> > make sure they see the same information. Run it with no
>> arguments
>> >>> >>>> > to
>> >>> >>>> > see the commands you can pass it.
>> >>> >>>> >
>> >>> >>>> > There is also an open issue at
>> >>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making
>> this
>> >>> >>>> > a
>> >>> >>>> > little more automatic (instead of having to run nodeprobe on
>> each
>> >>> >>>> > node
>> >>> >>>> > and check the results by hand, you can just pass in all the
>> servers
>> >>> >>>> > that you think should be able to see each other) but there's no
>> >>> >>>> > code
>> >>> >>>> > for this yet.
>> >>> >>>> >
>> >>> >>>> > Michael
>> >>> >>>> >
>> >>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com>
>> wrote:
>> >>> >>>> > > Mark and Jonathan
>> >>> >>>> > > I have started cassandra on 4 servers with all 4 of them as
>> seeds
>> >>> >>>> > > how do i know all 4 are now part of the datastore
>> >>> >>>> > > are there ways to test this
>> >>> >>>> > > thanks a lot
>> >>> >>>> > >
>> >>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <
>> markxr@gmail.com>
>> >>> >>>> > > wrote:
>> >>> >>>> > >>
>> >>> >>>> > >> 2009/7/14 <mo...@gmail.com>
>> >>> >>>> > >>>
>> >>> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not
>> do
>> >>> >>>> > >>> much
>> >>> >>>> > >>> for
>> >>> >>>> > >>> you. You will probably only care if you have lots more
>> servers.
>> >>> >>>> > >>> 3
>> >>> >>>> > >>> servers is
>> >>> >>>> > >>> a reasonable minimum for a test / dev environment
>> >>> >>>> > >>> At How many servers does cassandra start really performing?
>> >>> >>>> > >>> or how many servers is an ideal setup say for a game 10?
>> >>> >>>> > >>
>> >>> >>>> > >> It can use any number, three is probably a reasonable
>> minimum, I
>> >>> >>>> > >> don't
>> >>> >>>> > >> know what the maximum is.
>> >>> >>>> > >>
>> >>> >>>> > >> If you have a small number of servers, there is probably no
>> >>> >>>> > >> reason
>> >>> >>>> > >> to use
>> >>> >>>> > >> Cassandra; you can more usefully use a conventional database
>> >>> >>>> > >> with
>> >>> >>>> > >> replication or sharding.
>> >>> >>>> > >>
>> >>> >>>> > >> The reason you might want to use Cassandra is to scale
>> writes a
>> >>> >>>> > >> lot,
>> >>> >>>> > >> to
>> >>> >>>> > >> levels you couldn't reach with more "conventional"
>> databases.
>> >>> >>>> > >>
>> >>> >>>> > >> In all likelihood, an application would use Cassandra to
>> store
>> >>> >>>> > >> high-volume
>> >>> >>>> > >> high-write data alongside a more conventional database to
>> store
>> >>> >>>> > >> smaller,
>> >>> >>>> > >> less frequently changing stuff.
>> >>> >>>> > >>
>> >>> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
>> >>> >>>> > >> running
>> >>> >>>> > >> on a
>> >>> >>>> > >> homogenous cluster of dedicated servers with reasonable
>> amounts
>> >>> >>>> > >> of
>> >>> >>>> > >> memory /
>> >>> >>>> > >> storage (But not necessarily high spec servers of CPU, IO
>> speed
>> >>> >>>> > >> or
>> >>> >>>> > >> internal
>> >>> >>>> > >> redundancy).
>> >>> >>>> > >>
>> >>> >>>> > >> Once the load balancing is implemented in 0.5 (according to
>> >>> >>>> > >> current
>> >>> >>>> > >> plans)
>> >>> >>>> > >> it will become more useful for heterogenous environments.
>> >>> >>>> > >>
>> >>> >>>> > >> Mark
>> >>> >>>> > >
>> >>> >>>> > >
>> >>> >>>> > >
>> >>> >>>> > > --
>> >>> >>>> > > Bidegg worlds best auction site
>> >>> >>>> > > http://bidegg.com
>> >>> >>>> > >
>> >>> >>>>
>> >>> >>>> --
>> >>> >>>>
>> >>> >>>>
>> ------------------------------------------------------------------------
>> >>> >>>> Anthony Molinaro
>> >>> >>>> <an...@alumni.caltech.edu>
>> >>> >>>
>> >>> >>>
>> >>> >>>
>> >>> >>> --
>> >>> >>> Bidegg worlds best auction site
>> >>> >>> http://bidegg.com
>> >>> >>
>> >>> >>
>> >>> >>
>> >>> >> --
>> >>> >> Bidegg worlds best auction site
>> >>> >> http://bidegg.com
>> >>> >>
>> >>> >
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Evan Weaver
>> >>
>> >>
>> >>
>> >> --
>> >> Bidegg worlds best auction site
>> >> http://bidegg.com
>> >>
>> >
>> >
>> >
>> > --
>> > Evan Weaver
>> >
>>
>>
>>
>> --
>> Evan Weaver
>>
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by mo...@gmail.com.
some one in the group said a min of 2 seeds is necessary.
i ll set the listenAddress to blank
but i think it might be a problem of ports being blocked by fedora
Can someone please list the ports used by cassandra to access the outside
seeds and find the ring network?
And if there are any users using fedora - can you show me how to open those
ports so cassandra can gossip its way into a ring network
right now i have 4 island cassandra nodes :(
On Wed, Jul 15, 2009 at 9:24 PM, Evan Weaver <ew...@gmail.com> wrote:
> Oh, yeah, definitely set ListenAddress to blank. 0.0.0.0 doesn't mean
> "all interfaces" for some reason I forget.
>
> Evan
>
> On Wed, Jul 15, 2009 at 9:23 PM, Evan Weaver<ew...@gmail.com> wrote:
> > Try with only one seed. Not every host has to be in the seeds.
> >
> > Evan
> >
> > On Wed, Jul 15, 2009 at 8:52 PM, <mo...@gmail.com> wrote:
> >> in Seeds
> >> can we specify domain name instead of ip address
> >> right now seeds is specifying ip address
> >>
> >> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com> wrote:
> >>>
> >>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
> >>> blank (auto-discover). Dunno if that has changed.
> >>>
> >>> Looks like this if you're successful:
> >>>
> >>> $ bin/nodeprobe --host 10.224.17.13 ring
> >>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
> >>> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
> >>> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
> >>>
> >>> Evan
> >>>
> >>> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<
> michael.greene@gmail.com>
> >>> wrote:
> >>> > The port you're looking for is typically 8080, but if you only
> specify
> >>> > the host and not the port it shoudl work just fine.
> >>> >
> >>> > bin/nodeprobe -host localhost
> >>> >
> >>> > Michael
> >>> >
> >>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
> >>> >> bin]$ ./nodeprobe -host localhost -port 8888
> >>> >> Error connecting to remote JMX agent!
> >>> >> java.io.IOException: Failed to retrieve RMIServer stub:
> >>> >> javax.naming.CommunicationException [Root exception is
> >>> >> java.rmi.ConnectIOException: error during JRMP connection
> >>> >> establishment;
> >>> >> nested exception is:
> >>> >> java.io.EOFException]
> >>> >> at
> >>> >>
> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> >>> >> at
> >>> >>
> >>> >>
> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> >>> >> at
> >>> >> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
> >>> >> at
> >>> >> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
> >>> >> at
> >>> >> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
> >>> >> Caused by: javax.naming.CommunicationException [Root exception is
> >>> >> java.rmi.ConnectIOException: error during JRMP connection
> >>> >> establishment;
> >>> >> nested exception is:
> >>> >> java.io.EOFException]
> >>> >> at
> >>> >>
> >>> >>
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> >>> >> at
> >>> >>
> >>> >>
> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> >>> >> at
> javax.naming.InitialContext.lookup(InitialContext.java:409)
> >>> >> at
> >>> >>
> >>> >>
> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> >>> >> at
> >>> >>
> >>> >>
> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> >>> >> at
> >>> >>
> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> >>> >> ... 4 more
> >>> >> Caused by: java.rmi.ConnectIOException: error during JRMP connection
> >>> >> establishment; nested exception is:
> >>> >> java.io.EOFException
> >>> >> at
> >>> >>
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
> >>> >> at
> >>> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> >>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> >>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> >>> >> at
> >>> >>
> >>> >>
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> >>> >> ... 9 more
> >>> >> Caused by: java.io.EOFException
> >>> >> at
> java.io.DataInputStream.readByte(DataInputStream.java:267)
> >>> >> at
> >>> >>
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
> >>> >> ... 13 more
> >>> >>
> >>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
> >>> >>>
> >>> >>> port 7002 doesnt trying nodeprobe
> >>> >>>
> >>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
> >>> >>> <an...@alumni.caltech.edu> wrote:
> >>> >>>>
> >>> >>>> Alternatively if you are using the 0.3 release you can point a
> >>> >>>> browser
> >>> >>>> at port 7002 of one of the boxes and should see all the nodes in
> the
> >>> >>>> list.
> >>> >>>>
> >>> >>>> -Anthony
> >>> >>>>
> >>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
> >>> >>>> > You can use the nodeprobe utility in bin/ to contact each node
> and
> >>> >>>> > make sure they see the same information. Run it with no
> arguments
> >>> >>>> > to
> >>> >>>> > see the commands you can pass it.
> >>> >>>> >
> >>> >>>> > There is also an open issue at
> >>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making
> this
> >>> >>>> > a
> >>> >>>> > little more automatic (instead of having to run nodeprobe on
> each
> >>> >>>> > node
> >>> >>>> > and check the results by hand, you can just pass in all the
> servers
> >>> >>>> > that you think should be able to see each other) but there's no
> >>> >>>> > code
> >>> >>>> > for this yet.
> >>> >>>> >
> >>> >>>> > Michael
> >>> >>>> >
> >>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com>
> wrote:
> >>> >>>> > > Mark and Jonathan
> >>> >>>> > > I have started cassandra on 4 servers with all 4 of them as
> seeds
> >>> >>>> > > how do i know all 4 are now part of the datastore
> >>> >>>> > > are there ways to test this
> >>> >>>> > > thanks a lot
> >>> >>>> > >
> >>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <
> markxr@gmail.com>
> >>> >>>> > > wrote:
> >>> >>>> > >>
> >>> >>>> > >> 2009/7/14 <mo...@gmail.com>
> >>> >>>> > >>>
> >>> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not
> do
> >>> >>>> > >>> much
> >>> >>>> > >>> for
> >>> >>>> > >>> you. You will probably only care if you have lots more
> servers.
> >>> >>>> > >>> 3
> >>> >>>> > >>> servers is
> >>> >>>> > >>> a reasonable minimum for a test / dev environment
> >>> >>>> > >>> At How many servers does cassandra start really performing?
> >>> >>>> > >>> or how many servers is an ideal setup say for a game 10?
> >>> >>>> > >>
> >>> >>>> > >> It can use any number, three is probably a reasonable
> minimum, I
> >>> >>>> > >> don't
> >>> >>>> > >> know what the maximum is.
> >>> >>>> > >>
> >>> >>>> > >> If you have a small number of servers, there is probably no
> >>> >>>> > >> reason
> >>> >>>> > >> to use
> >>> >>>> > >> Cassandra; you can more usefully use a conventional database
> >>> >>>> > >> with
> >>> >>>> > >> replication or sharding.
> >>> >>>> > >>
> >>> >>>> > >> The reason you might want to use Cassandra is to scale writes
> a
> >>> >>>> > >> lot,
> >>> >>>> > >> to
> >>> >>>> > >> levels you couldn't reach with more "conventional" databases.
> >>> >>>> > >>
> >>> >>>> > >> In all likelihood, an application would use Cassandra to
> store
> >>> >>>> > >> high-volume
> >>> >>>> > >> high-write data alongside a more conventional database to
> store
> >>> >>>> > >> smaller,
> >>> >>>> > >> less frequently changing stuff.
> >>> >>>> > >>
> >>> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
> >>> >>>> > >> running
> >>> >>>> > >> on a
> >>> >>>> > >> homogenous cluster of dedicated servers with reasonable
> amounts
> >>> >>>> > >> of
> >>> >>>> > >> memory /
> >>> >>>> > >> storage (But not necessarily high spec servers of CPU, IO
> speed
> >>> >>>> > >> or
> >>> >>>> > >> internal
> >>> >>>> > >> redundancy).
> >>> >>>> > >>
> >>> >>>> > >> Once the load balancing is implemented in 0.5 (according to
> >>> >>>> > >> current
> >>> >>>> > >> plans)
> >>> >>>> > >> it will become more useful for heterogenous environments.
> >>> >>>> > >>
> >>> >>>> > >> Mark
> >>> >>>> > >
> >>> >>>> > >
> >>> >>>> > >
> >>> >>>> > > --
> >>> >>>> > > Bidegg worlds best auction site
> >>> >>>> > > http://bidegg.com
> >>> >>>> > >
> >>> >>>>
> >>> >>>> --
> >>> >>>>
> >>> >>>>
> ------------------------------------------------------------------------
> >>> >>>> Anthony Molinaro
> >>> >>>> <an...@alumni.caltech.edu>
> >>> >>>
> >>> >>>
> >>> >>>
> >>> >>> --
> >>> >>> Bidegg worlds best auction site
> >>> >>> http://bidegg.com
> >>> >>
> >>> >>
> >>> >>
> >>> >> --
> >>> >> Bidegg worlds best auction site
> >>> >> http://bidegg.com
> >>> >>
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> Evan Weaver
> >>
> >>
> >>
> >> --
> >> Bidegg worlds best auction site
> >> http://bidegg.com
> >>
> >
> >
> >
> > --
> > Evan Weaver
> >
>
>
>
> --
> Evan Weaver
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Evan Weaver <ew...@gmail.com>.
Oh, yeah, definitely set ListenAddress to blank. 0.0.0.0 doesn't mean
"all interfaces" for some reason I forget.
Evan
On Wed, Jul 15, 2009 at 9:23 PM, Evan Weaver<ew...@gmail.com> wrote:
> Try with only one seed. Not every host has to be in the seeds.
>
> Evan
>
> On Wed, Jul 15, 2009 at 8:52 PM, <mo...@gmail.com> wrote:
>> in Seeds
>> can we specify domain name instead of ip address
>> right now seeds is specifying ip address
>>
>> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com> wrote:
>>>
>>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
>>> blank (auto-discover). Dunno if that has changed.
>>>
>>> Looks like this if you're successful:
>>>
>>> $ bin/nodeprobe --host 10.224.17.13 ring
>>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
>>> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
>>> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>>>
>>> Evan
>>>
>>> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<mi...@gmail.com>
>>> wrote:
>>> > The port you're looking for is typically 8080, but if you only specify
>>> > the host and not the port it shoudl work just fine.
>>> >
>>> > bin/nodeprobe -host localhost
>>> >
>>> > Michael
>>> >
>>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
>>> >> bin]$ ./nodeprobe -host localhost -port 8888
>>> >> Error connecting to remote JMX agent!
>>> >> java.io.IOException: Failed to retrieve RMIServer stub:
>>> >> javax.naming.CommunicationException [Root exception is
>>> >> java.rmi.ConnectIOException: error during JRMP connection
>>> >> establishment;
>>> >> nested exception is:
>>> >> java.io.EOFException]
>>> >> at
>>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
>>> >> at
>>> >>
>>> >> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
>>> >> at
>>> >> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
>>> >> at
>>> >> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
>>> >> at
>>> >> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
>>> >> Caused by: javax.naming.CommunicationException [Root exception is
>>> >> java.rmi.ConnectIOException: error during JRMP connection
>>> >> establishment;
>>> >> nested exception is:
>>> >> java.io.EOFException]
>>> >> at
>>> >>
>>> >> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
>>> >> at
>>> >>
>>> >> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
>>> >> at javax.naming.InitialContext.lookup(InitialContext.java:409)
>>> >> at
>>> >>
>>> >> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
>>> >> at
>>> >>
>>> >> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
>>> >> at
>>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
>>> >> ... 4 more
>>> >> Caused by: java.rmi.ConnectIOException: error during JRMP connection
>>> >> establishment; nested exception is:
>>> >> java.io.EOFException
>>> >> at
>>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
>>> >> at
>>> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
>>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
>>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
>>> >> at
>>> >>
>>> >> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
>>> >> ... 9 more
>>> >> Caused by: java.io.EOFException
>>> >> at java.io.DataInputStream.readByte(DataInputStream.java:267)
>>> >> at
>>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
>>> >> ... 13 more
>>> >>
>>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>>> >>>
>>> >>> port 7002 doesnt trying nodeprobe
>>> >>>
>>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>>> >>> <an...@alumni.caltech.edu> wrote:
>>> >>>>
>>> >>>> Alternatively if you are using the 0.3 release you can point a
>>> >>>> browser
>>> >>>> at port 7002 of one of the boxes and should see all the nodes in the
>>> >>>> list.
>>> >>>>
>>> >>>> -Anthony
>>> >>>>
>>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>>> >>>> > You can use the nodeprobe utility in bin/ to contact each node and
>>> >>>> > make sure they see the same information. Run it with no arguments
>>> >>>> > to
>>> >>>> > see the commands you can pass it.
>>> >>>> >
>>> >>>> > There is also an open issue at
>>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this
>>> >>>> > a
>>> >>>> > little more automatic (instead of having to run nodeprobe on each
>>> >>>> > node
>>> >>>> > and check the results by hand, you can just pass in all the servers
>>> >>>> > that you think should be able to see each other) but there's no
>>> >>>> > code
>>> >>>> > for this yet.
>>> >>>> >
>>> >>>> > Michael
>>> >>>> >
>>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
>>> >>>> > > Mark and Jonathan
>>> >>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
>>> >>>> > > how do i know all 4 are now part of the datastore
>>> >>>> > > are there ways to test this
>>> >>>> > > thanks a lot
>>> >>>> > >
>>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
>>> >>>> > > wrote:
>>> >>>> > >>
>>> >>>> > >> 2009/7/14 <mo...@gmail.com>
>>> >>>> > >>>
>>> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not do
>>> >>>> > >>> much
>>> >>>> > >>> for
>>> >>>> > >>> you. You will probably only care if you have lots more servers.
>>> >>>> > >>> 3
>>> >>>> > >>> servers is
>>> >>>> > >>> a reasonable minimum for a test / dev environment
>>> >>>> > >>> At How many servers does cassandra start really performing?
>>> >>>> > >>> or how many servers is an ideal setup say for a game 10?
>>> >>>> > >>
>>> >>>> > >> It can use any number, three is probably a reasonable minimum, I
>>> >>>> > >> don't
>>> >>>> > >> know what the maximum is.
>>> >>>> > >>
>>> >>>> > >> If you have a small number of servers, there is probably no
>>> >>>> > >> reason
>>> >>>> > >> to use
>>> >>>> > >> Cassandra; you can more usefully use a conventional database
>>> >>>> > >> with
>>> >>>> > >> replication or sharding.
>>> >>>> > >>
>>> >>>> > >> The reason you might want to use Cassandra is to scale writes a
>>> >>>> > >> lot,
>>> >>>> > >> to
>>> >>>> > >> levels you couldn't reach with more "conventional" databases.
>>> >>>> > >>
>>> >>>> > >> In all likelihood, an application would use Cassandra to store
>>> >>>> > >> high-volume
>>> >>>> > >> high-write data alongside a more conventional database to store
>>> >>>> > >> smaller,
>>> >>>> > >> less frequently changing stuff.
>>> >>>> > >>
>>> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
>>> >>>> > >> running
>>> >>>> > >> on a
>>> >>>> > >> homogenous cluster of dedicated servers with reasonable amounts
>>> >>>> > >> of
>>> >>>> > >> memory /
>>> >>>> > >> storage (But not necessarily high spec servers of CPU, IO speed
>>> >>>> > >> or
>>> >>>> > >> internal
>>> >>>> > >> redundancy).
>>> >>>> > >>
>>> >>>> > >> Once the load balancing is implemented in 0.5 (according to
>>> >>>> > >> current
>>> >>>> > >> plans)
>>> >>>> > >> it will become more useful for heterogenous environments.
>>> >>>> > >>
>>> >>>> > >> Mark
>>> >>>> > >
>>> >>>> > >
>>> >>>> > >
>>> >>>> > > --
>>> >>>> > > Bidegg worlds best auction site
>>> >>>> > > http://bidegg.com
>>> >>>> > >
>>> >>>>
>>> >>>> --
>>> >>>>
>>> >>>> ------------------------------------------------------------------------
>>> >>>> Anthony Molinaro
>>> >>>> <an...@alumni.caltech.edu>
>>> >>>
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Bidegg worlds best auction site
>>> >>> http://bidegg.com
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Bidegg worlds best auction site
>>> >> http://bidegg.com
>>> >>
>>> >
>>>
>>>
>>>
>>> --
>>> Evan Weaver
>>
>>
>>
>> --
>> Bidegg worlds best auction site
>> http://bidegg.com
>>
>
>
>
> --
> Evan Weaver
>
--
Evan Weaver
Re: one server or more servers?
Posted by Evan Weaver <ew...@gmail.com>.
Try with only one seed. Not every host has to be in the seeds.
Evan
On Wed, Jul 15, 2009 at 8:52 PM, <mo...@gmail.com> wrote:
> in Seeds
> can we specify domain name instead of ip address
> right now seeds is specifying ip address
>
> On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com> wrote:
>>
>> I sometimes have to use 127.0.0.1, at least when ListenAddress is
>> blank (auto-discover). Dunno if that has changed.
>>
>> Looks like this if you're successful:
>>
>> $ bin/nodeprobe --host 10.224.17.13 ring
>> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
>> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
>> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>>
>> Evan
>>
>> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<mi...@gmail.com>
>> wrote:
>> > The port you're looking for is typically 8080, but if you only specify
>> > the host and not the port it shoudl work just fine.
>> >
>> > bin/nodeprobe -host localhost
>> >
>> > Michael
>> >
>> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
>> >> bin]$ ./nodeprobe -host localhost -port 8888
>> >> Error connecting to remote JMX agent!
>> >> java.io.IOException: Failed to retrieve RMIServer stub:
>> >> javax.naming.CommunicationException [Root exception is
>> >> java.rmi.ConnectIOException: error during JRMP connection
>> >> establishment;
>> >> nested exception is:
>> >> java.io.EOFException]
>> >> at
>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
>> >> at
>> >>
>> >> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
>> >> at
>> >> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
>> >> at
>> >> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
>> >> at
>> >> org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
>> >> Caused by: javax.naming.CommunicationException [Root exception is
>> >> java.rmi.ConnectIOException: error during JRMP connection
>> >> establishment;
>> >> nested exception is:
>> >> java.io.EOFException]
>> >> at
>> >>
>> >> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
>> >> at
>> >>
>> >> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
>> >> at javax.naming.InitialContext.lookup(InitialContext.java:409)
>> >> at
>> >>
>> >> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
>> >> at
>> >>
>> >> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
>> >> at
>> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
>> >> ... 4 more
>> >> Caused by: java.rmi.ConnectIOException: error during JRMP connection
>> >> establishment; nested exception is:
>> >> java.io.EOFException
>> >> at
>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
>> >> at
>> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
>> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
>> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
>> >> at
>> >>
>> >> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
>> >> ... 9 more
>> >> Caused by: java.io.EOFException
>> >> at java.io.DataInputStream.readByte(DataInputStream.java:267)
>> >> at
>> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
>> >> ... 13 more
>> >>
>> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>> >>>
>> >>> port 7002 doesnt trying nodeprobe
>> >>>
>> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>> >>> <an...@alumni.caltech.edu> wrote:
>> >>>>
>> >>>> Alternatively if you are using the 0.3 release you can point a
>> >>>> browser
>> >>>> at port 7002 of one of the boxes and should see all the nodes in the
>> >>>> list.
>> >>>>
>> >>>> -Anthony
>> >>>>
>> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>> >>>> > You can use the nodeprobe utility in bin/ to contact each node and
>> >>>> > make sure they see the same information. Run it with no arguments
>> >>>> > to
>> >>>> > see the commands you can pass it.
>> >>>> >
>> >>>> > There is also an open issue at
>> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this
>> >>>> > a
>> >>>> > little more automatic (instead of having to run nodeprobe on each
>> >>>> > node
>> >>>> > and check the results by hand, you can just pass in all the servers
>> >>>> > that you think should be able to see each other) but there's no
>> >>>> > code
>> >>>> > for this yet.
>> >>>> >
>> >>>> > Michael
>> >>>> >
>> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
>> >>>> > > Mark and Jonathan
>> >>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
>> >>>> > > how do i know all 4 are now part of the datastore
>> >>>> > > are there ways to test this
>> >>>> > > thanks a lot
>> >>>> > >
>> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
>> >>>> > > wrote:
>> >>>> > >>
>> >>>> > >> 2009/7/14 <mo...@gmail.com>
>> >>>> > >>>
>> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not do
>> >>>> > >>> much
>> >>>> > >>> for
>> >>>> > >>> you. You will probably only care if you have lots more servers.
>> >>>> > >>> 3
>> >>>> > >>> servers is
>> >>>> > >>> a reasonable minimum for a test / dev environment
>> >>>> > >>> At How many servers does cassandra start really performing?
>> >>>> > >>> or how many servers is an ideal setup say for a game 10?
>> >>>> > >>
>> >>>> > >> It can use any number, three is probably a reasonable minimum, I
>> >>>> > >> don't
>> >>>> > >> know what the maximum is.
>> >>>> > >>
>> >>>> > >> If you have a small number of servers, there is probably no
>> >>>> > >> reason
>> >>>> > >> to use
>> >>>> > >> Cassandra; you can more usefully use a conventional database
>> >>>> > >> with
>> >>>> > >> replication or sharding.
>> >>>> > >>
>> >>>> > >> The reason you might want to use Cassandra is to scale writes a
>> >>>> > >> lot,
>> >>>> > >> to
>> >>>> > >> levels you couldn't reach with more "conventional" databases.
>> >>>> > >>
>> >>>> > >> In all likelihood, an application would use Cassandra to store
>> >>>> > >> high-volume
>> >>>> > >> high-write data alongside a more conventional database to store
>> >>>> > >> smaller,
>> >>>> > >> less frequently changing stuff.
>> >>>> > >>
>> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
>> >>>> > >> running
>> >>>> > >> on a
>> >>>> > >> homogenous cluster of dedicated servers with reasonable amounts
>> >>>> > >> of
>> >>>> > >> memory /
>> >>>> > >> storage (But not necessarily high spec servers of CPU, IO speed
>> >>>> > >> or
>> >>>> > >> internal
>> >>>> > >> redundancy).
>> >>>> > >>
>> >>>> > >> Once the load balancing is implemented in 0.5 (according to
>> >>>> > >> current
>> >>>> > >> plans)
>> >>>> > >> it will become more useful for heterogenous environments.
>> >>>> > >>
>> >>>> > >> Mark
>> >>>> > >
>> >>>> > >
>> >>>> > >
>> >>>> > > --
>> >>>> > > Bidegg worlds best auction site
>> >>>> > > http://bidegg.com
>> >>>> > >
>> >>>>
>> >>>> --
>> >>>>
>> >>>> ------------------------------------------------------------------------
>> >>>> Anthony Molinaro
>> >>>> <an...@alumni.caltech.edu>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Bidegg worlds best auction site
>> >>> http://bidegg.com
>> >>
>> >>
>> >>
>> >> --
>> >> Bidegg worlds best auction site
>> >> http://bidegg.com
>> >>
>> >
>>
>>
>>
>> --
>> Evan Weaver
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
--
Evan Weaver
Re: one server or more servers?
Posted by mo...@gmail.com.
in Seeds
can we specify domain name instead of ip address
right now seeds is specifying ip address
On Wed, Jul 15, 2009 at 4:49 PM, Evan Weaver <ew...@gmail.com> wrote:
> I sometimes have to use 127.0.0.1, at least when ListenAddress is
> blank (auto-discover). Dunno if that has changed.
>
> Looks like this if you're successful:
>
> $ bin/nodeprobe --host 10.224.17.13 ring
> Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
> Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
> Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
>
> Evan
>
> On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<mi...@gmail.com>
> wrote:
> > The port you're looking for is typically 8080, but if you only specify
> > the host and not the port it shoudl work just fine.
> >
> > bin/nodeprobe -host localhost
> >
> > Michael
> >
> > On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
> >> bin]$ ./nodeprobe -host localhost -port 8888
> >> Error connecting to remote JMX agent!
> >> java.io.IOException: Failed to retrieve RMIServer stub:
> >> javax.naming.CommunicationException [Root exception is
> >> java.rmi.ConnectIOException: error during JRMP connection establishment;
> >> nested exception is:
> >> java.io.EOFException]
> >> at
> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> >> at
> >>
> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> >> at
> org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
> >> at
> org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
> >> at org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
> >> Caused by: javax.naming.CommunicationException [Root exception is
> >> java.rmi.ConnectIOException: error during JRMP connection establishment;
> >> nested exception is:
> >> java.io.EOFException]
> >> at
> >>
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> >> at
> >>
> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> >> at javax.naming.InitialContext.lookup(InitialContext.java:409)
> >> at
> >>
> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> >> at
> >>
> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> >> at
> >> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> >> ... 4 more
> >> Caused by: java.rmi.ConnectIOException: error during JRMP connection
> >> establishment; nested exception is:
> >> java.io.EOFException
> >> at
> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
> >> at
> >> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> >> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> >> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> >> at
> >>
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> >> ... 9 more
> >> Caused by: java.io.EOFException
> >> at java.io.DataInputStream.readByte(DataInputStream.java:267)
> >> at
> >> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
> >> ... 13 more
> >>
> >> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
> >>>
> >>> port 7002 doesnt trying nodeprobe
> >>>
> >>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
> >>> <an...@alumni.caltech.edu> wrote:
> >>>>
> >>>> Alternatively if you are using the 0.3 release you can point a browser
> >>>> at port 7002 of one of the boxes and should see all the nodes in the
> >>>> list.
> >>>>
> >>>> -Anthony
> >>>>
> >>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
> >>>> > You can use the nodeprobe utility in bin/ to contact each node and
> >>>> > make sure they see the same information. Run it with no arguments
> to
> >>>> > see the commands you can pass it.
> >>>> >
> >>>> > There is also an open issue at
> >>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this
> a
> >>>> > little more automatic (instead of having to run nodeprobe on each
> node
> >>>> > and check the results by hand, you can just pass in all the servers
> >>>> > that you think should be able to see each other) but there's no code
> >>>> > for this yet.
> >>>> >
> >>>> > Michael
> >>>> >
> >>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
> >>>> > > Mark and Jonathan
> >>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
> >>>> > > how do i know all 4 are now part of the datastore
> >>>> > > are there ways to test this
> >>>> > > thanks a lot
> >>>> > >
> >>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
> >>>> > > wrote:
> >>>> > >>
> >>>> > >> 2009/7/14 <mo...@gmail.com>
> >>>> > >>>
> >>>> > >>> 1. If you only have 3 production servers, Cassandra may not do
> much
> >>>> > >>> for
> >>>> > >>> you. You will probably only care if you have lots more servers.
> 3
> >>>> > >>> servers is
> >>>> > >>> a reasonable minimum for a test / dev environment
> >>>> > >>> At How many servers does cassandra start really performing?
> >>>> > >>> or how many servers is an ideal setup say for a game 10?
> >>>> > >>
> >>>> > >> It can use any number, three is probably a reasonable minimum, I
> >>>> > >> don't
> >>>> > >> know what the maximum is.
> >>>> > >>
> >>>> > >> If you have a small number of servers, there is probably no
> reason
> >>>> > >> to use
> >>>> > >> Cassandra; you can more usefully use a conventional database with
> >>>> > >> replication or sharding.
> >>>> > >>
> >>>> > >> The reason you might want to use Cassandra is to scale writes a
> lot,
> >>>> > >> to
> >>>> > >> levels you couldn't reach with more "conventional" databases.
> >>>> > >>
> >>>> > >> In all likelihood, an application would use Cassandra to store
> >>>> > >> high-volume
> >>>> > >> high-write data alongside a more conventional database to store
> >>>> > >> smaller,
> >>>> > >> less frequently changing stuff.
> >>>> > >>
> >>>> > >> It appears to me that Cassandra 0.3 is only really useful if
> running
> >>>> > >> on a
> >>>> > >> homogenous cluster of dedicated servers with reasonable amounts
> of
> >>>> > >> memory /
> >>>> > >> storage (But not necessarily high spec servers of CPU, IO speed
> or
> >>>> > >> internal
> >>>> > >> redundancy).
> >>>> > >>
> >>>> > >> Once the load balancing is implemented in 0.5 (according to
> current
> >>>> > >> plans)
> >>>> > >> it will become more useful for heterogenous environments.
> >>>> > >>
> >>>> > >> Mark
> >>>> > >
> >>>> > >
> >>>> > >
> >>>> > > --
> >>>> > > Bidegg worlds best auction site
> >>>> > > http://bidegg.com
> >>>> > >
> >>>>
> >>>> --
> >>>>
> ------------------------------------------------------------------------
> >>>> Anthony Molinaro <
> anthonym@alumni.caltech.edu>
> >>>
> >>>
> >>>
> >>> --
> >>> Bidegg worlds best auction site
> >>> http://bidegg.com
> >>
> >>
> >>
> >> --
> >> Bidegg worlds best auction site
> >> http://bidegg.com
> >>
> >
>
>
>
> --
> Evan Weaver
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Evan Weaver <ew...@gmail.com>.
I sometimes have to use 127.0.0.1, at least when ListenAddress is
blank (auto-discover). Dunno if that has changed.
Looks like this if you're successful:
$ bin/nodeprobe --host 10.224.17.13 ring
Token(124007023942663924846758258675932114665) 3 10.224.17.13 |<--|
Token(106858063638814585506848525974047690568) 3 10.224.17.19 | ^
Token(141130545721235451315477340120224986045) 3 10.224.17.14 |-->|
Evan
On Wed, Jul 15, 2009 at 4:24 PM, Michael Greene<mi...@gmail.com> wrote:
> The port you're looking for is typically 8080, but if you only specify
> the host and not the port it shoudl work just fine.
>
> bin/nodeprobe -host localhost
>
> Michael
>
> On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
>> bin]$ ./nodeprobe -host localhost -port 8888
>> Error connecting to remote JMX agent!
>> java.io.IOException: Failed to retrieve RMIServer stub:
>> javax.naming.CommunicationException [Root exception is
>> java.rmi.ConnectIOException: error during JRMP connection establishment;
>> nested exception is:
>> java.io.EOFException]
>> at
>> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
>> at
>> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
>> at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
>> at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
>> at org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
>> Caused by: javax.naming.CommunicationException [Root exception is
>> java.rmi.ConnectIOException: error during JRMP connection establishment;
>> nested exception is:
>> java.io.EOFException]
>> at
>> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
>> at
>> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
>> at javax.naming.InitialContext.lookup(InitialContext.java:409)
>> at
>> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
>> at
>> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
>> at
>> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
>> ... 4 more
>> Caused by: java.rmi.ConnectIOException: error during JRMP connection
>> establishment; nested exception is:
>> java.io.EOFException
>> at
>> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
>> at
>> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
>> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
>> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
>> at
>> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
>> ... 9 more
>> Caused by: java.io.EOFException
>> at java.io.DataInputStream.readByte(DataInputStream.java:267)
>> at
>> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
>> ... 13 more
>>
>> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>>>
>>> port 7002 doesnt trying nodeprobe
>>>
>>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>>> <an...@alumni.caltech.edu> wrote:
>>>>
>>>> Alternatively if you are using the 0.3 release you can point a browser
>>>> at port 7002 of one of the boxes and should see all the nodes in the
>>>> list.
>>>>
>>>> -Anthony
>>>>
>>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>>>> > You can use the nodeprobe utility in bin/ to contact each node and
>>>> > make sure they see the same information. Run it with no arguments to
>>>> > see the commands you can pass it.
>>>> >
>>>> > There is also an open issue at
>>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this a
>>>> > little more automatic (instead of having to run nodeprobe on each node
>>>> > and check the results by hand, you can just pass in all the servers
>>>> > that you think should be able to see each other) but there's no code
>>>> > for this yet.
>>>> >
>>>> > Michael
>>>> >
>>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
>>>> > > Mark and Jonathan
>>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
>>>> > > how do i know all 4 are now part of the datastore
>>>> > > are there ways to test this
>>>> > > thanks a lot
>>>> > >
>>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
>>>> > > wrote:
>>>> > >>
>>>> > >> 2009/7/14 <mo...@gmail.com>
>>>> > >>>
>>>> > >>> 1. If you only have 3 production servers, Cassandra may not do much
>>>> > >>> for
>>>> > >>> you. You will probably only care if you have lots more servers. 3
>>>> > >>> servers is
>>>> > >>> a reasonable minimum for a test / dev environment
>>>> > >>> At How many servers does cassandra start really performing?
>>>> > >>> or how many servers is an ideal setup say for a game 10?
>>>> > >>
>>>> > >> It can use any number, three is probably a reasonable minimum, I
>>>> > >> don't
>>>> > >> know what the maximum is.
>>>> > >>
>>>> > >> If you have a small number of servers, there is probably no reason
>>>> > >> to use
>>>> > >> Cassandra; you can more usefully use a conventional database with
>>>> > >> replication or sharding.
>>>> > >>
>>>> > >> The reason you might want to use Cassandra is to scale writes a lot,
>>>> > >> to
>>>> > >> levels you couldn't reach with more "conventional" databases.
>>>> > >>
>>>> > >> In all likelihood, an application would use Cassandra to store
>>>> > >> high-volume
>>>> > >> high-write data alongside a more conventional database to store
>>>> > >> smaller,
>>>> > >> less frequently changing stuff.
>>>> > >>
>>>> > >> It appears to me that Cassandra 0.3 is only really useful if running
>>>> > >> on a
>>>> > >> homogenous cluster of dedicated servers with reasonable amounts of
>>>> > >> memory /
>>>> > >> storage (But not necessarily high spec servers of CPU, IO speed or
>>>> > >> internal
>>>> > >> redundancy).
>>>> > >>
>>>> > >> Once the load balancing is implemented in 0.5 (according to current
>>>> > >> plans)
>>>> > >> it will become more useful for heterogenous environments.
>>>> > >>
>>>> > >> Mark
>>>> > >
>>>> > >
>>>> > >
>>>> > > --
>>>> > > Bidegg worlds best auction site
>>>> > > http://bidegg.com
>>>> > >
>>>>
>>>> --
>>>> ------------------------------------------------------------------------
>>>> Anthony Molinaro <an...@alumni.caltech.edu>
>>>
>>>
>>>
>>> --
>>> Bidegg worlds best auction site
>>> http://bidegg.com
>>
>>
>>
>> --
>> Bidegg worlds best auction site
>> http://bidegg.com
>>
>
--
Evan Weaver
Re: one server or more servers?
Posted by Michael Greene <mi...@gmail.com>.
The port you're looking for is typically 8080, but if you only specify
the host and not the port it shoudl work just fine.
bin/nodeprobe -host localhost
Michael
On Wed, Jul 15, 2009 at 6:18 PM, <mo...@gmail.com> wrote:
> bin]$ ./nodeprobe -host localhost -port 8888
> Error connecting to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub:
> javax.naming.CommunicationException [Root exception is
> java.rmi.ConnectIOException: error during JRMP connection establishment;
> nested exception is:
> java.io.EOFException]
> at
> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> at
> javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
> at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
> at org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
> Caused by: javax.naming.CommunicationException [Root exception is
> java.rmi.ConnectIOException: error during JRMP connection establishment;
> nested exception is:
> java.io.EOFException]
> at
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> at
> com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> at javax.naming.InitialContext.lookup(InitialContext.java:409)
> at
> javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> at
> javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> at
> javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> ... 4 more
> Caused by: java.rmi.ConnectIOException: error during JRMP connection
> establishment; nested exception is:
> java.io.EOFException
> at
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
> at
> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> at
> com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> ... 9 more
> Caused by: java.io.EOFException
> at java.io.DataInputStream.readByte(DataInputStream.java:267)
> at
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
> ... 13 more
>
> On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
>>
>> port 7002 doesnt trying nodeprobe
>>
>> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro
>> <an...@alumni.caltech.edu> wrote:
>>>
>>> Alternatively if you are using the 0.3 release you can point a browser
>>> at port 7002 of one of the boxes and should see all the nodes in the
>>> list.
>>>
>>> -Anthony
>>>
>>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>>> > You can use the nodeprobe utility in bin/ to contact each node and
>>> > make sure they see the same information. Run it with no arguments to
>>> > see the commands you can pass it.
>>> >
>>> > There is also an open issue at
>>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this a
>>> > little more automatic (instead of having to run nodeprobe on each node
>>> > and check the results by hand, you can just pass in all the servers
>>> > that you think should be able to see each other) but there's no code
>>> > for this yet.
>>> >
>>> > Michael
>>> >
>>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
>>> > > Mark and Jonathan
>>> > > I have started cassandra on 4 servers with all 4 of them as seeds
>>> > > how do i know all 4 are now part of the datastore
>>> > > are there ways to test this
>>> > > thanks a lot
>>> > >
>>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
>>> > > wrote:
>>> > >>
>>> > >> 2009/7/14 <mo...@gmail.com>
>>> > >>>
>>> > >>> 1. If you only have 3 production servers, Cassandra may not do much
>>> > >>> for
>>> > >>> you. You will probably only care if you have lots more servers. 3
>>> > >>> servers is
>>> > >>> a reasonable minimum for a test / dev environment
>>> > >>> At How many servers does cassandra start really performing?
>>> > >>> or how many servers is an ideal setup say for a game 10?
>>> > >>
>>> > >> It can use any number, three is probably a reasonable minimum, I
>>> > >> don't
>>> > >> know what the maximum is.
>>> > >>
>>> > >> If you have a small number of servers, there is probably no reason
>>> > >> to use
>>> > >> Cassandra; you can more usefully use a conventional database with
>>> > >> replication or sharding.
>>> > >>
>>> > >> The reason you might want to use Cassandra is to scale writes a lot,
>>> > >> to
>>> > >> levels you couldn't reach with more "conventional" databases.
>>> > >>
>>> > >> In all likelihood, an application would use Cassandra to store
>>> > >> high-volume
>>> > >> high-write data alongside a more conventional database to store
>>> > >> smaller,
>>> > >> less frequently changing stuff.
>>> > >>
>>> > >> It appears to me that Cassandra 0.3 is only really useful if running
>>> > >> on a
>>> > >> homogenous cluster of dedicated servers with reasonable amounts of
>>> > >> memory /
>>> > >> storage (But not necessarily high spec servers of CPU, IO speed or
>>> > >> internal
>>> > >> redundancy).
>>> > >>
>>> > >> Once the load balancing is implemented in 0.5 (according to current
>>> > >> plans)
>>> > >> it will become more useful for heterogenous environments.
>>> > >>
>>> > >> Mark
>>> > >
>>> > >
>>> > >
>>> > > --
>>> > > Bidegg worlds best auction site
>>> > > http://bidegg.com
>>> > >
>>>
>>> --
>>> ------------------------------------------------------------------------
>>> Anthony Molinaro <an...@alumni.caltech.edu>
>>
>>
>>
>> --
>> Bidegg worlds best auction site
>> http://bidegg.com
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
Re: one server or more servers?
Posted by mo...@gmail.com.
bin]$ ./nodeprobe -host localhost -port 8888
Error connecting to remote JMX agent!
java.io.IOException: Failed to retrieve RMIServer stub:
javax.naming.CommunicationException [Root exception is
java.rmi.ConnectIOException: error during JRMP connection establishment;
nested exception is:
java.io.EOFException]
at
javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
at
javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:149)
at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:111)
at org.apache.cassandra.tools.NodeProbe.main(NodeProbe.java:470)
Caused by: javax.naming.CommunicationException [Root exception is
java.rmi.ConnectIOException: error during JRMP connection establishment;
nested exception is:
java.io.EOFException]
at
com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
at
com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
at javax.naming.InitialContext.lookup(InitialContext.java:409)
at
javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
at
javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
at
javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
... 4 more
Caused by: java.rmi.ConnectIOException: error during JRMP connection
establishment; nested exception is:
java.io.EOFException
at
sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:304)
at
sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
at
com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
... 9 more
Caused by: java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:267)
at
sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:246)
... 13 more
On Wed, Jul 15, 2009 at 4:17 PM, <mo...@gmail.com> wrote:
> port 7002 doesnt trying nodeprobe
>
>
> On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro <
> anthonym@alumni.caltech.edu> wrote:
>
>> Alternatively if you are using the 0.3 release you can point a browser
>> at port 7002 of one of the boxes and should see all the nodes in the
>> list.
>>
>> -Anthony
>>
>> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
>> > You can use the nodeprobe utility in bin/ to contact each node and
>> > make sure they see the same information. Run it with no arguments to
>> > see the commands you can pass it.
>> >
>> > There is also an open issue at
>> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this a
>> > little more automatic (instead of having to run nodeprobe on each node
>> > and check the results by hand, you can just pass in all the servers
>> > that you think should be able to see each other) but there's no code
>> > for this yet.
>> >
>> > Michael
>> >
>> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
>> > > Mark and Jonathan
>> > > I have started cassandra on 4 servers with all 4 of them as seeds
>> > > how do i know all 4 are now part of the datastore
>> > > are there ways to test this
>> > > thanks a lot
>> > >
>> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com>
>> wrote:
>> > >>
>> > >> 2009/7/14 <mo...@gmail.com>
>> > >>>
>> > >>> 1. If you only have 3 production servers, Cassandra may not do much
>> for
>> > >>> you. You will probably only care if you have lots more servers. 3
>> servers is
>> > >>> a reasonable minimum for a test / dev environment
>> > >>> At How many servers does cassandra start really performing?
>> > >>> or how many servers is an ideal setup say for a game 10?
>> > >>
>> > >> It can use any number, three is probably a reasonable minimum, I
>> don't
>> > >> know what the maximum is.
>> > >>
>> > >> If you have a small number of servers, there is probably no reason to
>> use
>> > >> Cassandra; you can more usefully use a conventional database with
>> > >> replication or sharding.
>> > >>
>> > >> The reason you might want to use Cassandra is to scale writes a lot,
>> to
>> > >> levels you couldn't reach with more "conventional" databases.
>> > >>
>> > >> In all likelihood, an application would use Cassandra to store
>> high-volume
>> > >> high-write data alongside a more conventional database to store
>> smaller,
>> > >> less frequently changing stuff.
>> > >>
>> > >> It appears to me that Cassandra 0.3 is only really useful if running
>> on a
>> > >> homogenous cluster of dedicated servers with reasonable amounts of
>> memory /
>> > >> storage (But not necessarily high spec servers of CPU, IO speed or
>> internal
>> > >> redundancy).
>> > >>
>> > >> Once the load balancing is implemented in 0.5 (according to current
>> plans)
>> > >> it will become more useful for heterogenous environments.
>> > >>
>> > >> Mark
>> > >
>> > >
>> > >
>> > > --
>> > > Bidegg worlds best auction site
>> > > http://bidegg.com
>> > >
>>
>> --
>> ------------------------------------------------------------------------
>> Anthony Molinaro <an...@alumni.caltech.edu>
>>
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by mo...@gmail.com.
port 7002 doesnt trying nodeprobe
On Wed, Jul 15, 2009 at 4:03 PM, Anthony Molinaro <
anthonym@alumni.caltech.edu> wrote:
> Alternatively if you are using the 0.3 release you can point a browser
> at port 7002 of one of the boxes and should see all the nodes in the
> list.
>
> -Anthony
>
> On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
> > You can use the nodeprobe utility in bin/ to contact each node and
> > make sure they see the same information. Run it with no arguments to
> > see the commands you can pass it.
> >
> > There is also an open issue at
> > https://issues.apache.org/jira/browse/CASSANDRA-252 for making this a
> > little more automatic (instead of having to run nodeprobe on each node
> > and check the results by hand, you can just pass in all the servers
> > that you think should be able to see each other) but there's no code
> > for this yet.
> >
> > Michael
> >
> > On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
> > > Mark and Jonathan
> > > I have started cassandra on 4 servers with all 4 of them as seeds
> > > how do i know all 4 are now part of the datastore
> > > are there ways to test this
> > > thanks a lot
> > >
> > > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com> wrote:
> > >>
> > >> 2009/7/14 <mo...@gmail.com>
> > >>>
> > >>> 1. If you only have 3 production servers, Cassandra may not do much
> for
> > >>> you. You will probably only care if you have lots more servers. 3
> servers is
> > >>> a reasonable minimum for a test / dev environment
> > >>> At How many servers does cassandra start really performing?
> > >>> or how many servers is an ideal setup say for a game 10?
> > >>
> > >> It can use any number, three is probably a reasonable minimum, I don't
> > >> know what the maximum is.
> > >>
> > >> If you have a small number of servers, there is probably no reason to
> use
> > >> Cassandra; you can more usefully use a conventional database with
> > >> replication or sharding.
> > >>
> > >> The reason you might want to use Cassandra is to scale writes a lot,
> to
> > >> levels you couldn't reach with more "conventional" databases.
> > >>
> > >> In all likelihood, an application would use Cassandra to store
> high-volume
> > >> high-write data alongside a more conventional database to store
> smaller,
> > >> less frequently changing stuff.
> > >>
> > >> It appears to me that Cassandra 0.3 is only really useful if running
> on a
> > >> homogenous cluster of dedicated servers with reasonable amounts of
> memory /
> > >> storage (But not necessarily high spec servers of CPU, IO speed or
> internal
> > >> redundancy).
> > >>
> > >> Once the load balancing is implemented in 0.5 (according to current
> plans)
> > >> it will become more useful for heterogenous environments.
> > >>
> > >> Mark
> > >
> > >
> > >
> > > --
> > > Bidegg worlds best auction site
> > > http://bidegg.com
> > >
>
> --
> ------------------------------------------------------------------------
> Anthony Molinaro <an...@alumni.caltech.edu>
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Anthony Molinaro <an...@alumni.caltech.edu>.
Alternatively if you are using the 0.3 release you can point a browser
at port 7002 of one of the boxes and should see all the nodes in the
list.
-Anthony
On Wed, Jul 15, 2009 at 05:40:27PM -0500, Michael Greene wrote:
> You can use the nodeprobe utility in bin/ to contact each node and
> make sure they see the same information. Run it with no arguments to
> see the commands you can pass it.
>
> There is also an open issue at
> https://issues.apache.org/jira/browse/CASSANDRA-252 for making this a
> little more automatic (instead of having to run nodeprobe on each node
> and check the results by hand, you can just pass in all the servers
> that you think should be able to see each other) but there's no code
> for this yet.
>
> Michael
>
> On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
> > Mark and Jonathan
> > I have started cassandra on 4 servers with all 4 of them as seeds
> > how do i know all 4 are now part of the datastore
> > are there ways to test this
> > thanks a lot
> >
> > On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com> wrote:
> >>
> >> 2009/7/14 <mo...@gmail.com>
> >>>
> >>> 1. If you only have 3 production servers, Cassandra may not do much for
> >>> you. You will probably only care if you have lots more servers. 3 servers is
> >>> a reasonable minimum for a test / dev environment
> >>> At How many servers does cassandra start really performing?
> >>> or how many servers is an ideal setup say for a game 10?
> >>
> >> It can use any number, three is probably a reasonable minimum, I don't
> >> know what the maximum is.
> >>
> >> If you have a small number of servers, there is probably no reason to use
> >> Cassandra; you can more usefully use a conventional database with
> >> replication or sharding.
> >>
> >> The reason you might want to use Cassandra is to scale writes a lot, to
> >> levels you couldn't reach with more "conventional" databases.
> >>
> >> In all likelihood, an application would use Cassandra to store high-volume
> >> high-write data alongside a more conventional database to store smaller,
> >> less frequently changing stuff.
> >>
> >> It appears to me that Cassandra 0.3 is only really useful if running on a
> >> homogenous cluster of dedicated servers with reasonable amounts of memory /
> >> storage (But not necessarily high spec servers of CPU, IO speed or internal
> >> redundancy).
> >>
> >> Once the load balancing is implemented in 0.5 (according to current plans)
> >> it will become more useful for heterogenous environments.
> >>
> >> Mark
> >
> >
> >
> > --
> > Bidegg worlds best auction site
> > http://bidegg.com
> >
--
------------------------------------------------------------------------
Anthony Molinaro <an...@alumni.caltech.edu>
Re: one server or more servers?
Posted by Michael Greene <mi...@gmail.com>.
You can use the nodeprobe utility in bin/ to contact each node and
make sure they see the same information. Run it with no arguments to
see the commands you can pass it.
There is also an open issue at
https://issues.apache.org/jira/browse/CASSANDRA-252 for making this a
little more automatic (instead of having to run nodeprobe on each node
and check the results by hand, you can just pass in all the servers
that you think should be able to see each other) but there's no code
for this yet.
Michael
On Wed, Jul 15, 2009 at 5:33 PM, <mo...@gmail.com> wrote:
> Mark and Jonathan
> I have started cassandra on 4 servers with all 4 of them as seeds
> how do i know all 4 are now part of the datastore
> are there ways to test this
> thanks a lot
>
> On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com> wrote:
>>
>> 2009/7/14 <mo...@gmail.com>
>>>
>>> 1. If you only have 3 production servers, Cassandra may not do much for
>>> you. You will probably only care if you have lots more servers. 3 servers is
>>> a reasonable minimum for a test / dev environment
>>> At How many servers does cassandra start really performing?
>>> or how many servers is an ideal setup say for a game 10?
>>
>> It can use any number, three is probably a reasonable minimum, I don't
>> know what the maximum is.
>>
>> If you have a small number of servers, there is probably no reason to use
>> Cassandra; you can more usefully use a conventional database with
>> replication or sharding.
>>
>> The reason you might want to use Cassandra is to scale writes a lot, to
>> levels you couldn't reach with more "conventional" databases.
>>
>> In all likelihood, an application would use Cassandra to store high-volume
>> high-write data alongside a more conventional database to store smaller,
>> less frequently changing stuff.
>>
>> It appears to me that Cassandra 0.3 is only really useful if running on a
>> homogenous cluster of dedicated servers with reasonable amounts of memory /
>> storage (But not necessarily high spec servers of CPU, IO speed or internal
>> redundancy).
>>
>> Once the load balancing is implemented in 0.5 (according to current plans)
>> it will become more useful for heterogenous environments.
>>
>> Mark
>
>
>
> --
> Bidegg worlds best auction site
> http://bidegg.com
>
Re: one server or more servers?
Posted by mo...@gmail.com.
Mark and Jonathan
I have started cassandra on 4 servers with all 4 of them as seeds
how do i know all 4 are now part of the datastore
are there ways to test this
thanks a lot
On Tue, Jul 14, 2009 at 8:30 AM, Mark Robson <ma...@gmail.com> wrote:
> 2009/7/14 <mo...@gmail.com>
>
>> *1. If you only have 3 production servers, Cassandra may not do much for
>> you. You will probably only care if you have lots more servers. 3 servers is
>> a reasonable minimum for a test / dev environment*
>> At How many servers does cassandra start really performing?
>> or how many servers is an ideal setup say for a game 10?
>>
>
> It can use any number, three is probably a reasonable minimum, I don't know
> what the maximum is.
>
> If you have a small number of servers, there is probably no reason to use
> Cassandra; you can more usefully use a conventional database with
> replication or sharding.
>
> The reason you might want to use Cassandra is to scale writes a lot, to
> levels you couldn't reach with more "conventional" databases.
>
> In all likelihood, an application would use Cassandra to store high-volume
> high-write data alongside a more conventional database to store smaller,
> less frequently changing stuff.
>
> It appears to me that Cassandra 0.3 is only really useful if running on a
> homogenous cluster of dedicated servers with reasonable amounts of memory /
> storage (But not necessarily high spec servers of CPU, IO speed or internal
> redundancy).
>
> Once the load balancing is implemented in 0.5 (according to current plans)
> it will become more useful for heterogenous environments.
>
> Mark
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 <mo...@gmail.com>
> *1. If you only have 3 production servers, Cassandra may not do much for
> you. You will probably only care if you have lots more servers. 3 servers is
> a reasonable minimum for a test / dev environment*
> At How many servers does cassandra start really performing?
> or how many servers is an ideal setup say for a game 10?
>
It can use any number, three is probably a reasonable minimum, I don't know
what the maximum is.
If you have a small number of servers, there is probably no reason to use
Cassandra; you can more usefully use a conventional database with
replication or sharding.
The reason you might want to use Cassandra is to scale writes a lot, to
levels you couldn't reach with more "conventional" databases.
In all likelihood, an application would use Cassandra to store high-volume
high-write data alongside a more conventional database to store smaller,
less frequently changing stuff.
It appears to me that Cassandra 0.3 is only really useful if running on a
homogenous cluster of dedicated servers with reasonable amounts of memory /
storage (But not necessarily high spec servers of CPU, IO speed or internal
redundancy).
Once the load balancing is implemented in 0.5 (according to current plans)
it will become more useful for heterogenous environments.
Mark
Re: one server or more servers?
Posted by mo...@gmail.com.
*1. If you only have 3 production servers, Cassandra may not do much for
you. You will probably only care if you have lots more servers. 3 servers is
a reasonable minimum for a test / dev environment*
At How many servers does cassandra start really performing?
or how many servers is an ideal setup say for a game 10?
On Tue, Jul 14, 2009 at 3:00 AM, Mark Robson <ma...@gmail.com> wrote:
>
>
> 2009/7/14 <mo...@gmail.com>
>
>> I have 3 productions servers, is it better to
>>
>> A. start the cassandra in one node and add other seeds later
>> or
>> B. Start cassandra in all the 3 nodes
>>
>> if i do A, when i later add 2 nodes ,will cassandra pick up the other two
>> nodes and start distributing the loads fairly
>
>
> My guess would be:
>
> 1. If you only have 3 production servers, Cassandra may not do much for
> you. You will probably only care if you have lots more servers. 3 servers is
> a reasonable minimum for a test / dev environment.
>
> 2. All of your servers should have static IPs. You should make sure that at
> least 2-3 of them are unlikely to go away, and put those in as seeds, the
> other servers can come and go and change IP address etc.
>
> I would set up 2-3 servers which I expected to be unlikely to go away (i.e.
> they won't be taken out any time soon), and code their IPs into the seeds.
> The other servers can use those to find each other.
>
> Also your ops team should then be aware, that if they get rid of those
> "seed" servers, at some point new boxes should be deployed to take over
> those IPs so there are always at least two actively running Cassandra, that
> way your other nodes can find one another.
>
> Having only one seed server would place a single point of failure, which
> you don't want.
>
> If you have a segmented network (e.g. routed, different racks, different
> datacentres with VPN between them etc), you could put two seeds in each
> segment, which would make discovery tolerant of a partition.
>
> But having said that, it's relatively inconvenient to have a large number
> of seeds as you'd need to keep deploying new config files to all your nodes.
>
> Mark
>
--
Bidegg worlds best auction site
http://bidegg.com
Re: one server or more servers?
Posted by Mark Robson <ma...@gmail.com>.
2009/7/14 <mo...@gmail.com>
> I have 3 productions servers, is it better to
>
> A. start the cassandra in one node and add other seeds later
> or
> B. Start cassandra in all the 3 nodes
>
> if i do A, when i later add 2 nodes ,will cassandra pick up the other two
> nodes and start distributing the loads fairly
My guess would be:
1. If you only have 3 production servers, Cassandra may not do much for you.
You will probably only care if you have lots more servers. 3 servers is a
reasonable minimum for a test / dev environment.
2. All of your servers should have static IPs. You should make sure that at
least 2-3 of them are unlikely to go away, and put those in as seeds, the
other servers can come and go and change IP address etc.
I would set up 2-3 servers which I expected to be unlikely to go away (i.e.
they won't be taken out any time soon), and code their IPs into the seeds.
The other servers can use those to find each other.
Also your ops team should then be aware, that if they get rid of those
"seed" servers, at some point new boxes should be deployed to take over
those IPs so there are always at least two actively running Cassandra, that
way your other nodes can find one another.
Having only one seed server would place a single point of failure, which you
don't want.
If you have a segmented network (e.g. routed, different racks, different
datacentres with VPN between them etc), you could put two seeds in each
segment, which would make discovery tolerant of a partition.
But having said that, it's relatively inconvenient to have a large number of
seeds as you'd need to keep deploying new config files to all your nodes.
Mark