You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Eldad Yamin <el...@gmail.com> on 2011/08/03 15:28:31 UTC
Install Cassandra on EC2
Hi,
Is there any manual or important notes I should know before I try to install
Cassandra on EC2?
Thanks!
Re: Install Cassandra on EC2
Posted by Eldad Yamin <el...@gmail.com>.
HI Aaron,
Thanks for your replay.
I've already saw that, but at the moment I'm interesting in installing
Cassandra from scratch - I want to learn.
well, yesterday I've installed 1 node - now I'm looking on how to add more
nodes and read more about Cassandra's tools (node reaper etc.)
Thanks!
On Thu, Aug 4, 2011 at 1:23 AM, aaron morton <aa...@thelastpickle.com>wrote:
> Pre build AMI here
>
> http://www.datastax.com/dev/blog/setting-up-a-cassandra-cluster-with-the-datastax-ami
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Cassandra Developer
> @aaronmorton
> http://www.thelastpickle.com
>
> On 4 Aug 2011, at 03:24, Jeremy Hanna wrote:
>
> Some quick thoughts that might be helpful:
>
> - use ephemeral instances and RAID0 over the local volumes for both
> cassandra's data as well as the log directory. The log directory because if
> you crash due to heap size, the heap dump will be stored in the log
> directory. you don't want that to go in your root/OS partition.
>
> - probably want to stripe across AZs so that a single AZ failure doesn't
> affect you as much.
>
> - for seeds, it's nice to use elastic ips so that your seed configuration
> doesn't have to change if a node is replaced.
>
> - the ec2snitch makes it so each AZ appears as a rack wrt topology -
> simpler as it inspects the ec2 metadata. if you need more than one DC in
> your cluster (we need a second virtual DC for analytics), you'll probably
> want to use the property file snitch. there's a cross region ec2snitch
> that's coming in 1.0.
>
> would probably be good to add some ec2 specific tips in the wiki. the page
> that dave mentioned is a good step-by-step, but there's been a lot of
> community knowledge accumulated about best practices in the year since that
> was done.
>
> On Aug 3, 2011, at 8:28 AM, Eldad Yamin wrote:
>
> Hi,
>
> Is there any manual or important notes I should know before I try to
> install Cassandra on EC2?
>
>
> Thanks!
>
>
>
>
Re: Install Cassandra on EC2
Posted by aaron morton <aa...@thelastpickle.com>.
Pre build AMI here
http://www.datastax.com/dev/blog/setting-up-a-cassandra-cluster-with-the-datastax-ami
Cheers
-----------------
Aaron Morton
Freelance Cassandra Developer
@aaronmorton
http://www.thelastpickle.com
On 4 Aug 2011, at 03:24, Jeremy Hanna wrote:
> Some quick thoughts that might be helpful:
>
> - use ephemeral instances and RAID0 over the local volumes for both cassandra's data as well as the log directory. The log directory because if you crash due to heap size, the heap dump will be stored in the log directory. you don't want that to go in your root/OS partition.
>
> - probably want to stripe across AZs so that a single AZ failure doesn't affect you as much.
>
> - for seeds, it's nice to use elastic ips so that your seed configuration doesn't have to change if a node is replaced.
>
> - the ec2snitch makes it so each AZ appears as a rack wrt topology - simpler as it inspects the ec2 metadata. if you need more than one DC in your cluster (we need a second virtual DC for analytics), you'll probably want to use the property file snitch. there's a cross region ec2snitch that's coming in 1.0.
>
> would probably be good to add some ec2 specific tips in the wiki. the page that dave mentioned is a good step-by-step, but there's been a lot of community knowledge accumulated about best practices in the year since that was done.
>
> On Aug 3, 2011, at 8:28 AM, Eldad Yamin wrote:
>
>> Hi,
>> Is there any manual or important notes I should know before I try to install Cassandra on EC2?
>>
>> Thanks!
>
Re: Install Cassandra on EC2
Posted by Jeremy Hanna <je...@gmail.com>.
Some quick thoughts that might be helpful:
- use ephemeral instances and RAID0 over the local volumes for both cassandra's data as well as the log directory. The log directory because if you crash due to heap size, the heap dump will be stored in the log directory. you don't want that to go in your root/OS partition.
- probably want to stripe across AZs so that a single AZ failure doesn't affect you as much.
- for seeds, it's nice to use elastic ips so that your seed configuration doesn't have to change if a node is replaced.
- the ec2snitch makes it so each AZ appears as a rack wrt topology - simpler as it inspects the ec2 metadata. if you need more than one DC in your cluster (we need a second virtual DC for analytics), you'll probably want to use the property file snitch. there's a cross region ec2snitch that's coming in 1.0.
would probably be good to add some ec2 specific tips in the wiki. the page that dave mentioned is a good step-by-step, but there's been a lot of community knowledge accumulated about best practices in the year since that was done.
On Aug 3, 2011, at 8:28 AM, Eldad Yamin wrote:
> Hi,
> Is there any manual or important notes I should know before I try to install Cassandra on EC2?
>
> Thanks!
Re: Install Cassandra on EC2
Posted by Dave Viner <da...@gmail.com>.
Hi Eldad,
Check out http://wiki.apache.org/cassandra/CloudConfig
There are a few ways listed there including a step-by-step guide.
Dave Viner
On Wed, Aug 3, 2011 at 7:49 AM, Eldad Yamin <el...@gmail.com> wrote:
> Thanks!
> But I prefer to learn how to Install first - if you have any good
> references (I didn't find any, even general installation for a EC2/regular
> machine)
> I'm also going to try and install Solandra, I hope that Whirr will support
> it in the near future.
>
> On Wed, Aug 3, 2011 at 5:43 PM, John Conwell <jo...@iamjohn.me> wrote:
>
>> One thing you might want to look at is the Apache Whirr project (which is
>> awesome by the way!). It automagically handles spinning up a cluster of
>> resources on EC2 (or rackspace for that matter), installing and configuring
>> cassandra, and starting it.
>>
>> One thing to be aware of if you go this route. By default in the yaml
>> file all data is written under the /var folder. But on a server started by
>> Whirr, this folder only has something like 4gb. Most of the hard disk
>> space is under the /mnt folder. So you'll either need to change what
>> folders are pointed to what drives (not sure if you can or not...I'm sure
>> you could), or change the yaml file to point the /mnt folder.
>>
>>
>> On Wed, Aug 3, 2011 at 6:28 AM, Eldad Yamin <el...@gmail.com> wrote:
>>
>>> Hi,
>>> Is there any manual or important notes I should know before I try to
>>> install Cassandra on EC2?
>>>
>>> Thanks!
>>>
>>
>>
>>
>> --
>>
>> Thanks,
>> John C
>>
>>
>
Re: Install Cassandra on EC2
Posted by Eldad Yamin <el...@gmail.com>.
Thanks!
But I prefer to learn how to Install first - if you have any good references
(I didn't find any, even general installation for a EC2/regular machine)
I'm also going to try and install Solandra, I hope that Whirr will support
it in the near future.
On Wed, Aug 3, 2011 at 5:43 PM, John Conwell <jo...@iamjohn.me> wrote:
> One thing you might want to look at is the Apache Whirr project (which is
> awesome by the way!). It automagically handles spinning up a cluster of
> resources on EC2 (or rackspace for that matter), installing and configuring
> cassandra, and starting it.
>
> One thing to be aware of if you go this route. By default in the yaml file
> all data is written under the /var folder. But on a server started by
> Whirr, this folder only has something like 4gb. Most of the hard disk
> space is under the /mnt folder. So you'll either need to change what
> folders are pointed to what drives (not sure if you can or not...I'm sure
> you could), or change the yaml file to point the /mnt folder.
>
>
> On Wed, Aug 3, 2011 at 6:28 AM, Eldad Yamin <el...@gmail.com> wrote:
>
>> Hi,
>> Is there any manual or important notes I should know before I try to
>> install Cassandra on EC2?
>>
>> Thanks!
>>
>
>
>
> --
>
> Thanks,
> John C
>
>
Re: Install Cassandra on EC2
Posted by John Conwell <jo...@iamjohn.me>.
One thing you might want to look at is the Apache Whirr project (which is
awesome by the way!). It automagically handles spinning up a cluster of
resources on EC2 (or rackspace for that matter), installing and configuring
cassandra, and starting it.
One thing to be aware of if you go this route. By default in the yaml file
all data is written under the /var folder. But on a server started by
Whirr, this folder only has something like 4gb. Most of the hard disk
space is under the /mnt folder. So you'll either need to change what
folders are pointed to what drives (not sure if you can or not...I'm sure
you could), or change the yaml file to point the /mnt folder.
On Wed, Aug 3, 2011 at 6:28 AM, Eldad Yamin <el...@gmail.com> wrote:
> Hi,
> Is there any manual or important notes I should know before I try to
> install Cassandra on EC2?
>
> Thanks!
>
--
Thanks,
John C