You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Paulo Ricardo Motta Gomes <pa...@chaordicsystems.com> on 2014/05/20 16:43:05 UTC
Disable FS journaling
Hello,
Has anyone disabled file system journaling on Cassandra nodes? Does it make
any difference on write performance?
Cheers,
--
*Paulo Motta*
Chaordic | *Platform*
*www.chaordic.com.br <http://www.chaordic.com.br/>*
+55 48 3232.3200
Re: Disable FS journaling
Posted by Kevin Burton <bu...@spinn3r.com>.
My gut says you won't see much of a performance boost. Especially if
you're on SSD as the journal isn't going to be hindered by random write
speed.
Also, I *believe* you will lose filesystem metadata too… which Cassandra
doesn't protect you from.
On Tue, May 20, 2014 at 9:30 AM, Paulo Ricardo Motta Gomes <
paulo.motta@chaordicsystems.com> wrote:
>
> On Tue, May 20, 2014 at 1:24 PM, Terje Marthinussen <
> tmarthinussen@gmail.com> wrote:
>
>> Journal enabled is faster on almost all operations.
>>
>>
> Good to know, thanks!
>
>
>
>> Recovery here is more about saving you from waiting 1/2 hour from a
>> traditional full file system check.
>>
>>
> On an EC2 environment you normally lose the machine anyway on failures, so
> that's not of much use in that case.
>
>
>> Feel free to wait if you want though! :)
>>
>> Regards,
>> Terje
>>
>> On 21 May 2014, at 01:11, Paulo Ricardo Motta Gomes <
>> paulo.motta@chaordicsystems.com> wrote:
>>
>> Thanks for the links!
>>
>> Forgot to mention, using XFS here, as suggested by the Cassandra wiki.
>> But just double checked and it's apparently not possible to disable
>> journaling on XFS.
>>
>> One of ours sysadmin just suggested disabling journaling, since it's
>> mostly for recovery purposes, and Cassandra already does that pretty well
>> with commitlog, replication and anti-entropy. It would anyway be nice to
>> know if there could be any performance benefits from it. But I personally
>> don't think it would help much, due to the append-only nature of cassandra
>> writes.
>>
>>
>> On Tue, May 20, 2014 at 12:43 PM, Michael Shuler <mi...@pbandjelly.org>wrote:
>>
>>> On 05/20/2014 09:54 AM, Samir Faci wrote:
>>>
>>>> I'm not sure you'd be gaining much by doing this. This is probably
>>>> dependent on the file system you're referring to when you say
>>>> journaling. There's a few of them around,
>>>>
>>>> You could opt to use ext2 instead of ext3/4 in the unix world. A quick
>>>> google search linked me to this:
>>>>
>>>
>>> ext2/3 is not a good choice for file size limitation and performance
>>> reasons.
>>>
>>> I started to search for a couple links, and a quick check of the links I
>>> posted a couple years ago seem to still be interesting ;)
>>>
>>> http://mail-archives.apache.org/mod_mbox/cassandra-user/
>>> 201204.mbox/%3C4F7C5C16.1020800@pbandjelly.org%3E
>>>
>>> (repost from above)
>>>
>>> Hopefully this is some good reading on the topic:
>>>
>>> https://www.google.com/search?q=xfs+site%3Ahttp%3A%2F%
>>> 2Fmail-archives.apache.org%2Fmod_mbox%2Fcassandra-user
>>>
>>> one of the more interesting considerations:
>>> http://mail-archives.apache.org/mod_mbox/cassandra-user/201004.mbox/%
>>> 3Ch2y96b607d1004131614k5382b3a5ie899989d629217bc@mail.gmail.com%3E
>>>
>>> http://wiki.apache.org/cassandra/CassandraHardware
>>>
>>> http://wiki.apache.org/cassandra/LargeDataSetConsiderations
>>>
>>> http://www.datastax.com/dev/blog/questions-from-the-tokyo-
>>> cassandra-conference
>>>
>>> --
>>> Kind regards,
>>> Michael
>>>
>>
>>
>>
>> --
>> *Paulo Motta*
>>
>> Chaordic | *Platform*
>> *www.chaordic.com.br <http://www.chaordic.com.br/>*
>> +55 48 3232.3200
>>
>>
>
>
> --
> *Paulo Motta*
>
> Chaordic | *Platform*
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> +55 48 3232.3200
>
--
Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
Skype: *burtonator*
blog: http://burtonator.wordpress.com
… or check out my Google+
profile<https://plus.google.com/102718274791889610666/posts>
<http://spinn3r.com>
War is peace. Freedom is slavery. Ignorance is strength. Corporations are
people.
Re: Disable FS journaling
Posted by Paulo Ricardo Motta Gomes <pa...@chaordicsystems.com>.
On Tue, May 20, 2014 at 1:24 PM, Terje Marthinussen <tmarthinussen@gmail.com
> wrote:
> Journal enabled is faster on almost all operations.
>
>
Good to know, thanks!
> Recovery here is more about saving you from waiting 1/2 hour from a
> traditional full file system check.
>
>
On an EC2 environment you normally lose the machine anyway on failures, so
that's not of much use in that case.
> Feel free to wait if you want though! :)
>
> Regards,
> Terje
>
> On 21 May 2014, at 01:11, Paulo Ricardo Motta Gomes <
> paulo.motta@chaordicsystems.com> wrote:
>
> Thanks for the links!
>
> Forgot to mention, using XFS here, as suggested by the Cassandra wiki. But
> just double checked and it's apparently not possible to disable journaling
> on XFS.
>
> One of ours sysadmin just suggested disabling journaling, since it's
> mostly for recovery purposes, and Cassandra already does that pretty well
> with commitlog, replication and anti-entropy. It would anyway be nice to
> know if there could be any performance benefits from it. But I personally
> don't think it would help much, due to the append-only nature of cassandra
> writes.
>
>
> On Tue, May 20, 2014 at 12:43 PM, Michael Shuler <mi...@pbandjelly.org>wrote:
>
>> On 05/20/2014 09:54 AM, Samir Faci wrote:
>>
>>> I'm not sure you'd be gaining much by doing this. This is probably
>>> dependent on the file system you're referring to when you say
>>> journaling. There's a few of them around,
>>>
>>> You could opt to use ext2 instead of ext3/4 in the unix world. A quick
>>> google search linked me to this:
>>>
>>
>> ext2/3 is not a good choice for file size limitation and performance
>> reasons.
>>
>> I started to search for a couple links, and a quick check of the links I
>> posted a couple years ago seem to still be interesting ;)
>>
>> http://mail-archives.apache.org/mod_mbox/cassandra-user/
>> 201204.mbox/%3C4F7C5C16.1020800@pbandjelly.org%3E
>>
>> (repost from above)
>>
>> Hopefully this is some good reading on the topic:
>>
>> https://www.google.com/search?q=xfs+site%3Ahttp%3A%2F%
>> 2Fmail-archives.apache.org%2Fmod_mbox%2Fcassandra-user
>>
>> one of the more interesting considerations:
>> http://mail-archives.apache.org/mod_mbox/cassandra-user/201004.mbox/%
>> 3Ch2y96b607d1004131614k5382b3a5ie899989d629217bc@mail.gmail.com%3E
>>
>> http://wiki.apache.org/cassandra/CassandraHardware
>>
>> http://wiki.apache.org/cassandra/LargeDataSetConsiderations
>>
>> http://www.datastax.com/dev/blog/questions-from-the-tokyo-
>> cassandra-conference
>>
>> --
>> Kind regards,
>> Michael
>>
>
>
>
> --
> *Paulo Motta*
>
> Chaordic | *Platform*
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> +55 48 3232.3200
>
>
--
*Paulo Motta*
Chaordic | *Platform*
*www.chaordic.com.br <http://www.chaordic.com.br/>*
+55 48 3232.3200
Re: Disable FS journaling
Posted by Terje Marthinussen <tm...@gmail.com>.
Journal enabled is faster on almost all operations.
Recovery here is more about saving you from waiting 1/2 hour from a traditional full file system check.
Feel free to wait if you want though! :)
Regards,
Terje
> On 21 May 2014, at 01:11, Paulo Ricardo Motta Gomes <pa...@chaordicsystems.com> wrote:
>
> Thanks for the links!
>
> Forgot to mention, using XFS here, as suggested by the Cassandra wiki. But just double checked and it's apparently not possible to disable journaling on XFS.
>
> One of ours sysadmin just suggested disabling journaling, since it's mostly for recovery purposes, and Cassandra already does that pretty well with commitlog, replication and anti-entropy. It would anyway be nice to know if there could be any performance benefits from it. But I personally don't think it would help much, due to the append-only nature of cassandra writes.
>
>
>> On Tue, May 20, 2014 at 12:43 PM, Michael Shuler <mi...@pbandjelly.org> wrote:
>>> On 05/20/2014 09:54 AM, Samir Faci wrote:
>>> I'm not sure you'd be gaining much by doing this. This is probably
>>> dependent on the file system you're referring to when you say
>>> journaling. There's a few of them around,
>>>
>>> You could opt to use ext2 instead of ext3/4 in the unix world. A quick
>>> google search linked me to this:
>>
>> ext2/3 is not a good choice for file size limitation and performance reasons.
>>
>> I started to search for a couple links, and a quick check of the links I posted a couple years ago seem to still be interesting ;)
>>
>> http://mail-archives.apache.org/mod_mbox/cassandra-user/201204.mbox/%3C4F7C5C16.1020800@pbandjelly.org%3E
>>
>> (repost from above)
>>
>> Hopefully this is some good reading on the topic:
>>
>> https://www.google.com/search?q=xfs+site%3Ahttp%3A%2F%2Fmail-archives.apache.org%2Fmod_mbox%2Fcassandra-user
>>
>> one of the more interesting considerations:
>> http://mail-archives.apache.org/mod_mbox/cassandra-user/201004.mbox/%3Ch2y96b607d1004131614k5382b3a5ie899989d629217bc@mail.gmail.com%3E
>>
>> http://wiki.apache.org/cassandra/CassandraHardware
>>
>> http://wiki.apache.org/cassandra/LargeDataSetConsiderations
>>
>> http://www.datastax.com/dev/blog/questions-from-the-tokyo-cassandra-conference
>>
>> --
>> Kind regards,
>> Michael
>
>
>
> --
> Paulo Motta
>
> Chaordic | Platform
> www.chaordic.com.br
> +55 48 3232.3200
Re: Disable FS journaling
Posted by Paulo Ricardo Motta Gomes <pa...@chaordicsystems.com>.
Thanks for the links!
Forgot to mention, using XFS here, as suggested by the Cassandra wiki. But
just double checked and it's apparently not possible to disable journaling
on XFS.
One of ours sysadmin just suggested disabling journaling, since it's mostly
for recovery purposes, and Cassandra already does that pretty well with
commitlog, replication and anti-entropy. It would anyway be nice to know if
there could be any performance benefits from it. But I personally don't
think it would help much, due to the append-only nature of cassandra writes.
On Tue, May 20, 2014 at 12:43 PM, Michael Shuler <mi...@pbandjelly.org>wrote:
> On 05/20/2014 09:54 AM, Samir Faci wrote:
>
>> I'm not sure you'd be gaining much by doing this. This is probably
>> dependent on the file system you're referring to when you say
>> journaling. There's a few of them around,
>>
>> You could opt to use ext2 instead of ext3/4 in the unix world. A quick
>> google search linked me to this:
>>
>
> ext2/3 is not a good choice for file size limitation and performance
> reasons.
>
> I started to search for a couple links, and a quick check of the links I
> posted a couple years ago seem to still be interesting ;)
>
> http://mail-archives.apache.org/mod_mbox/cassandra-user/
> 201204.mbox/%3C4F7C5C16.1020800@pbandjelly.org%3E
>
> (repost from above)
>
> Hopefully this is some good reading on the topic:
>
> https://www.google.com/search?q=xfs+site%3Ahttp%3A%2F%
> 2Fmail-archives.apache.org%2Fmod_mbox%2Fcassandra-user
>
> one of the more interesting considerations:
> http://mail-archives.apache.org/mod_mbox/cassandra-user/201004.mbox/%
> 3Ch2y96b607d1004131614k5382b3a5ie899989d629217bc@mail.gmail.com%3E
>
> http://wiki.apache.org/cassandra/CassandraHardware
>
> http://wiki.apache.org/cassandra/LargeDataSetConsiderations
>
> http://www.datastax.com/dev/blog/questions-from-the-tokyo-
> cassandra-conference
>
> --
> Kind regards,
> Michael
>
--
*Paulo Motta*
Chaordic | *Platform*
*www.chaordic.com.br <http://www.chaordic.com.br/>*
+55 48 3232.3200
Re: Disable FS journaling
Posted by Michael Shuler <mi...@pbandjelly.org>.
On 05/20/2014 09:54 AM, Samir Faci wrote:
> I'm not sure you'd be gaining much by doing this. This is probably
> dependent on the file system you're referring to when you say
> journaling. There's a few of them around,
>
> You could opt to use ext2 instead of ext3/4 in the unix world. A quick
> google search linked me to this:
ext2/3 is not a good choice for file size limitation and performance
reasons.
I started to search for a couple links, and a quick check of the links I
posted a couple years ago seem to still be interesting ;)
http://mail-archives.apache.org/mod_mbox/cassandra-user/201204.mbox/%3C4F7C5C16.1020800@pbandjelly.org%3E
(repost from above)
Hopefully this is some good reading on the topic:
https://www.google.com/search?q=xfs+site%3Ahttp%3A%2F%2Fmail-archives.apache.org%2Fmod_mbox%2Fcassandra-user
one of the more interesting considerations:
http://mail-archives.apache.org/mod_mbox/cassandra-user/201004.mbox/%3Ch2y96b607d1004131614k5382b3a5ie899989d629217bc@mail.gmail.com%3E
http://wiki.apache.org/cassandra/CassandraHardware
http://wiki.apache.org/cassandra/LargeDataSetConsiderations
http://www.datastax.com/dev/blog/questions-from-the-tokyo-cassandra-conference
--
Kind regards,
Michael
Re: Disable FS journaling
Posted by Samir Faci <sa...@esamir.com>.
I'm not sure you'd be gaining much by doing this. This is probably
dependent on the file system you're referring to when you say
journaling. There's a few of them around,
You could opt to use ext2 instead of ext3/4 in the unix world. A quick
google search linked me to this:
http://blog.serverbuddies.com/disable-journaling-in-ext3-file-system/
looks like:
tune2fs -O^has_journal /dev/xdy #disable journaling
tune2fs -j /dev/xdy #enable journaling.
On Tue, May 20, 2014 at 7:43 AM, Paulo Ricardo Motta Gomes <
paulo.motta@chaordicsystems.com> wrote:
> Hello,
>
> Has anyone disabled file system journaling on Cassandra nodes? Does it
> make any difference on write performance?
>
> Cheers,
>
> --
> *Paulo Motta*
>
> Chaordic | *Platform*
> *www.chaordic.com.br <http://www.chaordic.com.br/>*
> +55 48 3232.3200
>
--
Samir Faci
*insert title*
fortune | cowsay -f /usr/share/cows/tux.cow
Sent from my non-iphone laptop.