You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@couchdb.apache.org by max <ma...@gmail.com> on 2018/05/24 16:07:09 UTC
Which filesystem are you using?
Hi,
I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it works
great.
But I'm gonna migrate my data to a bigger server and I'd like to find some
advice about filesystem I should or should not use.
I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I know
CouchDB is tail-append but some of .couch database are close 100 GB and
then was wondering about my next filesystem to store those .couch files.
Which one is better faster stronger? Which one cannot (should not) be used?
I was thinking about zfs, xfs, btrfs...
Any advice?
Thanks.
Max.
Re: Which filesystem are you using?
Posted by Assaf <as...@gmail.com>.
I've had performance issues with EXT4 on ubuntu 16.04 with ~4TB of DBs.
Now I'm using XFS on ubuntu 16.04 and have no issues with ~12TB of DBs. I'm
using CouchDB 2.0.
Here are some insights I learned over time -
https://github.com/assafmo/couchdb-linux-performance
On Fri, May 25, 2018 at 1:34 AM Sean Lang <sl...@gmail.com> wrote:
> I'm using CoreOS - I run CouchDB inside of a Docker container and use
> containers for just about everything else I run, so it's a nice fit.
> However, I think that btrfs comes standard on most Linux distros now, since
> it has been included in the mainline kernel since 2.6.
>
> Also, I've never tried out RAID5 with btrfs, so I can't comment on the data
> loss that Touzet mentioned. I don't think that the btrfs wiki recommends
> using RAID5/6 at all, since it's slower and isn't stable yet.
>
> On Thu, May 24, 2018 at 4:45 PM max <ma...@gmail.com> wrote:
>
> > Thank you. Which OS are you using with btfrs?
> >
> > Le jeu. 24 mai 2018 à 22:41, Sean Lang <sl...@gmail.com> a écrit :
> >
> > > I use BTRFS in RAID10 and it works well. I've been running it on 3
> > servers
> > > for more than a year under near 24/7 load and haven't run into any
> issues
> > > with the filesystem. However, it's not a "production" setup where I've
> > even
> > > attempted to maintain 99.999% uptime, it's just a personal project
> doing
> > > data processing. Also, I don't have any benchmarks to say whether it's
> > > faster or slower than another filesystem.
> > >
> > > On Thu, May 24, 2018 at 12:46 PM Joan Touzet <wo...@apache.org>
> wrote:
> > >
> > > > Sorry, I should have qualified - I recommend ZFS on *BSD and Solaris
> > > > derivatives, and xfs on Linuxes. Performance is a concern on Linux,
> > yes.
> > > I
> > > > personally also don't buy Shuttleworth's argument that ZFS on Linux
> > > doesn't
> > > > taint the kernel. But that's a discussion for a different forum... :)
> > > >
> > > >
> > > > -Joan
> > > >
> > > > ----- Original Message -----
> > > >
> > > > From: "max" <ma...@gmail.com>
> > > > To: user@couchdb.apache.org, "Joan Touzet" <wo...@apache.org>
> > > > Sent: Thursday, May 24, 2018 12:40:40 PM
> > > > Subject: Re: Which filesystem are you using?
> > > >
> > > >
> > > > Thank you for your quick answer.
> > > >
> > > >
> > > > No fear about zfs on ubuntu? I could hear about degraded disk perf on
> > > > other system than FreeBSD...
> > > >
> > > >
> > > > 2018-05-24 18:09 GMT+02:00 Joan Touzet < wohali@apache.org > :
> > > >
> > > >
> > > > zfs and xfs are great choices, especially for filesystem snapshots
> and
> > > > backup.
> > > >
> > > > personally, i recommend against btrfs due to certain data loss
> > scenarios
> > > > in RAID 5 setups, which is a common approach for database servers.
> > > >
> > > >
> > > >
> > > > ----- Original Message -----
> > > > From: "max" < maxima078@gmail.com >
> > > > To: user@couchdb.apache.org
> > > > Sent: Thursday, May 24, 2018 12:07:09 PM
> > > > Subject: Which filesystem are you using?
> > > >
> > > > Hi,
> > > >
> > > > I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it
> > works
> > > > great.
> > > > But I'm gonna migrate my data to a bigger server and I'd like to find
> > > some
> > > > advice about filesystem I should or should not use.
> > > >
> > > > I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I
> > know
> > > > CouchDB is tail-append but some of .couch database are close 100 GB
> and
> > > > then was wondering about my next filesystem to store those .couch
> > files.
> > > > Which one is better faster stronger? Which one cannot (should not) be
> > > > used?
> > > > I was thinking about zfs, xfs, btrfs...
> > > >
> > > > Any advice?
> > > >
> > > > Thanks.
> > > >
> > > > Max.
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> >
>
Re: Which filesystem are you using?
Posted by Sean Lang <sl...@gmail.com>.
I'm using CoreOS - I run CouchDB inside of a Docker container and use
containers for just about everything else I run, so it's a nice fit.
However, I think that btrfs comes standard on most Linux distros now, since
it has been included in the mainline kernel since 2.6.
Also, I've never tried out RAID5 with btrfs, so I can't comment on the data
loss that Touzet mentioned. I don't think that the btrfs wiki recommends
using RAID5/6 at all, since it's slower and isn't stable yet.
On Thu, May 24, 2018 at 4:45 PM max <ma...@gmail.com> wrote:
> Thank you. Which OS are you using with btfrs?
>
> Le jeu. 24 mai 2018 à 22:41, Sean Lang <sl...@gmail.com> a écrit :
>
> > I use BTRFS in RAID10 and it works well. I've been running it on 3
> servers
> > for more than a year under near 24/7 load and haven't run into any issues
> > with the filesystem. However, it's not a "production" setup where I've
> even
> > attempted to maintain 99.999% uptime, it's just a personal project doing
> > data processing. Also, I don't have any benchmarks to say whether it's
> > faster or slower than another filesystem.
> >
> > On Thu, May 24, 2018 at 12:46 PM Joan Touzet <wo...@apache.org> wrote:
> >
> > > Sorry, I should have qualified - I recommend ZFS on *BSD and Solaris
> > > derivatives, and xfs on Linuxes. Performance is a concern on Linux,
> yes.
> > I
> > > personally also don't buy Shuttleworth's argument that ZFS on Linux
> > doesn't
> > > taint the kernel. But that's a discussion for a different forum... :)
> > >
> > >
> > > -Joan
> > >
> > > ----- Original Message -----
> > >
> > > From: "max" <ma...@gmail.com>
> > > To: user@couchdb.apache.org, "Joan Touzet" <wo...@apache.org>
> > > Sent: Thursday, May 24, 2018 12:40:40 PM
> > > Subject: Re: Which filesystem are you using?
> > >
> > >
> > > Thank you for your quick answer.
> > >
> > >
> > > No fear about zfs on ubuntu? I could hear about degraded disk perf on
> > > other system than FreeBSD...
> > >
> > >
> > > 2018-05-24 18:09 GMT+02:00 Joan Touzet < wohali@apache.org > :
> > >
> > >
> > > zfs and xfs are great choices, especially for filesystem snapshots and
> > > backup.
> > >
> > > personally, i recommend against btrfs due to certain data loss
> scenarios
> > > in RAID 5 setups, which is a common approach for database servers.
> > >
> > >
> > >
> > > ----- Original Message -----
> > > From: "max" < maxima078@gmail.com >
> > > To: user@couchdb.apache.org
> > > Sent: Thursday, May 24, 2018 12:07:09 PM
> > > Subject: Which filesystem are you using?
> > >
> > > Hi,
> > >
> > > I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it
> works
> > > great.
> > > But I'm gonna migrate my data to a bigger server and I'd like to find
> > some
> > > advice about filesystem I should or should not use.
> > >
> > > I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I
> know
> > > CouchDB is tail-append but some of .couch database are close 100 GB and
> > > then was wondering about my next filesystem to store those .couch
> files.
> > > Which one is better faster stronger? Which one cannot (should not) be
> > > used?
> > > I was thinking about zfs, xfs, btrfs...
> > >
> > > Any advice?
> > >
> > > Thanks.
> > >
> > > Max.
> > >
> > >
> > >
> > >
> > >
> >
>
Re: Which filesystem are you using?
Posted by max <ma...@gmail.com>.
Thank you. Which OS are you using with btfrs?
Le jeu. 24 mai 2018 à 22:41, Sean Lang <sl...@gmail.com> a écrit :
> I use BTRFS in RAID10 and it works well. I've been running it on 3 servers
> for more than a year under near 24/7 load and haven't run into any issues
> with the filesystem. However, it's not a "production" setup where I've even
> attempted to maintain 99.999% uptime, it's just a personal project doing
> data processing. Also, I don't have any benchmarks to say whether it's
> faster or slower than another filesystem.
>
> On Thu, May 24, 2018 at 12:46 PM Joan Touzet <wo...@apache.org> wrote:
>
> > Sorry, I should have qualified - I recommend ZFS on *BSD and Solaris
> > derivatives, and xfs on Linuxes. Performance is a concern on Linux, yes.
> I
> > personally also don't buy Shuttleworth's argument that ZFS on Linux
> doesn't
> > taint the kernel. But that's a discussion for a different forum... :)
> >
> >
> > -Joan
> >
> > ----- Original Message -----
> >
> > From: "max" <ma...@gmail.com>
> > To: user@couchdb.apache.org, "Joan Touzet" <wo...@apache.org>
> > Sent: Thursday, May 24, 2018 12:40:40 PM
> > Subject: Re: Which filesystem are you using?
> >
> >
> > Thank you for your quick answer.
> >
> >
> > No fear about zfs on ubuntu? I could hear about degraded disk perf on
> > other system than FreeBSD...
> >
> >
> > 2018-05-24 18:09 GMT+02:00 Joan Touzet < wohali@apache.org > :
> >
> >
> > zfs and xfs are great choices, especially for filesystem snapshots and
> > backup.
> >
> > personally, i recommend against btrfs due to certain data loss scenarios
> > in RAID 5 setups, which is a common approach for database servers.
> >
> >
> >
> > ----- Original Message -----
> > From: "max" < maxima078@gmail.com >
> > To: user@couchdb.apache.org
> > Sent: Thursday, May 24, 2018 12:07:09 PM
> > Subject: Which filesystem are you using?
> >
> > Hi,
> >
> > I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it works
> > great.
> > But I'm gonna migrate my data to a bigger server and I'd like to find
> some
> > advice about filesystem I should or should not use.
> >
> > I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I know
> > CouchDB is tail-append but some of .couch database are close 100 GB and
> > then was wondering about my next filesystem to store those .couch files.
> > Which one is better faster stronger? Which one cannot (should not) be
> > used?
> > I was thinking about zfs, xfs, btrfs...
> >
> > Any advice?
> >
> > Thanks.
> >
> > Max.
> >
> >
> >
> >
> >
>
Re: Which filesystem are you using?
Posted by Sean Lang <sl...@gmail.com>.
I use BTRFS in RAID10 and it works well. I've been running it on 3 servers
for more than a year under near 24/7 load and haven't run into any issues
with the filesystem. However, it's not a "production" setup where I've even
attempted to maintain 99.999% uptime, it's just a personal project doing
data processing. Also, I don't have any benchmarks to say whether it's
faster or slower than another filesystem.
On Thu, May 24, 2018 at 12:46 PM Joan Touzet <wo...@apache.org> wrote:
> Sorry, I should have qualified - I recommend ZFS on *BSD and Solaris
> derivatives, and xfs on Linuxes. Performance is a concern on Linux, yes. I
> personally also don't buy Shuttleworth's argument that ZFS on Linux doesn't
> taint the kernel. But that's a discussion for a different forum... :)
>
>
> -Joan
>
> ----- Original Message -----
>
> From: "max" <ma...@gmail.com>
> To: user@couchdb.apache.org, "Joan Touzet" <wo...@apache.org>
> Sent: Thursday, May 24, 2018 12:40:40 PM
> Subject: Re: Which filesystem are you using?
>
>
> Thank you for your quick answer.
>
>
> No fear about zfs on ubuntu? I could hear about degraded disk perf on
> other system than FreeBSD...
>
>
> 2018-05-24 18:09 GMT+02:00 Joan Touzet < wohali@apache.org > :
>
>
> zfs and xfs are great choices, especially for filesystem snapshots and
> backup.
>
> personally, i recommend against btrfs due to certain data loss scenarios
> in RAID 5 setups, which is a common approach for database servers.
>
>
>
> ----- Original Message -----
> From: "max" < maxima078@gmail.com >
> To: user@couchdb.apache.org
> Sent: Thursday, May 24, 2018 12:07:09 PM
> Subject: Which filesystem are you using?
>
> Hi,
>
> I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it works
> great.
> But I'm gonna migrate my data to a bigger server and I'd like to find some
> advice about filesystem I should or should not use.
>
> I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I know
> CouchDB is tail-append but some of .couch database are close 100 GB and
> then was wondering about my next filesystem to store those .couch files.
> Which one is better faster stronger? Which one cannot (should not) be
> used?
> I was thinking about zfs, xfs, btrfs...
>
> Any advice?
>
> Thanks.
>
> Max.
>
>
>
>
>
Re: Which filesystem are you using?
Posted by Joan Touzet <wo...@apache.org>.
Sorry, I should have qualified - I recommend ZFS on *BSD and Solaris derivatives, and xfs on Linuxes. Performance is a concern on Linux, yes. I personally also don't buy Shuttleworth's argument that ZFS on Linux doesn't taint the kernel. But that's a discussion for a different forum... :)
-Joan
----- Original Message -----
From: "max" <ma...@gmail.com>
To: user@couchdb.apache.org, "Joan Touzet" <wo...@apache.org>
Sent: Thursday, May 24, 2018 12:40:40 PM
Subject: Re: Which filesystem are you using?
Thank you for your quick answer.
No fear about zfs on ubuntu? I could hear about degraded disk perf on other system than FreeBSD...
2018-05-24 18:09 GMT+02:00 Joan Touzet < wohali@apache.org > :
zfs and xfs are great choices, especially for filesystem snapshots and
backup.
personally, i recommend against btrfs due to certain data loss scenarios
in RAID 5 setups, which is a common approach for database servers.
----- Original Message -----
From: "max" < maxima078@gmail.com >
To: user@couchdb.apache.org
Sent: Thursday, May 24, 2018 12:07:09 PM
Subject: Which filesystem are you using?
Hi,
I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it works
great.
But I'm gonna migrate my data to a bigger server and I'd like to find some
advice about filesystem I should or should not use.
I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I know
CouchDB is tail-append but some of .couch database are close 100 GB and
then was wondering about my next filesystem to store those .couch files.
Which one is better faster stronger? Which one cannot (should not) be used?
I was thinking about zfs, xfs, btrfs...
Any advice?
Thanks.
Max.
Re: Which filesystem are you using?
Posted by max <ma...@gmail.com>.
Thank you for your quick answer.
No fear about zfs on ubuntu? I could hear about degraded disk perf on other
system than FreeBSD...
2018-05-24 18:09 GMT+02:00 Joan Touzet <wo...@apache.org>:
> zfs and xfs are great choices, especially for filesystem snapshots and
> backup.
>
> personally, i recommend against btrfs due to certain data loss scenarios
> in RAID 5 setups, which is a common approach for database servers.
>
> ----- Original Message -----
> From: "max" <ma...@gmail.com>
> To: user@couchdb.apache.org
> Sent: Thursday, May 24, 2018 12:07:09 PM
> Subject: Which filesystem are you using?
>
> Hi,
>
> I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it works
> great.
> But I'm gonna migrate my data to a bigger server and I'd like to find some
> advice about filesystem I should or should not use.
>
> I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I know
> CouchDB is tail-append but some of .couch database are close 100 GB and
> then was wondering about my next filesystem to store those .couch files.
> Which one is better faster stronger? Which one cannot (should not) be used?
> I was thinking about zfs, xfs, btrfs...
>
> Any advice?
>
> Thanks.
>
> Max.
>
Re: Which filesystem are you using?
Posted by Joan Touzet <wo...@apache.org>.
zfs and xfs are great choices, especially for filesystem snapshots and
backup.
personally, i recommend against btrfs due to certain data loss scenarios
in RAID 5 setups, which is a common approach for database servers.
----- Original Message -----
From: "max" <ma...@gmail.com>
To: user@couchdb.apache.org
Sent: Thursday, May 24, 2018 12:07:09 PM
Subject: Which filesystem are you using?
Hi,
I'm using CouchDB 1.7.1 on Ubuntu 16.04 with ext4 filesystem and it works
great.
But I'm gonna migrate my data to a bigger server and I'd like to find some
advice about filesystem I should or should not use.
I'll install Ubuntu 16.04, and I need to backup my data (*.couch), I know
CouchDB is tail-append but some of .couch database are close 100 GB and
then was wondering about my next filesystem to store those .couch files.
Which one is better faster stronger? Which one cannot (should not) be used?
I was thinking about zfs, xfs, btrfs...
Any advice?
Thanks.
Max.