You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Fariborz Navidan <md...@gmail.com> on 2019/07/15 10:49:02 UTC

[VOTE] Ceph, ZFS or Linux Soft RAID?

Hello,

Which one do you think is faster to use for local soft Raid-0 for primary
storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which one can
gives us better IOPS and IO latency on NVMe SSD disks? The storage will be
used for production cloud environment where arround 60 VMs will run on top
of it.

Your ides are highly appreciated

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Fariborz Navidan <md...@gmail.com>.
The use case is public VPS hosting.

On Mon, Jul 15, 2019 at 7:20 PM Andrija Panic <an...@gmail.com>
wrote:

> XFS ("puke" smiley from skype goes here..), some funny issues historically,
> but should be "better" than ext4 (I still prefer ext4 if possible).
> CEPH - awful a lot knowledge and expertise is required, especially to tune
> it for NVME - but do you want LOCAL or DISTRIBUTED storage (since Ceph is
> distributed, KVM only stuff) ?
> ZFS (puke) (puke) (puke) - works fine in sense of working, but the
> performance penalty is just insane, avoid like a plague!
>
> If you don't require a lot of live migrations (not supported with local
> storage/KVM, though there is some support for KVM in 4.12 for ROOT volumes
> only, if not mistaken) - then go with pure local storage with NVME - that's
> the best KISS method and the most performant one (test and choose FS for
> it).
>
> As others have asked, it depends what you want to accomplish and what is
> your use case (feel free to share it if you like).
>
> Cheers
>
>
> On Mon, 15 Jul 2019 at 16:30, Sven Vogel <S....@ewerk.com> wrote:
>
> > I think I would go for ceph …
> >
> >
> > __
> >
> > Sven Vogel
> > Teamlead Platform
> >
> > EWERK RZ GmbH
> > Brühl 24, D-04109 Leipzig
> > P +49 341 42649 - 11
> > F +49 341 42649 - 18
> > S.Vogel@ewerk.com
> > www.ewerk.com
> >
> > Geschäftsführer:
> > Dr. Erik Wende, Hendrik Schubert, Frank Richter
> > Registergericht: Leipzig HRB 17023
> >
> > Zertifiziert nach:
> > ISO/IEC 27001:2013
> > DIN EN ISO 9001:2015
> > DIN ISO/IEC 20000-1:2011
> >
> > EWERK-Blog | LinkedIn | Xing | Twitter | Facebook
> >
> > Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
> >
> > Disclaimer Privacy:
> > Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien)
> ist
> > vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der
> > bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung,
> > Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte
> > informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie
> > die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem
> System.
> > Vielen Dank.
> >
> > The contents of this e-mail (including any attachments) are confidential
> > and may be legally privileged. If you are not the intended recipient of
> > this e-mail, any disclosure, copying, distribution or use of its contents
> > is strictly prohibited, and you should please notify the sender
> immediately
> > and then delete it (including any attachments) from your system. Thank
> you.
> > > Am 15.07.2019 um 16:25 schrieb Vladimir Melnik <v....@uplink.ua>:
> > >
> > > Hello,
> > >
> > > Isn't xfs better than ext4 for that?
> > >
> > > Thanks.
> > >
> > > On Mon, Jul 15, 2019 at 06:23:11PM +0700, Ivan Kudryavtsev wrote:
> > >> if you use local fs, use just ext4 over the required disk topology
> which
> > >> gives the desired redundancy.
> >
> >
>
> --
>
> Andrija Panić
>

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Andrija Panic <an...@gmail.com>.
XFS ("puke" smiley from skype goes here..), some funny issues historically,
but should be "better" than ext4 (I still prefer ext4 if possible).
CEPH - awful a lot knowledge and expertise is required, especially to tune
it for NVME - but do you want LOCAL or DISTRIBUTED storage (since Ceph is
distributed, KVM only stuff) ?
ZFS (puke) (puke) (puke) - works fine in sense of working, but the
performance penalty is just insane, avoid like a plague!

If you don't require a lot of live migrations (not supported with local
storage/KVM, though there is some support for KVM in 4.12 for ROOT volumes
only, if not mistaken) - then go with pure local storage with NVME - that's
the best KISS method and the most performant one (test and choose FS for
it).

As others have asked, it depends what you want to accomplish and what is
your use case (feel free to share it if you like).

Cheers


On Mon, 15 Jul 2019 at 16:30, Sven Vogel <S....@ewerk.com> wrote:

> I think I would go for ceph …
>
>
> __
>
> Sven Vogel
> Teamlead Platform
>
> EWERK RZ GmbH
> Brühl 24, D-04109 Leipzig
> P +49 341 42649 - 11
> F +49 341 42649 - 18
> S.Vogel@ewerk.com
> www.ewerk.com
>
> Geschäftsführer:
> Dr. Erik Wende, Hendrik Schubert, Frank Richter
> Registergericht: Leipzig HRB 17023
>
> Zertifiziert nach:
> ISO/IEC 27001:2013
> DIN EN ISO 9001:2015
> DIN ISO/IEC 20000-1:2011
>
> EWERK-Blog | LinkedIn | Xing | Twitter | Facebook
>
> Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.
>
> Disclaimer Privacy:
> Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist
> vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der
> bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung,
> Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte
> informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie
> die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System.
> Vielen Dank.
>
> The contents of this e-mail (including any attachments) are confidential
> and may be legally privileged. If you are not the intended recipient of
> this e-mail, any disclosure, copying, distribution or use of its contents
> is strictly prohibited, and you should please notify the sender immediately
> and then delete it (including any attachments) from your system. Thank you.
> > Am 15.07.2019 um 16:25 schrieb Vladimir Melnik <v....@uplink.ua>:
> >
> > Hello,
> >
> > Isn't xfs better than ext4 for that?
> >
> > Thanks.
> >
> > On Mon, Jul 15, 2019 at 06:23:11PM +0700, Ivan Kudryavtsev wrote:
> >> if you use local fs, use just ext4 over the required disk topology which
> >> gives the desired redundancy.
>
>

-- 

Andrija Panić

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Sven Vogel <S....@ewerk.com>.
I think I would go for ceph …


__

Sven Vogel
Teamlead Platform

EWERK RZ GmbH
Brühl 24, D-04109 Leipzig
P +49 341 42649 - 11
F +49 341 42649 - 18
S.Vogel@ewerk.com
www.ewerk.com

Geschäftsführer:
Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 17023

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 20000-1:2011

EWERK-Blog | LinkedIn | Xing | Twitter | Facebook

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist vertraulich und nur für den Empfänger bestimmt. Sollten Sie nicht der bestimmungsgemäße Empfänger sein, ist Ihnen jegliche Offenlegung, Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt. Bitte informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die E-Mail (einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen Dank.

The contents of this e-mail (including any attachments) are confidential and may be legally privileged. If you are not the intended recipient of this e-mail, any disclosure, copying, distribution or use of its contents is strictly prohibited, and you should please notify the sender immediately and then delete it (including any attachments) from your system. Thank you.
> Am 15.07.2019 um 16:25 schrieb Vladimir Melnik <v....@uplink.ua>:
>
> Hello,
>
> Isn't xfs better than ext4 for that?
>
> Thanks.
>
> On Mon, Jul 15, 2019 at 06:23:11PM +0700, Ivan Kudryavtsev wrote:
>> if you use local fs, use just ext4 over the required disk topology which
>> gives the desired redundancy.


Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Vladimir Melnik <v....@uplink.ua>.
Hello,

Isn't xfs better than ext4 for that?

Thanks.

On Mon, Jul 15, 2019 at 06:23:11PM +0700, Ivan Kudryavtsev wrote:
> if you use local fs, use just ext4 over the required disk topology which
> gives the desired redundancy.

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Fariborz Navidan <md...@gmail.com>.
Thanks to all

On Mon, Jul 15, 2019 at 6:31 PM <nu...@li.nux.ro> wrote:

> What's the use case exactly, what are you aiming to achieve?
>
> Any layer you add will increase latency, NFS especially, even if it's
> local.
>
>
> On 2019-07-15 14:56, Fariborz Navidan wrote:
> > Thank you for opinions.
> >
> > Also I would ask you another question. how would difference in mater of
> > performance between pure local storage and local nfs storage (local
> > drives
> > are exported and mounted on local machines)?
> >
> > On Mon, Jul 15, 2019 at 6:15 PM Ivan Kudryavtsev
> > <ku...@bw-sw.com>
> > wrote:
> >
> >> ZFS is not a good choice for high IO applications. Use the most simple
> >> layering as possible.
> >>
> >> пн, 15 июл. 2019 г., 18:50 Christoffer Pedersen <vr...@vrod.dk>:
> >>
> >> > Hello,
> >> >
> >> > ZFS is unfortunately not supported, otherwise I would have recommended
> >> > that. But if you are going local systems (no nfs/iscsi), ext4 would be
> >> the
> >> > way to go.
> >> >
> >> > On Mon, Jul 15, 2019 at 1:23 PM Ivan Kudryavtsev <
> >> kudryavtsev_ia@bw-sw.com
> >> > >
> >> > wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > > if you use local fs, use just ext4 over the required disk topology
> >> which
> >> > > gives the desired redundancy.
> >> > >
> >> > > E.g. JBOD, R0 work well when data safety policy is established and
> >> > backups
> >> > > are maintained well.
> >> > >
> >> > > Otherwise look to R5, R10 or R6.
> >> > >
> >> > > пн, 15 июл. 2019 г., 18:05 <nu...@li.nux.ro>:
> >> > >
> >> > > > Isn't that a bit apples and oranges? Ceph is a network distributed
> >> > > > thingy, not a local solution.
> >> > > >
> >> > > > I'd use linux/software raid + lvm, it's the only one supported (by
> >> > > > CentOS/RedHat).
> >> > > >
> >> > > > ZFS on Linux could be interesting if it was supported by
> Cloudstack,
> >> > but
> >> > > > it is not, you'd end up using qcow2 (COW) files on top of a COW
> >> > > > filesystem which could lead to issues. Also ZFS is not really the
> >> > > > fastest fs out there, though it does have some nice features.
> >> > > >
> >> > > > Did you really mean raid 0? I hope you have backups. :)
> >> > > >
> >> > > > hth
> >> > > >
> >> > > >
> >> > > > On 2019-07-15 11:49, Fariborz Navidan wrote:
> >> > > > > Hello,
> >> > > > >
> >> > > > > Which one do you think is faster to use for local soft Raid-0
> for
> >> > > > > primary
> >> > > > > storage? Ceph, ZFS or Built-in soft raid manager of CentOS?
> Which
> >> one
> >> > > > > can
> >> > > > > gives us better IOPS and IO latency on NVMe SSD disks? The
> storage
> >> > will
> >> > > > > be
> >> > > > > used for production cloud environment where arround 60 VMs will
> run
> >> > on
> >> > > > > top
> >> > > > > of it.
> >> > > > >
> >> > > > > Your ides are highly appreciated
> >> > > >
> >> > >
> >> >
> >> >
> >> > --
> >> > Thanks,
> >> > Chris pedersen
> >> >
> >>
>

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by nu...@li.nux.ro.
What's the use case exactly, what are you aiming to achieve?

Any layer you add will increase latency, NFS especially, even if it's 
local.


On 2019-07-15 14:56, Fariborz Navidan wrote:
> Thank you for opinions.
> 
> Also I would ask you another question. how would difference in mater of
> performance between pure local storage and local nfs storage (local 
> drives
> are exported and mounted on local machines)?
> 
> On Mon, Jul 15, 2019 at 6:15 PM Ivan Kudryavtsev 
> <ku...@bw-sw.com>
> wrote:
> 
>> ZFS is not a good choice for high IO applications. Use the most simple
>> layering as possible.
>> 
>> пн, 15 июл. 2019 г., 18:50 Christoffer Pedersen <vr...@vrod.dk>:
>> 
>> > Hello,
>> >
>> > ZFS is unfortunately not supported, otherwise I would have recommended
>> > that. But if you are going local systems (no nfs/iscsi), ext4 would be
>> the
>> > way to go.
>> >
>> > On Mon, Jul 15, 2019 at 1:23 PM Ivan Kudryavtsev <
>> kudryavtsev_ia@bw-sw.com
>> > >
>> > wrote:
>> >
>> > > Hi,
>> > >
>> > > if you use local fs, use just ext4 over the required disk topology
>> which
>> > > gives the desired redundancy.
>> > >
>> > > E.g. JBOD, R0 work well when data safety policy is established and
>> > backups
>> > > are maintained well.
>> > >
>> > > Otherwise look to R5, R10 or R6.
>> > >
>> > > пн, 15 июл. 2019 г., 18:05 <nu...@li.nux.ro>:
>> > >
>> > > > Isn't that a bit apples and oranges? Ceph is a network distributed
>> > > > thingy, not a local solution.
>> > > >
>> > > > I'd use linux/software raid + lvm, it's the only one supported (by
>> > > > CentOS/RedHat).
>> > > >
>> > > > ZFS on Linux could be interesting if it was supported by Cloudstack,
>> > but
>> > > > it is not, you'd end up using qcow2 (COW) files on top of a COW
>> > > > filesystem which could lead to issues. Also ZFS is not really the
>> > > > fastest fs out there, though it does have some nice features.
>> > > >
>> > > > Did you really mean raid 0? I hope you have backups. :)
>> > > >
>> > > > hth
>> > > >
>> > > >
>> > > > On 2019-07-15 11:49, Fariborz Navidan wrote:
>> > > > > Hello,
>> > > > >
>> > > > > Which one do you think is faster to use for local soft Raid-0 for
>> > > > > primary
>> > > > > storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which
>> one
>> > > > > can
>> > > > > gives us better IOPS and IO latency on NVMe SSD disks? The storage
>> > will
>> > > > > be
>> > > > > used for production cloud environment where arround 60 VMs will run
>> > on
>> > > > > top
>> > > > > of it.
>> > > > >
>> > > > > Your ides are highly appreciated
>> > > >
>> > >
>> >
>> >
>> > --
>> > Thanks,
>> > Chris pedersen
>> >
>> 

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Fariborz Navidan <md...@gmail.com>.
Thank you for opinions.

Also I would ask you another question. how would difference in mater of
performance between pure local storage and local nfs storage (local drives
are exported and mounted on local machines)?

On Mon, Jul 15, 2019 at 6:15 PM Ivan Kudryavtsev <ku...@bw-sw.com>
wrote:

> ZFS is not a good choice for high IO applications. Use the most simple
> layering as possible.
>
> пн, 15 июл. 2019 г., 18:50 Christoffer Pedersen <vr...@vrod.dk>:
>
> > Hello,
> >
> > ZFS is unfortunately not supported, otherwise I would have recommended
> > that. But if you are going local systems (no nfs/iscsi), ext4 would be
> the
> > way to go.
> >
> > On Mon, Jul 15, 2019 at 1:23 PM Ivan Kudryavtsev <
> kudryavtsev_ia@bw-sw.com
> > >
> > wrote:
> >
> > > Hi,
> > >
> > > if you use local fs, use just ext4 over the required disk topology
> which
> > > gives the desired redundancy.
> > >
> > > E.g. JBOD, R0 work well when data safety policy is established and
> > backups
> > > are maintained well.
> > >
> > > Otherwise look to R5, R10 or R6.
> > >
> > > пн, 15 июл. 2019 г., 18:05 <nu...@li.nux.ro>:
> > >
> > > > Isn't that a bit apples and oranges? Ceph is a network distributed
> > > > thingy, not a local solution.
> > > >
> > > > I'd use linux/software raid + lvm, it's the only one supported (by
> > > > CentOS/RedHat).
> > > >
> > > > ZFS on Linux could be interesting if it was supported by Cloudstack,
> > but
> > > > it is not, you'd end up using qcow2 (COW) files on top of a COW
> > > > filesystem which could lead to issues. Also ZFS is not really the
> > > > fastest fs out there, though it does have some nice features.
> > > >
> > > > Did you really mean raid 0? I hope you have backups. :)
> > > >
> > > > hth
> > > >
> > > >
> > > > On 2019-07-15 11:49, Fariborz Navidan wrote:
> > > > > Hello,
> > > > >
> > > > > Which one do you think is faster to use for local soft Raid-0 for
> > > > > primary
> > > > > storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which
> one
> > > > > can
> > > > > gives us better IOPS and IO latency on NVMe SSD disks? The storage
> > will
> > > > > be
> > > > > used for production cloud environment where arround 60 VMs will run
> > on
> > > > > top
> > > > > of it.
> > > > >
> > > > > Your ides are highly appreciated
> > > >
> > >
> >
> >
> > --
> > Thanks,
> > Chris pedersen
> >
>

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Ivan Kudryavtsev <ku...@bw-sw.com>.
ZFS is not a good choice for high IO applications. Use the most simple
layering as possible.

пн, 15 июл. 2019 г., 18:50 Christoffer Pedersen <vr...@vrod.dk>:

> Hello,
>
> ZFS is unfortunately not supported, otherwise I would have recommended
> that. But if you are going local systems (no nfs/iscsi), ext4 would be the
> way to go.
>
> On Mon, Jul 15, 2019 at 1:23 PM Ivan Kudryavtsev <kudryavtsev_ia@bw-sw.com
> >
> wrote:
>
> > Hi,
> >
> > if you use local fs, use just ext4 over the required disk topology which
> > gives the desired redundancy.
> >
> > E.g. JBOD, R0 work well when data safety policy is established and
> backups
> > are maintained well.
> >
> > Otherwise look to R5, R10 or R6.
> >
> > пн, 15 июл. 2019 г., 18:05 <nu...@li.nux.ro>:
> >
> > > Isn't that a bit apples and oranges? Ceph is a network distributed
> > > thingy, not a local solution.
> > >
> > > I'd use linux/software raid + lvm, it's the only one supported (by
> > > CentOS/RedHat).
> > >
> > > ZFS on Linux could be interesting if it was supported by Cloudstack,
> but
> > > it is not, you'd end up using qcow2 (COW) files on top of a COW
> > > filesystem which could lead to issues. Also ZFS is not really the
> > > fastest fs out there, though it does have some nice features.
> > >
> > > Did you really mean raid 0? I hope you have backups. :)
> > >
> > > hth
> > >
> > >
> > > On 2019-07-15 11:49, Fariborz Navidan wrote:
> > > > Hello,
> > > >
> > > > Which one do you think is faster to use for local soft Raid-0 for
> > > > primary
> > > > storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which one
> > > > can
> > > > gives us better IOPS and IO latency on NVMe SSD disks? The storage
> will
> > > > be
> > > > used for production cloud environment where arround 60 VMs will run
> on
> > > > top
> > > > of it.
> > > >
> > > > Your ides are highly appreciated
> > >
> >
>
>
> --
> Thanks,
> Chris pedersen
>

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Christoffer Pedersen <vr...@vrod.dk>.
Hello,

ZFS is unfortunately not supported, otherwise I would have recommended
that. But if you are going local systems (no nfs/iscsi), ext4 would be the
way to go.

On Mon, Jul 15, 2019 at 1:23 PM Ivan Kudryavtsev <ku...@bw-sw.com>
wrote:

> Hi,
>
> if you use local fs, use just ext4 over the required disk topology which
> gives the desired redundancy.
>
> E.g. JBOD, R0 work well when data safety policy is established and backups
> are maintained well.
>
> Otherwise look to R5, R10 or R6.
>
> пн, 15 июл. 2019 г., 18:05 <nu...@li.nux.ro>:
>
> > Isn't that a bit apples and oranges? Ceph is a network distributed
> > thingy, not a local solution.
> >
> > I'd use linux/software raid + lvm, it's the only one supported (by
> > CentOS/RedHat).
> >
> > ZFS on Linux could be interesting if it was supported by Cloudstack, but
> > it is not, you'd end up using qcow2 (COW) files on top of a COW
> > filesystem which could lead to issues. Also ZFS is not really the
> > fastest fs out there, though it does have some nice features.
> >
> > Did you really mean raid 0? I hope you have backups. :)
> >
> > hth
> >
> >
> > On 2019-07-15 11:49, Fariborz Navidan wrote:
> > > Hello,
> > >
> > > Which one do you think is faster to use for local soft Raid-0 for
> > > primary
> > > storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which one
> > > can
> > > gives us better IOPS and IO latency on NVMe SSD disks? The storage will
> > > be
> > > used for production cloud environment where arround 60 VMs will run on
> > > top
> > > of it.
> > >
> > > Your ides are highly appreciated
> >
>


-- 
Thanks,
Chris pedersen

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by Ivan Kudryavtsev <ku...@bw-sw.com>.
Hi,

if you use local fs, use just ext4 over the required disk topology which
gives the desired redundancy.

E.g. JBOD, R0 work well when data safety policy is established and backups
are maintained well.

Otherwise look to R5, R10 or R6.

пн, 15 июл. 2019 г., 18:05 <nu...@li.nux.ro>:

> Isn't that a bit apples and oranges? Ceph is a network distributed
> thingy, not a local solution.
>
> I'd use linux/software raid + lvm, it's the only one supported (by
> CentOS/RedHat).
>
> ZFS on Linux could be interesting if it was supported by Cloudstack, but
> it is not, you'd end up using qcow2 (COW) files on top of a COW
> filesystem which could lead to issues. Also ZFS is not really the
> fastest fs out there, though it does have some nice features.
>
> Did you really mean raid 0? I hope you have backups. :)
>
> hth
>
>
> On 2019-07-15 11:49, Fariborz Navidan wrote:
> > Hello,
> >
> > Which one do you think is faster to use for local soft Raid-0 for
> > primary
> > storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which one
> > can
> > gives us better IOPS and IO latency on NVMe SSD disks? The storage will
> > be
> > used for production cloud environment where arround 60 VMs will run on
> > top
> > of it.
> >
> > Your ides are highly appreciated
>

Re: [VOTE] Ceph, ZFS or Linux Soft RAID?

Posted by nu...@li.nux.ro.
Isn't that a bit apples and oranges? Ceph is a network distributed 
thingy, not a local solution.

I'd use linux/software raid + lvm, it's the only one supported (by 
CentOS/RedHat).

ZFS on Linux could be interesting if it was supported by Cloudstack, but 
it is not, you'd end up using qcow2 (COW) files on top of a COW 
filesystem which could lead to issues. Also ZFS is not really the 
fastest fs out there, though it does have some nice features.

Did you really mean raid 0? I hope you have backups. :)

hth


On 2019-07-15 11:49, Fariborz Navidan wrote:
> Hello,
> 
> Which one do you think is faster to use for local soft Raid-0 for 
> primary
> storage? Ceph, ZFS or Built-in soft raid manager of CentOS? Which one 
> can
> gives us better IOPS and IO latency on NVMe SSD disks? The storage will 
> be
> used for production cloud environment where arround 60 VMs will run on 
> top
> of it.
> 
> Your ides are highly appreciated