You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Niclas Lindblom <ni...@icloud.com.INVALID> on 2020/12/17 08:59:55 UTC
CS Kubernetes & persistent storage
Hi all,
I am testing the Kubernetes plugin for CS 4.14 and I am trying to figure out how to manage persistent storage across multiple nodes so a container can survive being moved from one node to another. The only thing I can think of to make this work would be a separate NFS server that containers can mount to, but perhaps there is a better option ? Are there any best practices around how to implement this in Cloudstack ?
Regards
Niclas
Re: CS Kubernetes & persistent storage
Posted by rv...@privaz.io.INVALID.
Niclas,
Thanks for sharing,
I was actually planing to test the same storage solution.
do you use local storage for the data disk? are you deploying storage intensive workloads like a database or similar?
which version of k8s are you running?
Regards,
Rafael
PS. are you based in Sweden?
On Thu, 2021-02-11 12:06 AM, Niclas Lindblom <ni...@icloud.com.INVALID> wrote:
>
Thanks Daan,
>
> I ended up using Rook Ceph file system across a 3 node cluster with a virtual disk attached to each vm. Works pretty well so far and I can recommend anyone with the same requirement to check it out.
>
> Regards
>
> Niclas
>
> > On 10 Feb 2021, at 22:59, Daan Hoogland " target="_blank"><da...@gmail.com> wrote:
> >
> > sorry for the late answer Niclas,
> > We don't have a solution in ACS for him right now. You probably want to
> > share access to a mount on some persistent storage across VMs so a k8s
> > container can move between VMs and still work on the same data. I don't
> > think a zone wide storage or any other means in ACS would help with this.
> > As you mention, you'll will have to run a nfs server and mount it on all
> > node VMs manually. nice feature request (once you figure it out)
> >
> >> On Thu, Dec 17, 2020 at 9:00 AM Niclas Lindblom
> >> " target="_blank"><ni...@icloud.com.invalid> wrote:
> >>
> >> Hi all,
> >>
> >> I am testing the Kubernetes plugin for CS 4.14 and I am trying to figure
> >> out how to manage persistent storage across multiple nodes so a container
> >> can survive being moved from one node to another. The only thing I can
> >> think of to make this work would be a separate NFS server that containers
> >> can mount to, but perhaps there is a better option ? Are there any best
> >> practices around how to implement this in Cloudstack ?
> >>
> >> Regards
> >>
> >> Niclas
> >
> >
> >
> > --
> > Daan
>
Re: CS Kubernetes & persistent storage
Posted by Niclas Lindblom <ni...@icloud.com.INVALID>.
Thanks Daan,
I ended up using Rook Ceph file system across a 3 node cluster with a virtual disk attached to each vm. Works pretty well so far and I can recommend anyone with the same requirement to check it out.
Regards
Niclas
> On 10 Feb 2021, at 22:59, Daan Hoogland <da...@gmail.com> wrote:
>
> sorry for the late answer Niclas,
> We don't have a solution in ACS for him right now. You probably want to
> share access to a mount on some persistent storage across VMs so a k8s
> container can move between VMs and still work on the same data. I don't
> think a zone wide storage or any other means in ACS would help with this.
> As you mention, you'll will have to run a nfs server and mount it on all
> node VMs manually. nice feature request (once you figure it out)
>
>> On Thu, Dec 17, 2020 at 9:00 AM Niclas Lindblom
>> <ni...@icloud.com.invalid> wrote:
>>
>> Hi all,
>>
>> I am testing the Kubernetes plugin for CS 4.14 and I am trying to figure
>> out how to manage persistent storage across multiple nodes so a container
>> can survive being moved from one node to another. The only thing I can
>> think of to make this work would be a separate NFS server that containers
>> can mount to, but perhaps there is a better option ? Are there any best
>> practices around how to implement this in Cloudstack ?
>>
>> Regards
>>
>> Niclas
>
>
>
> --
> Daan
Re: CS Kubernetes & persistent storage
Posted by Daan Hoogland <da...@gmail.com>.
sorry for the late answer Niclas,
We don't have a solution in ACS for him right now. You probably want to
share access to a mount on some persistent storage across VMs so a k8s
container can move between VMs and still work on the same data. I don't
think a zone wide storage or any other means in ACS would help with this.
As you mention, you'll will have to run a nfs server and mount it on all
node VMs manually. nice feature request (once you figure it out)
On Thu, Dec 17, 2020 at 9:00 AM Niclas Lindblom
<ni...@icloud.com.invalid> wrote:
> Hi all,
>
> I am testing the Kubernetes plugin for CS 4.14 and I am trying to figure
> out how to manage persistent storage across multiple nodes so a container
> can survive being moved from one node to another. The only thing I can
> think of to make this work would be a separate NFS server that containers
> can mount to, but perhaps there is a better option ? Are there any best
> practices around how to implement this in Cloudstack ?
>
> Regards
>
> Niclas
--
Daan