You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@heron.apache.org by Ning Wang <wa...@gmail.com> on 2021/09/21 01:37:15 UTC
9/21/2021 Bi-Weekly OSS Heron Sync-up
Hello,
It has been two weeks since our last sync! Let's share our works for the
last two weeks in this thread. Thanks!
Regards,
--ning
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Ning Wang <wa...@gmail.com>.
Thanks a lot!
K8s data is so overwhelming, :D
On Fri, Sep 24, 2021 at 6:51 AM Nicholas Nezis <ni...@gmail.com>
wrote:
> Some good resources:
>
> 5 minute summary video:
> https://hello-tanzu.vmware.com/kubernetes-in-five-minutes/
> Kubernetes services explanation:
> https://www.youtube.com/watch?v=NFApeJRXos4
> A playlist of these lightboard sessions:
> https://www.youtube.com/playlist?list=PL7bmigfV0EqQw4WnD0wF-SRBYttCFeBbF
>
> Books: (I would start with the first, but added the other two as I found
> them helpful for different reasons. I have a link below to get a free copy
> of the first)
>
> - Kubernetes Up and Running
> - Good summary of the various aspects of K8s. Each chapter does a
> good job explaining each concept
> - Programming Kubernetes
> - This is a great book on programming Kubernetes Operators. This
> really gets into the inner workings of Kubernetes
> - Not needed for intro to K8s, but I highly recommend it if you are
> interested in building K8s controllers
> - Kubernetes Patterns
> - Each chapter is a pattern that helps demonstrate interesting
> solutions
> - I found this to be a nice supplement because it opened my eyes to
> new ways to build solutions
>
>
> Free digital copy thanks to VMWare:
>
> https://hello-tanzu.vmware.com/kubernetes-up-and-running-2/?utm_source=google&utm_medium=cpc&utm_campaign=amer_c1-sl_a2&utm_content=m023&utm_term=kubernetes%20up%20and%20running&_bt=490974064786&_bk=kubernetes%20up%20and%20running&_bm=e&_bn=g&_bg=114812567223&gclid=CjwKCAjw7rWKBhAtEiwAJ3CWLPQ9TH5c2JOJGuZM7aTKMAWJf0MG1gSzSkmy4HsdIjBH7pTryM_xBhoCvnAQAvD_BwE
>
>
> On Tue, Sep 21, 2021 at 8:42 PM Ning Wang <wa...@gmail.com> wrote:
>
> > k8s is very complicated. More leads are always better. :D
> >
> > On Tue, Sep 21, 2021 at 2:15 PM Saad Ur Rahman <saad.ur.rahman@gmail.com
> >
> > wrote:
> >
> > > You are most welcome. Nick Nezis is one of our resident K8s gurus and
> > > would probably be able to guide you better.
> > >
> > > On 2021/09/21 18:34:42, Ning Wang <wa...@gmail.com> wrote:
> > > > Cool. Thank you very much!
> > > >
> > > > On Tue, Sep 21, 2021 at 11:26 AM Saad Ur Rahman <
> > > saad.ur.rahman@gmail.com>
> > > > wrote:
> > > >
> > > > > Thank you, Ning!
> > > > >
> > > > > As for learning K8s goes, perhaps someone knows of an in-depth
> book,
> > > but I
> > > > > had to learn about it when I was familiarizing myself with AWS way
> > > back.
> > > > > What I used were the official tutorials found here:
> > > > > https://kubernetes.io/docs/tutorials/
> > > > >
> > > > > I would begin by understanding the Docker engine and how it works,
> > and
> > > > > what it is doing. I believe the Docker engine is providing you with
> > an
> > > > > insolated file system as well as memory and CPU scheduling. On Mac
> > and
> > > > > Windows, it provides a thin layer kernel to support Linux CGroups.
> On
> > > > > native *nix variant OS's it is using the actual OS kernel to
> provide
> > > memory
> > > > > and CPU limits and scheduling (CGroups and KVM). Someone with more
> > > > > knowledge would be able to correct and expand on this information.
> > > Docker
> > > > > is not the only engine used by K8s, there are others to look at as
> > > well.
> > > > >
> > > > > On 2021/09/21 17:18:54, Ning Wang <wa...@gmail.com> wrote:
> > > > > > Good work! Better k8s support is our priority!
> > > > > >
> > > > > > BTW: is there any suggestion for a good k8s book (for beginner,
> > > > > > fundamentals, simple and straightforward)?
> > > > > >
> > > > > > On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <
> josh@joshfischer.io
> > >
> > > > > wrote:
> > > > > >
> > > > > > > Those are kind words, Saad. Thank you.
> > > > > > >
> > > > > > > On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <
> > > > > saad.ur.rahman@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi Josh,
> > > > > > > >
> > > > > > > > You have been a great help with the Pod Template PR with a
> lot
> > of
> > > > > advice,
> > > > > > > > and your help getting the build environment set up has been
> > > > > invaluable -
> > > > > > > > thank you!
> > > > > > > >
> > > > > > > > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io>
> > > wrote:
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > I've been preparing for my ApacheCon talk tomorrow at
> > 18:00UTC
> > > on
> > > > > my
> > > > > > > > > experience with releasing Heron from the incubator. Some
> side
> > > > > > > > conversations
> > > > > > > > > with the k8's stuff Saad wrote about, but my involvement
> with
> > > it
> > > > > has
> > > > > > > been
> > > > > > > > > minimal.
> > > > > > > > >
> > > > > > > > > - Josh
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > > > > > > > saad.ur.rahman@gmail.com>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hello everyone,
> > > > > > > > > >
> > > > > > > > > > Nick Nezis and I are working on getting Pod Template
> > > definitions
> > > > > for
> > > > > > > > > > executor nodes loaded from ConfigMaps. We have a WIP PR
> > > underway.
> > > > > > > > > >
> > > > > > > > > > The current challenge being faced is testing as there
> seems
> > > to
> > > > > have
> > > > > > > > been
> > > > > > > > > > no design considerations taken when creating the
> > V1Controller
> > > > > class.
> > > > > > > > The
> > > > > > > > > > V1CoreClient needs to be mocked for testing and it has
> > been a
> > > > > long
> > > > > > > time
> > > > > > > > > > since I have played with Mockito, so I am relearning
> > things.
> > > > > Also,
> > > > > > > the
> > > > > > > > > > default constructed V1 config objects tend to allow null
> > > fields
> > > > > for
> > > > > > > > > > anything which is not explicitly set, so checks need to
> be
> > > > > performed
> > > > > > > > > > carefully. Another option is to directly employ a blanket
> > > catch
> > > > > for
> > > > > > > > null
> > > > > > > > > > pointer exceptions and log them.
> > > > > > > > > >
> > > > > > > > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com>
> > > wrote:
> > > > > > > > > > > Hello,
> > > > > > > > > > >
> > > > > > > > > > > It has been two weeks since our last sync! Let's share
> > our
> > > > > works
> > > > > > > for
> > > > > > > > the
> > > > > > > > > > > last two weeks in this thread. Thanks!
> > > > > > > > > > >
> > > > > > > > > > > Regards,
> > > > > > > > > > > --ning
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Nicholas Nezis <ni...@gmail.com>.
Some good resources:
5 minute summary video:
https://hello-tanzu.vmware.com/kubernetes-in-five-minutes/
Kubernetes services explanation: https://www.youtube.com/watch?v=NFApeJRXos4
A playlist of these lightboard sessions:
https://www.youtube.com/playlist?list=PL7bmigfV0EqQw4WnD0wF-SRBYttCFeBbF
Books: (I would start with the first, but added the other two as I found
them helpful for different reasons. I have a link below to get a free copy
of the first)
- Kubernetes Up and Running
- Good summary of the various aspects of K8s. Each chapter does a
good job explaining each concept
- Programming Kubernetes
- This is a great book on programming Kubernetes Operators. This
really gets into the inner workings of Kubernetes
- Not needed for intro to K8s, but I highly recommend it if you are
interested in building K8s controllers
- Kubernetes Patterns
- Each chapter is a pattern that helps demonstrate interesting
solutions
- I found this to be a nice supplement because it opened my eyes to
new ways to build solutions
Free digital copy thanks to VMWare:
https://hello-tanzu.vmware.com/kubernetes-up-and-running-2/?utm_source=google&utm_medium=cpc&utm_campaign=amer_c1-sl_a2&utm_content=m023&utm_term=kubernetes%20up%20and%20running&_bt=490974064786&_bk=kubernetes%20up%20and%20running&_bm=e&_bn=g&_bg=114812567223&gclid=CjwKCAjw7rWKBhAtEiwAJ3CWLPQ9TH5c2JOJGuZM7aTKMAWJf0MG1gSzSkmy4HsdIjBH7pTryM_xBhoCvnAQAvD_BwE
On Tue, Sep 21, 2021 at 8:42 PM Ning Wang <wa...@gmail.com> wrote:
> k8s is very complicated. More leads are always better. :D
>
> On Tue, Sep 21, 2021 at 2:15 PM Saad Ur Rahman <sa...@gmail.com>
> wrote:
>
> > You are most welcome. Nick Nezis is one of our resident K8s gurus and
> > would probably be able to guide you better.
> >
> > On 2021/09/21 18:34:42, Ning Wang <wa...@gmail.com> wrote:
> > > Cool. Thank you very much!
> > >
> > > On Tue, Sep 21, 2021 at 11:26 AM Saad Ur Rahman <
> > saad.ur.rahman@gmail.com>
> > > wrote:
> > >
> > > > Thank you, Ning!
> > > >
> > > > As for learning K8s goes, perhaps someone knows of an in-depth book,
> > but I
> > > > had to learn about it when I was familiarizing myself with AWS way
> > back.
> > > > What I used were the official tutorials found here:
> > > > https://kubernetes.io/docs/tutorials/
> > > >
> > > > I would begin by understanding the Docker engine and how it works,
> and
> > > > what it is doing. I believe the Docker engine is providing you with
> an
> > > > insolated file system as well as memory and CPU scheduling. On Mac
> and
> > > > Windows, it provides a thin layer kernel to support Linux CGroups. On
> > > > native *nix variant OS's it is using the actual OS kernel to provide
> > memory
> > > > and CPU limits and scheduling (CGroups and KVM). Someone with more
> > > > knowledge would be able to correct and expand on this information.
> > Docker
> > > > is not the only engine used by K8s, there are others to look at as
> > well.
> > > >
> > > > On 2021/09/21 17:18:54, Ning Wang <wa...@gmail.com> wrote:
> > > > > Good work! Better k8s support is our priority!
> > > > >
> > > > > BTW: is there any suggestion for a good k8s book (for beginner,
> > > > > fundamentals, simple and straightforward)?
> > > > >
> > > > > On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <josh@joshfischer.io
> >
> > > > wrote:
> > > > >
> > > > > > Those are kind words, Saad. Thank you.
> > > > > >
> > > > > > On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <
> > > > saad.ur.rahman@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi Josh,
> > > > > > >
> > > > > > > You have been a great help with the Pod Template PR with a lot
> of
> > > > advice,
> > > > > > > and your help getting the build environment set up has been
> > > > invaluable -
> > > > > > > thank you!
> > > > > > >
> > > > > > > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io>
> > wrote:
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I've been preparing for my ApacheCon talk tomorrow at
> 18:00UTC
> > on
> > > > my
> > > > > > > > experience with releasing Heron from the incubator. Some side
> > > > > > > conversations
> > > > > > > > with the k8's stuff Saad wrote about, but my involvement with
> > it
> > > > has
> > > > > > been
> > > > > > > > minimal.
> > > > > > > >
> > > > > > > > - Josh
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > > > > > > saad.ur.rahman@gmail.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hello everyone,
> > > > > > > > >
> > > > > > > > > Nick Nezis and I are working on getting Pod Template
> > definitions
> > > > for
> > > > > > > > > executor nodes loaded from ConfigMaps. We have a WIP PR
> > underway.
> > > > > > > > >
> > > > > > > > > The current challenge being faced is testing as there seems
> > to
> > > > have
> > > > > > > been
> > > > > > > > > no design considerations taken when creating the
> V1Controller
> > > > class.
> > > > > > > The
> > > > > > > > > V1CoreClient needs to be mocked for testing and it has
> been a
> > > > long
> > > > > > time
> > > > > > > > > since I have played with Mockito, so I am relearning
> things.
> > > > Also,
> > > > > > the
> > > > > > > > > default constructed V1 config objects tend to allow null
> > fields
> > > > for
> > > > > > > > > anything which is not explicitly set, so checks need to be
> > > > performed
> > > > > > > > > carefully. Another option is to directly employ a blanket
> > catch
> > > > for
> > > > > > > null
> > > > > > > > > pointer exceptions and log them.
> > > > > > > > >
> > > > > > > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com>
> > wrote:
> > > > > > > > > > Hello,
> > > > > > > > > >
> > > > > > > > > > It has been two weeks since our last sync! Let's share
> our
> > > > works
> > > > > > for
> > > > > > > the
> > > > > > > > > > last two weeks in this thread. Thanks!
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > > --ning
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Ning Wang <wa...@gmail.com>.
k8s is very complicated. More leads are always better. :D
On Tue, Sep 21, 2021 at 2:15 PM Saad Ur Rahman <sa...@gmail.com>
wrote:
> You are most welcome. Nick Nezis is one of our resident K8s gurus and
> would probably be able to guide you better.
>
> On 2021/09/21 18:34:42, Ning Wang <wa...@gmail.com> wrote:
> > Cool. Thank you very much!
> >
> > On Tue, Sep 21, 2021 at 11:26 AM Saad Ur Rahman <
> saad.ur.rahman@gmail.com>
> > wrote:
> >
> > > Thank you, Ning!
> > >
> > > As for learning K8s goes, perhaps someone knows of an in-depth book,
> but I
> > > had to learn about it when I was familiarizing myself with AWS way
> back.
> > > What I used were the official tutorials found here:
> > > https://kubernetes.io/docs/tutorials/
> > >
> > > I would begin by understanding the Docker engine and how it works, and
> > > what it is doing. I believe the Docker engine is providing you with an
> > > insolated file system as well as memory and CPU scheduling. On Mac and
> > > Windows, it provides a thin layer kernel to support Linux CGroups. On
> > > native *nix variant OS's it is using the actual OS kernel to provide
> memory
> > > and CPU limits and scheduling (CGroups and KVM). Someone with more
> > > knowledge would be able to correct and expand on this information.
> Docker
> > > is not the only engine used by K8s, there are others to look at as
> well.
> > >
> > > On 2021/09/21 17:18:54, Ning Wang <wa...@gmail.com> wrote:
> > > > Good work! Better k8s support is our priority!
> > > >
> > > > BTW: is there any suggestion for a good k8s book (for beginner,
> > > > fundamentals, simple and straightforward)?
> > > >
> > > > On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <jo...@joshfischer.io>
> > > wrote:
> > > >
> > > > > Those are kind words, Saad. Thank you.
> > > > >
> > > > > On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <
> > > saad.ur.rahman@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi Josh,
> > > > > >
> > > > > > You have been a great help with the Pod Template PR with a lot of
> > > advice,
> > > > > > and your help getting the build environment set up has been
> > > invaluable -
> > > > > > thank you!
> > > > > >
> > > > > > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io>
> wrote:
> > > > > > > Hi,
> > > > > > >
> > > > > > > I've been preparing for my ApacheCon talk tomorrow at 18:00UTC
> on
> > > my
> > > > > > > experience with releasing Heron from the incubator. Some side
> > > > > > conversations
> > > > > > > with the k8's stuff Saad wrote about, but my involvement with
> it
> > > has
> > > > > been
> > > > > > > minimal.
> > > > > > >
> > > > > > > - Josh
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > > > > > saad.ur.rahman@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hello everyone,
> > > > > > > >
> > > > > > > > Nick Nezis and I are working on getting Pod Template
> definitions
> > > for
> > > > > > > > executor nodes loaded from ConfigMaps. We have a WIP PR
> underway.
> > > > > > > >
> > > > > > > > The current challenge being faced is testing as there seems
> to
> > > have
> > > > > > been
> > > > > > > > no design considerations taken when creating the V1Controller
> > > class.
> > > > > > The
> > > > > > > > V1CoreClient needs to be mocked for testing and it has been a
> > > long
> > > > > time
> > > > > > > > since I have played with Mockito, so I am relearning things.
> > > Also,
> > > > > the
> > > > > > > > default constructed V1 config objects tend to allow null
> fields
> > > for
> > > > > > > > anything which is not explicitly set, so checks need to be
> > > performed
> > > > > > > > carefully. Another option is to directly employ a blanket
> catch
> > > for
> > > > > > null
> > > > > > > > pointer exceptions and log them.
> > > > > > > >
> > > > > > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com>
> wrote:
> > > > > > > > > Hello,
> > > > > > > > >
> > > > > > > > > It has been two weeks since our last sync! Let's share our
> > > works
> > > > > for
> > > > > > the
> > > > > > > > > last two weeks in this thread. Thanks!
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > --ning
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Saad Ur Rahman <sa...@gmail.com>.
You are most welcome. Nick Nezis is one of our resident K8s gurus and would probably be able to guide you better.
On 2021/09/21 18:34:42, Ning Wang <wa...@gmail.com> wrote:
> Cool. Thank you very much!
>
> On Tue, Sep 21, 2021 at 11:26 AM Saad Ur Rahman <sa...@gmail.com>
> wrote:
>
> > Thank you, Ning!
> >
> > As for learning K8s goes, perhaps someone knows of an in-depth book, but I
> > had to learn about it when I was familiarizing myself with AWS way back.
> > What I used were the official tutorials found here:
> > https://kubernetes.io/docs/tutorials/
> >
> > I would begin by understanding the Docker engine and how it works, and
> > what it is doing. I believe the Docker engine is providing you with an
> > insolated file system as well as memory and CPU scheduling. On Mac and
> > Windows, it provides a thin layer kernel to support Linux CGroups. On
> > native *nix variant OS's it is using the actual OS kernel to provide memory
> > and CPU limits and scheduling (CGroups and KVM). Someone with more
> > knowledge would be able to correct and expand on this information. Docker
> > is not the only engine used by K8s, there are others to look at as well.
> >
> > On 2021/09/21 17:18:54, Ning Wang <wa...@gmail.com> wrote:
> > > Good work! Better k8s support is our priority!
> > >
> > > BTW: is there any suggestion for a good k8s book (for beginner,
> > > fundamentals, simple and straightforward)?
> > >
> > > On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <jo...@joshfischer.io>
> > wrote:
> > >
> > > > Those are kind words, Saad. Thank you.
> > > >
> > > > On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <
> > saad.ur.rahman@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi Josh,
> > > > >
> > > > > You have been a great help with the Pod Template PR with a lot of
> > advice,
> > > > > and your help getting the build environment set up has been
> > invaluable -
> > > > > thank you!
> > > > >
> > > > > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io> wrote:
> > > > > > Hi,
> > > > > >
> > > > > > I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on
> > my
> > > > > > experience with releasing Heron from the incubator. Some side
> > > > > conversations
> > > > > > with the k8's stuff Saad wrote about, but my involvement with it
> > has
> > > > been
> > > > > > minimal.
> > > > > >
> > > > > > - Josh
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > > > > saad.ur.rahman@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Hello everyone,
> > > > > > >
> > > > > > > Nick Nezis and I are working on getting Pod Template definitions
> > for
> > > > > > > executor nodes loaded from ConfigMaps. We have a WIP PR underway.
> > > > > > >
> > > > > > > The current challenge being faced is testing as there seems to
> > have
> > > > > been
> > > > > > > no design considerations taken when creating the V1Controller
> > class.
> > > > > The
> > > > > > > V1CoreClient needs to be mocked for testing and it has been a
> > long
> > > > time
> > > > > > > since I have played with Mockito, so I am relearning things.
> > Also,
> > > > the
> > > > > > > default constructed V1 config objects tend to allow null fields
> > for
> > > > > > > anything which is not explicitly set, so checks need to be
> > performed
> > > > > > > carefully. Another option is to directly employ a blanket catch
> > for
> > > > > null
> > > > > > > pointer exceptions and log them.
> > > > > > >
> > > > > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > > > > > > > Hello,
> > > > > > > >
> > > > > > > > It has been two weeks since our last sync! Let's share our
> > works
> > > > for
> > > > > the
> > > > > > > > last two weeks in this thread. Thanks!
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > --ning
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Ning Wang <wa...@gmail.com>.
Cool. Thank you very much!
On Tue, Sep 21, 2021 at 11:26 AM Saad Ur Rahman <sa...@gmail.com>
wrote:
> Thank you, Ning!
>
> As for learning K8s goes, perhaps someone knows of an in-depth book, but I
> had to learn about it when I was familiarizing myself with AWS way back.
> What I used were the official tutorials found here:
> https://kubernetes.io/docs/tutorials/
>
> I would begin by understanding the Docker engine and how it works, and
> what it is doing. I believe the Docker engine is providing you with an
> insolated file system as well as memory and CPU scheduling. On Mac and
> Windows, it provides a thin layer kernel to support Linux CGroups. On
> native *nix variant OS's it is using the actual OS kernel to provide memory
> and CPU limits and scheduling (CGroups and KVM). Someone with more
> knowledge would be able to correct and expand on this information. Docker
> is not the only engine used by K8s, there are others to look at as well.
>
> On 2021/09/21 17:18:54, Ning Wang <wa...@gmail.com> wrote:
> > Good work! Better k8s support is our priority!
> >
> > BTW: is there any suggestion for a good k8s book (for beginner,
> > fundamentals, simple and straightforward)?
> >
> > On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <jo...@joshfischer.io>
> wrote:
> >
> > > Those are kind words, Saad. Thank you.
> > >
> > > On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <
> saad.ur.rahman@gmail.com>
> > > wrote:
> > >
> > > > Hi Josh,
> > > >
> > > > You have been a great help with the Pod Template PR with a lot of
> advice,
> > > > and your help getting the build environment set up has been
> invaluable -
> > > > thank you!
> > > >
> > > > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io> wrote:
> > > > > Hi,
> > > > >
> > > > > I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on
> my
> > > > > experience with releasing Heron from the incubator. Some side
> > > > conversations
> > > > > with the k8's stuff Saad wrote about, but my involvement with it
> has
> > > been
> > > > > minimal.
> > > > >
> > > > > - Josh
> > > > >
> > > > >
> > > > >
> > > > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > > > saad.ur.rahman@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hello everyone,
> > > > > >
> > > > > > Nick Nezis and I are working on getting Pod Template definitions
> for
> > > > > > executor nodes loaded from ConfigMaps. We have a WIP PR underway.
> > > > > >
> > > > > > The current challenge being faced is testing as there seems to
> have
> > > > been
> > > > > > no design considerations taken when creating the V1Controller
> class.
> > > > The
> > > > > > V1CoreClient needs to be mocked for testing and it has been a
> long
> > > time
> > > > > > since I have played with Mockito, so I am relearning things.
> Also,
> > > the
> > > > > > default constructed V1 config objects tend to allow null fields
> for
> > > > > > anything which is not explicitly set, so checks need to be
> performed
> > > > > > carefully. Another option is to directly employ a blanket catch
> for
> > > > null
> > > > > > pointer exceptions and log them.
> > > > > >
> > > > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > > > > > > Hello,
> > > > > > >
> > > > > > > It has been two weeks since our last sync! Let's share our
> works
> > > for
> > > > the
> > > > > > > last two weeks in this thread. Thanks!
> > > > > > >
> > > > > > > Regards,
> > > > > > > --ning
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Saad Ur Rahman <sa...@gmail.com>.
Thank you, Ning!
As for learning K8s goes, perhaps someone knows of an in-depth book, but I had to learn about it when I was familiarizing myself with AWS way back. What I used were the official tutorials found here: https://kubernetes.io/docs/tutorials/
I would begin by understanding the Docker engine and how it works, and what it is doing. I believe the Docker engine is providing you with an insolated file system as well as memory and CPU scheduling. On Mac and Windows, it provides a thin layer kernel to support Linux CGroups. On native *nix variant OS's it is using the actual OS kernel to provide memory and CPU limits and scheduling (CGroups and KVM). Someone with more knowledge would be able to correct and expand on this information. Docker is not the only engine used by K8s, there are others to look at as well.
On 2021/09/21 17:18:54, Ning Wang <wa...@gmail.com> wrote:
> Good work! Better k8s support is our priority!
>
> BTW: is there any suggestion for a good k8s book (for beginner,
> fundamentals, simple and straightforward)?
>
> On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <jo...@joshfischer.io> wrote:
>
> > Those are kind words, Saad. Thank you.
> >
> > On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <sa...@gmail.com>
> > wrote:
> >
> > > Hi Josh,
> > >
> > > You have been a great help with the Pod Template PR with a lot of advice,
> > > and your help getting the build environment set up has been invaluable -
> > > thank you!
> > >
> > > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io> wrote:
> > > > Hi,
> > > >
> > > > I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on my
> > > > experience with releasing Heron from the incubator. Some side
> > > conversations
> > > > with the k8's stuff Saad wrote about, but my involvement with it has
> > been
> > > > minimal.
> > > >
> > > > - Josh
> > > >
> > > >
> > > >
> > > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > > saad.ur.rahman@gmail.com>
> > > > wrote:
> > > >
> > > > > Hello everyone,
> > > > >
> > > > > Nick Nezis and I are working on getting Pod Template definitions for
> > > > > executor nodes loaded from ConfigMaps. We have a WIP PR underway.
> > > > >
> > > > > The current challenge being faced is testing as there seems to have
> > > been
> > > > > no design considerations taken when creating the V1Controller class.
> > > The
> > > > > V1CoreClient needs to be mocked for testing and it has been a long
> > time
> > > > > since I have played with Mockito, so I am relearning things. Also,
> > the
> > > > > default constructed V1 config objects tend to allow null fields for
> > > > > anything which is not explicitly set, so checks need to be performed
> > > > > carefully. Another option is to directly employ a blanket catch for
> > > null
> > > > > pointer exceptions and log them.
> > > > >
> > > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > > > > > Hello,
> > > > > >
> > > > > > It has been two weeks since our last sync! Let's share our works
> > for
> > > the
> > > > > > last two weeks in this thread. Thanks!
> > > > > >
> > > > > > Regards,
> > > > > > --ning
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Ning Wang <wa...@gmail.com>.
Good work! Better k8s support is our priority!
BTW: is there any suggestion for a good k8s book (for beginner,
fundamentals, simple and straightforward)?
On Tue, Sep 21, 2021 at 10:01 AM Josh Fischer <jo...@joshfischer.io> wrote:
> Those are kind words, Saad. Thank you.
>
> On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <sa...@gmail.com>
> wrote:
>
> > Hi Josh,
> >
> > You have been a great help with the Pod Template PR with a lot of advice,
> > and your help getting the build environment set up has been invaluable -
> > thank you!
> >
> > On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io> wrote:
> > > Hi,
> > >
> > > I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on my
> > > experience with releasing Heron from the incubator. Some side
> > conversations
> > > with the k8's stuff Saad wrote about, but my involvement with it has
> been
> > > minimal.
> > >
> > > - Josh
> > >
> > >
> > >
> > > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> > saad.ur.rahman@gmail.com>
> > > wrote:
> > >
> > > > Hello everyone,
> > > >
> > > > Nick Nezis and I are working on getting Pod Template definitions for
> > > > executor nodes loaded from ConfigMaps. We have a WIP PR underway.
> > > >
> > > > The current challenge being faced is testing as there seems to have
> > been
> > > > no design considerations taken when creating the V1Controller class.
> > The
> > > > V1CoreClient needs to be mocked for testing and it has been a long
> time
> > > > since I have played with Mockito, so I am relearning things. Also,
> the
> > > > default constructed V1 config objects tend to allow null fields for
> > > > anything which is not explicitly set, so checks need to be performed
> > > > carefully. Another option is to directly employ a blanket catch for
> > null
> > > > pointer exceptions and log them.
> > > >
> > > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > > > > Hello,
> > > > >
> > > > > It has been two weeks since our last sync! Let's share our works
> for
> > the
> > > > > last two weeks in this thread. Thanks!
> > > > >
> > > > > Regards,
> > > > > --ning
> > > > >
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Josh Fischer <jo...@joshfischer.io>.
Those are kind words, Saad. Thank you.
On Tue, Sep 21, 2021 at 11:36 AM Saad Ur Rahman <sa...@gmail.com>
wrote:
> Hi Josh,
>
> You have been a great help with the Pod Template PR with a lot of advice,
> and your help getting the build environment set up has been invaluable -
> thank you!
>
> On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io> wrote:
> > Hi,
> >
> > I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on my
> > experience with releasing Heron from the incubator. Some side
> conversations
> > with the k8's stuff Saad wrote about, but my involvement with it has been
> > minimal.
> >
> > - Josh
> >
> >
> >
> > On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <
> saad.ur.rahman@gmail.com>
> > wrote:
> >
> > > Hello everyone,
> > >
> > > Nick Nezis and I are working on getting Pod Template definitions for
> > > executor nodes loaded from ConfigMaps. We have a WIP PR underway.
> > >
> > > The current challenge being faced is testing as there seems to have
> been
> > > no design considerations taken when creating the V1Controller class.
> The
> > > V1CoreClient needs to be mocked for testing and it has been a long time
> > > since I have played with Mockito, so I am relearning things. Also, the
> > > default constructed V1 config objects tend to allow null fields for
> > > anything which is not explicitly set, so checks need to be performed
> > > carefully. Another option is to directly employ a blanket catch for
> null
> > > pointer exceptions and log them.
> > >
> > > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > > > Hello,
> > > >
> > > > It has been two weeks since our last sync! Let's share our works for
> the
> > > > last two weeks in this thread. Thanks!
> > > >
> > > > Regards,
> > > > --ning
> > > >
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Saad Ur Rahman <sa...@gmail.com>.
Hi Josh,
You have been a great help with the Pod Template PR with a lot of advice, and your help getting the build environment set up has been invaluable - thank you!
On 2021/09/21 16:31:32, Josh Fischer <jo...@joshfischer.io> wrote:
> Hi,
>
> I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on my
> experience with releasing Heron from the incubator. Some side conversations
> with the k8's stuff Saad wrote about, but my involvement with it has been
> minimal.
>
> - Josh
>
>
>
> On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <sa...@gmail.com>
> wrote:
>
> > Hello everyone,
> >
> > Nick Nezis and I are working on getting Pod Template definitions for
> > executor nodes loaded from ConfigMaps. We have a WIP PR underway.
> >
> > The current challenge being faced is testing as there seems to have been
> > no design considerations taken when creating the V1Controller class. The
> > V1CoreClient needs to be mocked for testing and it has been a long time
> > since I have played with Mockito, so I am relearning things. Also, the
> > default constructed V1 config objects tend to allow null fields for
> > anything which is not explicitly set, so checks need to be performed
> > carefully. Another option is to directly employ a blanket catch for null
> > pointer exceptions and log them.
> >
> > On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > > Hello,
> > >
> > > It has been two weeks since our last sync! Let's share our works for the
> > > last two weeks in this thread. Thanks!
> > >
> > > Regards,
> > > --ning
> > >
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Josh Fischer <jo...@joshfischer.io>.
Hi,
I've been preparing for my ApacheCon talk tomorrow at 18:00UTC on my
experience with releasing Heron from the incubator. Some side conversations
with the k8's stuff Saad wrote about, but my involvement with it has been
minimal.
- Josh
On Tue, Sep 21, 2021 at 11:22 AM Saad Ur Rahman <sa...@gmail.com>
wrote:
> Hello everyone,
>
> Nick Nezis and I are working on getting Pod Template definitions for
> executor nodes loaded from ConfigMaps. We have a WIP PR underway.
>
> The current challenge being faced is testing as there seems to have been
> no design considerations taken when creating the V1Controller class. The
> V1CoreClient needs to be mocked for testing and it has been a long time
> since I have played with Mockito, so I am relearning things. Also, the
> default constructed V1 config objects tend to allow null fields for
> anything which is not explicitly set, so checks need to be performed
> carefully. Another option is to directly employ a blanket catch for null
> pointer exceptions and log them.
>
> On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> > Hello,
> >
> > It has been two weeks since our last sync! Let's share our works for the
> > last two weeks in this thread. Thanks!
> >
> > Regards,
> > --ning
> >
>
Re: 9/21/2021 Bi-Weekly OSS Heron Sync-up
Posted by Saad Ur Rahman <sa...@gmail.com>.
Hello everyone,
Nick Nezis and I are working on getting Pod Template definitions for executor nodes loaded from ConfigMaps. We have a WIP PR underway.
The current challenge being faced is testing as there seems to have been no design considerations taken when creating the V1Controller class. The V1CoreClient needs to be mocked for testing and it has been a long time since I have played with Mockito, so I am relearning things. Also, the default constructed V1 config objects tend to allow null fields for anything which is not explicitly set, so checks need to be performed carefully. Another option is to directly employ a blanket catch for null pointer exceptions and log them.
On 2021/09/21 01:37:15, Ning Wang <wa...@gmail.com> wrote:
> Hello,
>
> It has been two weeks since our last sync! Let's share our works for the
> last two weeks in this thread. Thanks!
>
> Regards,
> --ning
>