You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@apache.org by Gavin McDonald <gm...@apache.org> on 2021/01/12 20:53:10 UTC
Builds Meeting this Thursday
Hi All,
Sorry for the last minute notice, this Thursday the 14th January
at 1700 UTC time will be our next builds@ meeting.
Just confirmed a few minutes ago, there will be a guest
representing Github on the call to talk about and answer
questions around Github Actions.
The remainder of the call are self set topics , so whatever
else you guys want to cover.
We will try Jitsi again, will a fallback url provided.
More details to follow
--
*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team
Re: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
Cool. Looking forward to it!
On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org> wrote:
> Hi All,
>
> Sorry for the last minute notice, this Thursday the 14th January
> at 1700 UTC time will be our next builds@ meeting.
>
> Just confirmed a few minutes ago, there will be a guest
> representing Github on the call to talk about and answer
> questions around Github Actions.
>
> The remainder of the call are self set topics , so whatever
> else you guys want to cover.
>
> We will try Jitsi again, will a fallback url provided.
> More details to follow
>
>
>
> --
>
> *Gavin McDonald*
> Systems Administrator
> ASF Infrastructure Team
>
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Gavin McDonald <gm...@apache.org>.
Hi,
On Wed, Jan 13, 2021 at 5:12 PM Tobiasz Kędzierski <
tobiasz.kedzierski@polidea.com> wrote:
> Announcement about the meeting showed too late for me and unfortunately I
> can not participate.
>
Sorry about that. For future reference all builds@ meetings are
scheduled for the 2nd Thursday of every month.
> I hope it will be recorded (at least partially) because I am very
> interested in Github Actions.
>
I'm afraid not, we won't record any builds@ meeting.
We will of course update the wiki page and this mailing list
with a meeting summary.
>
> I wanted to bring back the problem with monitoring and getting statistics
> about GitHub Actions [GA] usage within ASF.
>
> Limit for concurrent jobs for ASF is 200, there are more than 200 ASF
> repositories which use GA.
> One project can stuck queue for the whole organisation and there is no
> convenient way to monitor how many workflows and jobs are run within
> organisation repositories.
> I used GH Rest API (there is no graphQL for it) to periodically fetch
> information about GA workflows within ASF repositories (in
> https://github.com/TobKed/fetch-apache-ga-stats/).
> Based on collected data I created a dashboard in DataStudio. Example pics
> from report:
> https://pasteboard.co/JJt9HjD.png
> https://pasteboard.co/JJtahC2.png
>
> Here is old thread about it:
>
> https://lists.apache.org/thread.html/rcf6da2227d41bce72bc999f33cdf7d676ad4ffea051e2daa05d244b8%40%3Cbuilds.apache.org%3E
>
> Question is: Is there any way to efficiently obtain statistics related to
> GitHub Actions?
> I would appreciate asking for it on my behalf.
>
I'll ensure it gets looked into. If you could edit the meeting wiki page
with the above even better :)
>
> BR
> Tobiasz
>
> On Wed, Jan 13, 2021 at 9:53 AM Jarek Potiuk <ja...@potiuk.com> wrote:
>
> > Not sure. But I will ask for it.
> >
> > On Wed, Jan 13, 2021 at 9:44 AM Jarek Potiuk <ja...@polidea.com>
> > wrote:
> >
> >> Not sure. I will ask if we can record it.
> >>
> >> On Wed, Jan 13, 2021 at 5:44 AM Sumit Maheshwari <
> sumeet.manit@gmail.com>
> >> wrote:
> >>
> >>> Thanks for the heads-up Jarek,
> >>>
> >>> Will it be recorded?
> >>>
> >>>
> >>> On Wed, Jan 13, 2021 at 3:15 AM Jarek Potiuk <ja...@potiuk.com> wrote:
> >>>
> >>>> For those who are interested in performance/security of Github
> Actions,
> >>>> there is a meeting of "builds" for ASF this Thursday - where Brian
> Douglas
> >>>> Github's Staff Developers Advocate will be present.
> >>>>
> >>>> J.
> >>>>
> >>>> ---------- Forwarded message ---------
> >>>> From: Jarek Potiuk <ja...@potiuk.com>
> >>>> Date: Tue, Jan 12, 2021 at 10:42 PM
> >>>> Subject: Re: Builds Meeting this Thursday
> >>>> To: <bu...@apache.org>, <gm...@apache.org>
> >>>>
> >>>>
> >>>> Added my two topics. Thanks Gavin for this opportunity !
> >>>>
> >>>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gmcdonald@apache.org
> >
> >>>> wrote:
> >>>>
> >>>>> Please list on the cwiki meeting page any questions you have
> >>>>> for Brian so that I may send them to him ahead of time, if
> >>>>> possible.
> >>>>>
> >>>>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <
> gmcdonald@apache.org>
> >>>>> wrote:
> >>>>>
> >>>>> > Hi All,
> >>>>> >
> >>>>> > Cwiki page -
> >>>>> >
> >>>>>
> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
> >>>>> >
> >>>>> >
> >>>>> >
> >>>>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <
> gmcdonald@apache.org
> >>>>> >
> >>>>> > wrote:
> >>>>> >
> >>>>> >> Hi All,
> >>>>> >>
> >>>>> >> Sorry for the last minute notice, this Thursday the 14th January
> >>>>> >> at 1700 UTC time will be our next builds@ meeting.
> >>>>> >>
> >>>>> >> Just confirmed a few minutes ago, there will be a guest
> >>>>> >> representing Github on the call to talk about and answer
> >>>>> >> questions around Github Actions.
> >>>>> >>
> >>>>> >> The remainder of the call are self set topics , so whatever
> >>>>> >> else you guys want to cover.
> >>>>> >>
> >>>>> >> We will try Jitsi again, will a fallback url provided.
> >>>>> >> More details to follow
> >>>>> >>
> >>>>> >>
> >>>>> >>
> >>>>> >> --
> >>>>> >>
> >>>>> >> *Gavin McDonald*
> >>>>> >> Systems Administrator
> >>>>> >> ASF Infrastructure Team
> >>>>> >>
> >>>>> >
> >>>>> >
> >>>>> > --
> >>>>> >
> >>>>> > *Gavin McDonald*
> >>>>> > Systems Administrator
> >>>>> > ASF Infrastructure Team
> >>>>> >
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>> *Gavin McDonald*
> >>>>> Systems Administrator
> >>>>> ASF Infrastructure Team
> >>>>>
> >>>>
> >>>>
> >>>> --
> >>>> +48 660 796 129
> >>>>
> >>>>
> >>>> --
> >>>> +48 660 796 129
> >>>>
> >>>
> >>
> >> --
> >> Jarek Potiuk, Principal Software Engineer
> >>
> >> Polidea: http://polidea.com, MCE^4: http://mceconf.com
> >> Mobile: +48 660 796 129
> >>
> >
> >
> > --
> > +48 660 796 129
> >
>
--
*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team
Re: Builds Meeting this Thursday
Posted by Tobiasz Kędzierski <to...@polidea.com>.
Announcement about the meeting showed too late for me and unfortunately I
can not participate.
I hope it will be recorded (at least partially) because I am very
interested in Github Actions.
I wanted to bring back the problem with monitoring and getting statistics
about GitHub Actions [GA] usage within ASF.
Limit for concurrent jobs for ASF is 200, there are more than 200 ASF
repositories which use GA.
One project can stuck queue for the whole organisation and there is no
convenient way to monitor how many workflows and jobs are run within
organisation repositories.
I used GH Rest API (there is no graphQL for it) to periodically fetch
information about GA workflows within ASF repositories (in
https://github.com/TobKed/fetch-apache-ga-stats/).
Based on collected data I created a dashboard in DataStudio. Example pics
from report:
https://pasteboard.co/JJt9HjD.png
https://pasteboard.co/JJtahC2.png
Here is old thread about it:
https://lists.apache.org/thread.html/rcf6da2227d41bce72bc999f33cdf7d676ad4ffea051e2daa05d244b8%40%3Cbuilds.apache.org%3E
Question is: Is there any way to efficiently obtain statistics related to
GitHub Actions?
I would appreciate asking for it on my behalf.
BR
Tobiasz
On Wed, Jan 13, 2021 at 9:53 AM Jarek Potiuk <ja...@potiuk.com> wrote:
> Not sure. But I will ask for it.
>
> On Wed, Jan 13, 2021 at 9:44 AM Jarek Potiuk <ja...@polidea.com>
> wrote:
>
>> Not sure. I will ask if we can record it.
>>
>> On Wed, Jan 13, 2021 at 5:44 AM Sumit Maheshwari <su...@gmail.com>
>> wrote:
>>
>>> Thanks for the heads-up Jarek,
>>>
>>> Will it be recorded?
>>>
>>>
>>> On Wed, Jan 13, 2021 at 3:15 AM Jarek Potiuk <ja...@potiuk.com> wrote:
>>>
>>>> For those who are interested in performance/security of Github Actions,
>>>> there is a meeting of "builds" for ASF this Thursday - where Brian Douglas
>>>> Github's Staff Developers Advocate will be present.
>>>>
>>>> J.
>>>>
>>>> ---------- Forwarded message ---------
>>>> From: Jarek Potiuk <ja...@potiuk.com>
>>>> Date: Tue, Jan 12, 2021 at 10:42 PM
>>>> Subject: Re: Builds Meeting this Thursday
>>>> To: <bu...@apache.org>, <gm...@apache.org>
>>>>
>>>>
>>>> Added my two topics. Thanks Gavin for this opportunity !
>>>>
>>>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
>>>> wrote:
>>>>
>>>>> Please list on the cwiki meeting page any questions you have
>>>>> for Brian so that I may send them to him ahead of time, if
>>>>> possible.
>>>>>
>>>>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>>>>> wrote:
>>>>>
>>>>> > Hi All,
>>>>> >
>>>>> > Cwiki page -
>>>>> >
>>>>> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>>>>> >
>>>>> >
>>>>> >
>>>>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gmcdonald@apache.org
>>>>> >
>>>>> > wrote:
>>>>> >
>>>>> >> Hi All,
>>>>> >>
>>>>> >> Sorry for the last minute notice, this Thursday the 14th January
>>>>> >> at 1700 UTC time will be our next builds@ meeting.
>>>>> >>
>>>>> >> Just confirmed a few minutes ago, there will be a guest
>>>>> >> representing Github on the call to talk about and answer
>>>>> >> questions around Github Actions.
>>>>> >>
>>>>> >> The remainder of the call are self set topics , so whatever
>>>>> >> else you guys want to cover.
>>>>> >>
>>>>> >> We will try Jitsi again, will a fallback url provided.
>>>>> >> More details to follow
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> --
>>>>> >>
>>>>> >> *Gavin McDonald*
>>>>> >> Systems Administrator
>>>>> >> ASF Infrastructure Team
>>>>> >>
>>>>> >
>>>>> >
>>>>> > --
>>>>> >
>>>>> > *Gavin McDonald*
>>>>> > Systems Administrator
>>>>> > ASF Infrastructure Team
>>>>> >
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> *Gavin McDonald*
>>>>> Systems Administrator
>>>>> ASF Infrastructure Team
>>>>>
>>>>
>>>>
>>>> --
>>>> +48 660 796 129
>>>>
>>>>
>>>> --
>>>> +48 660 796 129
>>>>
>>>
>>
>> --
>> Jarek Potiuk, Principal Software Engineer
>>
>> Polidea: http://polidea.com, MCE^4: http://mceconf.com
>> Mobile: +48 660 796 129
>>
>
>
> --
> +48 660 796 129
>
Re: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
Not sure. But I will ask for it.
On Wed, Jan 13, 2021 at 9:44 AM Jarek Potiuk <ja...@polidea.com>
wrote:
> Not sure. I will ask if we can record it.
>
> On Wed, Jan 13, 2021 at 5:44 AM Sumit Maheshwari <su...@gmail.com>
> wrote:
>
>> Thanks for the heads-up Jarek,
>>
>> Will it be recorded?
>>
>>
>> On Wed, Jan 13, 2021 at 3:15 AM Jarek Potiuk <ja...@potiuk.com> wrote:
>>
>>> For those who are interested in performance/security of Github Actions,
>>> there is a meeting of "builds" for ASF this Thursday - where Brian Douglas
>>> Github's Staff Developers Advocate will be present.
>>>
>>> J.
>>>
>>> ---------- Forwarded message ---------
>>> From: Jarek Potiuk <ja...@potiuk.com>
>>> Date: Tue, Jan 12, 2021 at 10:42 PM
>>> Subject: Re: Builds Meeting this Thursday
>>> To: <bu...@apache.org>, <gm...@apache.org>
>>>
>>>
>>> Added my two topics. Thanks Gavin for this opportunity !
>>>
>>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
>>> wrote:
>>>
>>>> Please list on the cwiki meeting page any questions you have
>>>> for Brian so that I may send them to him ahead of time, if
>>>> possible.
>>>>
>>>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>>>> wrote:
>>>>
>>>> > Hi All,
>>>> >
>>>> > Cwiki page -
>>>> >
>>>> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>>>> >
>>>> >
>>>> >
>>>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>>>> > wrote:
>>>> >
>>>> >> Hi All,
>>>> >>
>>>> >> Sorry for the last minute notice, this Thursday the 14th January
>>>> >> at 1700 UTC time will be our next builds@ meeting.
>>>> >>
>>>> >> Just confirmed a few minutes ago, there will be a guest
>>>> >> representing Github on the call to talk about and answer
>>>> >> questions around Github Actions.
>>>> >>
>>>> >> The remainder of the call are self set topics , so whatever
>>>> >> else you guys want to cover.
>>>> >>
>>>> >> We will try Jitsi again, will a fallback url provided.
>>>> >> More details to follow
>>>> >>
>>>> >>
>>>> >>
>>>> >> --
>>>> >>
>>>> >> *Gavin McDonald*
>>>> >> Systems Administrator
>>>> >> ASF Infrastructure Team
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> >
>>>> > *Gavin McDonald*
>>>> > Systems Administrator
>>>> > ASF Infrastructure Team
>>>> >
>>>>
>>>>
>>>> --
>>>>
>>>> *Gavin McDonald*
>>>> Systems Administrator
>>>> ASF Infrastructure Team
>>>>
>>>
>>>
>>> --
>>> +48 660 796 129
>>>
>>>
>>> --
>>> +48 660 796 129
>>>
>>
>
> --
> Jarek Potiuk, Principal Software Engineer
>
> Polidea: http://polidea.com, MCE^4: http://mceconf.com
> Mobile: +48 660 796 129
>
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Sumit Maheshwari <su...@gmail.com>.
Thanks for the heads-up Jarek,
Will it be recorded?
On Wed, Jan 13, 2021 at 3:15 AM Jarek Potiuk <ja...@potiuk.com> wrote:
> For those who are interested in performance/security of Github Actions,
> there is a meeting of "builds" for ASF this Thursday - where Brian Douglas
> Github's Staff Developers Advocate will be present.
>
> J.
>
> ---------- Forwarded message ---------
> From: Jarek Potiuk <ja...@potiuk.com>
> Date: Tue, Jan 12, 2021 at 10:42 PM
> Subject: Re: Builds Meeting this Thursday
> To: <bu...@apache.org>, <gm...@apache.org>
>
>
> Added my two topics. Thanks Gavin for this opportunity !
>
> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
>> Please list on the cwiki meeting page any questions you have
>> for Brian so that I may send them to him ahead of time, if
>> possible.
>>
>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>> wrote:
>>
>> > Hi All,
>> >
>> > Cwiki page -
>> >
>> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>> >
>> >
>> >
>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>> > wrote:
>> >
>> >> Hi All,
>> >>
>> >> Sorry for the last minute notice, this Thursday the 14th January
>> >> at 1700 UTC time will be our next builds@ meeting.
>> >>
>> >> Just confirmed a few minutes ago, there will be a guest
>> >> representing Github on the call to talk about and answer
>> >> questions around Github Actions.
>> >>
>> >> The remainder of the call are self set topics , so whatever
>> >> else you guys want to cover.
>> >>
>> >> We will try Jitsi again, will a fallback url provided.
>> >> More details to follow
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> *Gavin McDonald*
>> >> Systems Administrator
>> >> ASF Infrastructure Team
>> >>
>> >
>> >
>> > --
>> >
>> > *Gavin McDonald*
>> > Systems Administrator
>> > ASF Infrastructure Team
>> >
>>
>>
>> --
>>
>> *Gavin McDonald*
>> Systems Administrator
>> ASF Infrastructure Team
>>
>
>
> --
> +48 660 796 129
>
>
> --
> +48 660 796 129
>
Re: Builds Meeting this Thursday
Posted by Tyson Hamilton <ty...@google.com>.
I suspect that Beam would suffer from the same problems that Airflow did,
specifically: "1) we won't be stuck in a queue behind other ASF projects
waiting for our "slot"". This is similar to why Beam migrated to using a
dedicated pool of Jenkins agents.
I'm not following the performance of our GH actions and whether they've
been blocking peoples PRs. They haven't been a problem for me. I believe
the urgency is unknown (but I suspect not high) and the first step would be
to perform an analysis of cost/benefit of: 1) migrating existing GH actions
to our own workers (maybe shared VMs with Jenkins agents), 2) migrating all
of Jenkins to GH actions, which would require having our own GH actions
workers anyways.
On Wed, Feb 10, 2021 at 1:59 PM Ahmet Altay <al...@google.com> wrote:
> Nice, thank you for sharing Aizhamal. Change looks relatively
> straightforward.
>
> What is the urgency of this for Beam? Is this already impacting Beam's gh
> actions?
>
> On Tue, Feb 9, 2021 at 7:15 PM Aizhamal Nurmamat kyzy <ai...@apache.org>
> wrote:
>
>> Hi all,
>> In case you may find this interesting / valuable: Airflow has configured
>> their own machines for Github actions.
>>
>> Here's the PR https://github.com/apache/airflow/pull/13730
>>
>> And here's the thread:
>> https://lists.apache.org/thread.html/r2e398f86479e4cbfca13c22e4499fb0becdbba20dd9d6d47e1ed30bd%40%3Cdev.airflow.apache.org%3E
>>
>>
>> On Mon, Feb 8, 2021 at 2:56 PM Ahmet Altay <al...@google.com> wrote:
>>
>>> Thank you for sharing this Ismaël.
>>>
>>> This 180 jobs limit across all Apache projects sounds like a problem for
>>> Beam, because we are running quite a bit of GH actions already. Following
>>> the Airflow suggestions, we can add VMs to apache-beam-testing projects to
>>> add Beam specifici private runners to address the issue. GHs suggestion
>>> against using private VMs in public projects [1] is related to the risk of
>>> unauthorized PRs running unexpected workloads in these VMs. As far as I
>>> remember, we did not have this problem with our jenkins machines and anyone
>>> being able to run code with their PRs. And Airflow has the suggestion of
>>> use preemptible machines. We can do the same and these machines are always
>>> recycled after 24 hours limiting the risks.
>>>
>>> /cc @Tyson Hamilton <ty...@google.com> @David Lu <lu...@google.com> @Alan
>>> Myrvold <am...@google.com>
>>>
>>> [1]
>>> https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners#self-hosted-runner-security-with-public-repositories
>>>
>>> On Mon, Feb 8, 2021 at 3:30 AM JB Onofré <jb...@nanthrax.net> wrote:
>>>
>>>> Hi Ismaël.
>>>>
>>>> Thanks for sharing. I started to evaluate GitHub actions on some other
>>>> Apache projects and the doc is interesting.
>>>>
>>>> Regards
>>>> JB
>>>>
>>>> > Le 8 févr. 2021 à 12:22, Ismaël Mejía <ie...@gmail.com> a écrit :
>>>> >
>>>> > Just for reference and related to this thread. It seems we may end up
>>>> > also having this queue issue (even if we don't fully move to Github
>>>> > actions).
>>>> > "For Apache projects, starting December 2020 we are experiencing a
>>>> > high strain of GitHub Actions jobs. All Apache projects are sharing
>>>> > 180 jobs and as more projects are using GitHub Actions the job queue
>>>> > becomes a serious bottleneck."
>>>> >
>>>> > An interesting document shared recently on builds@ goes deeper on how
>>>> > the Airflow project is dealing with this:
>>>> >
>>>> https://docs.google.com/document/d/1ZZeZ4BYMNX7ycGRUKAXv0s6etz1g-90Onn5nRQQHOfE/edit#
>>>> >
>>>> >> On Mon, Jan 18, 2021 at 1:28 PM Elliotte Rusty Harold
>>>> >> <el...@ibiblio.org> wrote:
>>>> >>
>>>> >>> On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com>
>>>> wrote:
>>>> >>>
>>>> >>> Thanks for sharing this Pablo, This looks super interesting. We
>>>> should
>>>> >>> see if it could make sense to migrate our Jenkins infra to GitHub
>>>> >>> Actions given that it is free and quickly becoming the new
>>>> 'standard',
>>>> >>> Good points it is 'free' because we will bring our machines and
>>>> Google
>>>> >>> pays :) bad points we will become 100% github dependant.
>>>> >>>
>>>> >>
>>>> >> Github actions have a really big advantage over Jenkins: they run on
>>>> >> forks, not just branches. This is very useful to non-commmiter
>>>> >> contributors.
>>>> >>
>>>> >> On the minus side it's not clear if one can see the logs from the
>>>> >> integration tests, which is blocking some work in the
>>>> >> maven-site-plugin:
>>>> >>
>>>> >>
>>>> https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
>>>> >>
>>>> >> --
>>>> >> Elliotte Rusty Harold
>>>> >> elharo@ibiblio.org
>>>>
>>>>
Re: Builds Meeting this Thursday
Posted by Ahmet Altay <al...@google.com>.
Nice, thank you for sharing Aizhamal. Change looks relatively
straightforward.
What is the urgency of this for Beam? Is this already impacting Beam's gh
actions?
On Tue, Feb 9, 2021 at 7:15 PM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:
> Hi all,
> In case you may find this interesting / valuable: Airflow has configured
> their own machines for Github actions.
>
> Here's the PR https://github.com/apache/airflow/pull/13730
>
> And here's the thread:
> https://lists.apache.org/thread.html/r2e398f86479e4cbfca13c22e4499fb0becdbba20dd9d6d47e1ed30bd%40%3Cdev.airflow.apache.org%3E
>
>
> On Mon, Feb 8, 2021 at 2:56 PM Ahmet Altay <al...@google.com> wrote:
>
>> Thank you for sharing this Ismaël.
>>
>> This 180 jobs limit across all Apache projects sounds like a problem for
>> Beam, because we are running quite a bit of GH actions already. Following
>> the Airflow suggestions, we can add VMs to apache-beam-testing projects to
>> add Beam specifici private runners to address the issue. GHs suggestion
>> against using private VMs in public projects [1] is related to the risk of
>> unauthorized PRs running unexpected workloads in these VMs. As far as I
>> remember, we did not have this problem with our jenkins machines and anyone
>> being able to run code with their PRs. And Airflow has the suggestion of
>> use preemptible machines. We can do the same and these machines are always
>> recycled after 24 hours limiting the risks.
>>
>> /cc @Tyson Hamilton <ty...@google.com> @David Lu <lu...@google.com> @Alan
>> Myrvold <am...@google.com>
>>
>> [1]
>> https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners#self-hosted-runner-security-with-public-repositories
>>
>> On Mon, Feb 8, 2021 at 3:30 AM JB Onofré <jb...@nanthrax.net> wrote:
>>
>>> Hi Ismaël.
>>>
>>> Thanks for sharing. I started to evaluate GitHub actions on some other
>>> Apache projects and the doc is interesting.
>>>
>>> Regards
>>> JB
>>>
>>> > Le 8 févr. 2021 à 12:22, Ismaël Mejía <ie...@gmail.com> a écrit :
>>> >
>>> > Just for reference and related to this thread. It seems we may end up
>>> > also having this queue issue (even if we don't fully move to Github
>>> > actions).
>>> > "For Apache projects, starting December 2020 we are experiencing a
>>> > high strain of GitHub Actions jobs. All Apache projects are sharing
>>> > 180 jobs and as more projects are using GitHub Actions the job queue
>>> > becomes a serious bottleneck."
>>> >
>>> > An interesting document shared recently on builds@ goes deeper on how
>>> > the Airflow project is dealing with this:
>>> >
>>> https://docs.google.com/document/d/1ZZeZ4BYMNX7ycGRUKAXv0s6etz1g-90Onn5nRQQHOfE/edit#
>>> >
>>> >> On Mon, Jan 18, 2021 at 1:28 PM Elliotte Rusty Harold
>>> >> <el...@ibiblio.org> wrote:
>>> >>
>>> >>> On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com>
>>> wrote:
>>> >>>
>>> >>> Thanks for sharing this Pablo, This looks super interesting. We
>>> should
>>> >>> see if it could make sense to migrate our Jenkins infra to GitHub
>>> >>> Actions given that it is free and quickly becoming the new
>>> 'standard',
>>> >>> Good points it is 'free' because we will bring our machines and
>>> Google
>>> >>> pays :) bad points we will become 100% github dependant.
>>> >>>
>>> >>
>>> >> Github actions have a really big advantage over Jenkins: they run on
>>> >> forks, not just branches. This is very useful to non-commmiter
>>> >> contributors.
>>> >>
>>> >> On the minus side it's not clear if one can see the logs from the
>>> >> integration tests, which is blocking some work in the
>>> >> maven-site-plugin:
>>> >>
>>> >>
>>> https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
>>> >>
>>> >> --
>>> >> Elliotte Rusty Harold
>>> >> elharo@ibiblio.org
>>>
>>>
Re: Builds Meeting this Thursday
Posted by Aizhamal Nurmamat kyzy <ai...@apache.org>.
Hi all,
In case you may find this interesting / valuable: Airflow has configured
their own machines for Github actions.
Here's the PR https://github.com/apache/airflow/pull/13730
And here's the thread:
https://lists.apache.org/thread.html/r2e398f86479e4cbfca13c22e4499fb0becdbba20dd9d6d47e1ed30bd%40%3Cdev.airflow.apache.org%3E
On Mon, Feb 8, 2021 at 2:56 PM Ahmet Altay <al...@google.com> wrote:
> Thank you for sharing this Ismaël.
>
> This 180 jobs limit across all Apache projects sounds like a problem for
> Beam, because we are running quite a bit of GH actions already. Following
> the Airflow suggestions, we can add VMs to apache-beam-testing projects to
> add Beam specifici private runners to address the issue. GHs suggestion
> against using private VMs in public projects [1] is related to the risk of
> unauthorized PRs running unexpected workloads in these VMs. As far as I
> remember, we did not have this problem with our jenkins machines and anyone
> being able to run code with their PRs. And Airflow has the suggestion of
> use preemptible machines. We can do the same and these machines are always
> recycled after 24 hours limiting the risks.
>
> /cc @Tyson Hamilton <ty...@google.com> @David Lu <lu...@google.com> @Alan
> Myrvold <am...@google.com>
>
> [1]
> https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners#self-hosted-runner-security-with-public-repositories
>
> On Mon, Feb 8, 2021 at 3:30 AM JB Onofré <jb...@nanthrax.net> wrote:
>
>> Hi Ismaël.
>>
>> Thanks for sharing. I started to evaluate GitHub actions on some other
>> Apache projects and the doc is interesting.
>>
>> Regards
>> JB
>>
>> > Le 8 févr. 2021 à 12:22, Ismaël Mejía <ie...@gmail.com> a écrit :
>> >
>> > Just for reference and related to this thread. It seems we may end up
>> > also having this queue issue (even if we don't fully move to Github
>> > actions).
>> > "For Apache projects, starting December 2020 we are experiencing a
>> > high strain of GitHub Actions jobs. All Apache projects are sharing
>> > 180 jobs and as more projects are using GitHub Actions the job queue
>> > becomes a serious bottleneck."
>> >
>> > An interesting document shared recently on builds@ goes deeper on how
>> > the Airflow project is dealing with this:
>> >
>> https://docs.google.com/document/d/1ZZeZ4BYMNX7ycGRUKAXv0s6etz1g-90Onn5nRQQHOfE/edit#
>> >
>> >> On Mon, Jan 18, 2021 at 1:28 PM Elliotte Rusty Harold
>> >> <el...@ibiblio.org> wrote:
>> >>
>> >>> On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com>
>> wrote:
>> >>>
>> >>> Thanks for sharing this Pablo, This looks super interesting. We should
>> >>> see if it could make sense to migrate our Jenkins infra to GitHub
>> >>> Actions given that it is free and quickly becoming the new 'standard',
>> >>> Good points it is 'free' because we will bring our machines and Google
>> >>> pays :) bad points we will become 100% github dependant.
>> >>>
>> >>
>> >> Github actions have a really big advantage over Jenkins: they run on
>> >> forks, not just branches. This is very useful to non-commmiter
>> >> contributors.
>> >>
>> >> On the minus side it's not clear if one can see the logs from the
>> >> integration tests, which is blocking some work in the
>> >> maven-site-plugin:
>> >>
>> >>
>> https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
>> >>
>> >> --
>> >> Elliotte Rusty Harold
>> >> elharo@ibiblio.org
>>
>>
Re: Builds Meeting this Thursday
Posted by Ahmet Altay <al...@google.com>.
Thank you for sharing this Ismaël.
This 180 jobs limit across all Apache projects sounds like a problem for
Beam, because we are running quite a bit of GH actions already. Following
the Airflow suggestions, we can add VMs to apache-beam-testing projects to
add Beam specifici private runners to address the issue. GHs suggestion
against using private VMs in public projects [1] is related to the risk of
unauthorized PRs running unexpected workloads in these VMs. As far as I
remember, we did not have this problem with our jenkins machines and anyone
being able to run code with their PRs. And Airflow has the suggestion of
use preemptible machines. We can do the same and these machines are always
recycled after 24 hours limiting the risks.
/cc @Tyson Hamilton <ty...@google.com> @David Lu <lu...@google.com> @Alan
Myrvold <am...@google.com>
[1]
https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners#self-hosted-runner-security-with-public-repositories
On Mon, Feb 8, 2021 at 3:30 AM JB Onofré <jb...@nanthrax.net> wrote:
> Hi Ismaël.
>
> Thanks for sharing. I started to evaluate GitHub actions on some other
> Apache projects and the doc is interesting.
>
> Regards
> JB
>
> > Le 8 févr. 2021 à 12:22, Ismaël Mejía <ie...@gmail.com> a écrit :
> >
> > Just for reference and related to this thread. It seems we may end up
> > also having this queue issue (even if we don't fully move to Github
> > actions).
> > "For Apache projects, starting December 2020 we are experiencing a
> > high strain of GitHub Actions jobs. All Apache projects are sharing
> > 180 jobs and as more projects are using GitHub Actions the job queue
> > becomes a serious bottleneck."
> >
> > An interesting document shared recently on builds@ goes deeper on how
> > the Airflow project is dealing with this:
> >
> https://docs.google.com/document/d/1ZZeZ4BYMNX7ycGRUKAXv0s6etz1g-90Onn5nRQQHOfE/edit#
> >
> >> On Mon, Jan 18, 2021 at 1:28 PM Elliotte Rusty Harold
> >> <el...@ibiblio.org> wrote:
> >>
> >>> On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com>
> wrote:
> >>>
> >>> Thanks for sharing this Pablo, This looks super interesting. We should
> >>> see if it could make sense to migrate our Jenkins infra to GitHub
> >>> Actions given that it is free and quickly becoming the new 'standard',
> >>> Good points it is 'free' because we will bring our machines and Google
> >>> pays :) bad points we will become 100% github dependant.
> >>>
> >>
> >> Github actions have a really big advantage over Jenkins: they run on
> >> forks, not just branches. This is very useful to non-commmiter
> >> contributors.
> >>
> >> On the minus side it's not clear if one can see the logs from the
> >> integration tests, which is blocking some work in the
> >> maven-site-plugin:
> >>
> >>
> https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
> >>
> >> --
> >> Elliotte Rusty Harold
> >> elharo@ibiblio.org
>
>
Re: Builds Meeting this Thursday
Posted by JB Onofré <jb...@nanthrax.net>.
Hi Ismaël.
Thanks for sharing. I started to evaluate GitHub actions on some other Apache projects and the doc is interesting.
Regards
JB
> Le 8 févr. 2021 à 12:22, Ismaël Mejía <ie...@gmail.com> a écrit :
>
> Just for reference and related to this thread. It seems we may end up
> also having this queue issue (even if we don't fully move to Github
> actions).
> "For Apache projects, starting December 2020 we are experiencing a
> high strain of GitHub Actions jobs. All Apache projects are sharing
> 180 jobs and as more projects are using GitHub Actions the job queue
> becomes a serious bottleneck."
>
> An interesting document shared recently on builds@ goes deeper on how
> the Airflow project is dealing with this:
> https://docs.google.com/document/d/1ZZeZ4BYMNX7ycGRUKAXv0s6etz1g-90Onn5nRQQHOfE/edit#
>
>> On Mon, Jan 18, 2021 at 1:28 PM Elliotte Rusty Harold
>> <el...@ibiblio.org> wrote:
>>
>>> On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com> wrote:
>>>
>>> Thanks for sharing this Pablo, This looks super interesting. We should
>>> see if it could make sense to migrate our Jenkins infra to GitHub
>>> Actions given that it is free and quickly becoming the new 'standard',
>>> Good points it is 'free' because we will bring our machines and Google
>>> pays :) bad points we will become 100% github dependant.
>>>
>>
>> Github actions have a really big advantage over Jenkins: they run on
>> forks, not just branches. This is very useful to non-commmiter
>> contributors.
>>
>> On the minus side it's not clear if one can see the logs from the
>> integration tests, which is blocking some work in the
>> maven-site-plugin:
>>
>> https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
>>
>> --
>> Elliotte Rusty Harold
>> elharo@ibiblio.org
Re: Builds Meeting this Thursday
Posted by Ismaël Mejía <ie...@gmail.com>.
Just for reference and related to this thread. It seems we may end up
also having this queue issue (even if we don't fully move to Github
actions).
"For Apache projects, starting December 2020 we are experiencing a
high strain of GitHub Actions jobs. All Apache projects are sharing
180 jobs and as more projects are using GitHub Actions the job queue
becomes a serious bottleneck."
An interesting document shared recently on builds@ goes deeper on how
the Airflow project is dealing with this:
https://docs.google.com/document/d/1ZZeZ4BYMNX7ycGRUKAXv0s6etz1g-90Onn5nRQQHOfE/edit#
On Mon, Jan 18, 2021 at 1:28 PM Elliotte Rusty Harold
<el...@ibiblio.org> wrote:
>
> On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com> wrote:
> >
> > Thanks for sharing this Pablo, This looks super interesting. We should
> > see if it could make sense to migrate our Jenkins infra to GitHub
> > Actions given that it is free and quickly becoming the new 'standard',
> > Good points it is 'free' because we will bring our machines and Google
> > pays :) bad points we will become 100% github dependant.
> >
>
> Github actions have a really big advantage over Jenkins: they run on
> forks, not just branches. This is very useful to non-commmiter
> contributors.
>
> On the minus side it's not clear if one can see the logs from the
> integration tests, which is blocking some work in the
> maven-site-plugin:
>
> https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
>
> --
> Elliotte Rusty Harold
> elharo@ibiblio.org
Re: Builds Meeting this Thursday
Posted by Elliotte Rusty Harold <el...@ibiblio.org>.
On Mon, Jan 18, 2021 at 10:49 AM Ismaël Mejía <ie...@gmail.com> wrote:
>
> Thanks for sharing this Pablo, This looks super interesting. We should
> see if it could make sense to migrate our Jenkins infra to GitHub
> Actions given that it is free and quickly becoming the new 'standard',
> Good points it is 'free' because we will bring our machines and Google
> pays :) bad points we will become 100% github dependant.
>
Github actions have a really big advantage over Jenkins: they run on
forks, not just branches. This is very useful to non-commmiter
contributors.
On the minus side it's not clear if one can see the logs from the
integration tests, which is blocking some work in the
maven-site-plugin:
https://github.com/apache/maven-site-plugin/pull/34#issuecomment-762207488
--
Elliotte Rusty Harold
elharo@ibiblio.org
Re: Builds Meeting this Thursday
Posted by Ismaël Mejía <ie...@gmail.com>.
Thanks for sharing this Pablo, This looks super interesting. We should
see if it could make sense to migrate our Jenkins infra to GitHub
Actions given that it is free and quickly becoming the new 'standard',
Good points it is 'free' because we will bring our machines and Google
pays :) bad points we will become 100% github dependant.
Related: In Avro we moved to github actions recently but we preserve a
docker based build workflow as a backup, but the Avro build is really
simple compared to Beam's.
Tobias it seems you did not copy builds@ or gavin in your answer (save
if it is in BCC)
Are there any interesting news after the meeting?
On Thu, Jan 14, 2021 at 9:54 AM Tobiasz Kędzierski
<to...@polidea.com> wrote:
>
> Thanks Gavin for the detailed response.
>
> > I'll ensure it gets looked into. If you could edit the meeting wiki page
> with the above even better :)
>
> Unfortunately I don't have permissions to edit cwiki.
>
> BR
> Tobiasz
>
> On Thu, Jan 14, 2021 at 1:35 AM Pablo Estrada <pa...@google.com> wrote:
>>
>> Hi all,
>> I've found out about this presentation on Apache Builds. Sharing with dev@ in case it's of interest to anyone. See the agenda: https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>> Best
>> -P.
>>
>> ---------- Forwarded message ---------
>> From: Jarek Potiuk <ja...@potiuk.com>
>> Date: Tue, Jan 12, 2021 at 1:45 PM
>> Subject: Fwd: Builds Meeting this Thursday
>> To: <de...@airflow.apache.org>
>>
>>
>> For those who are interested in performance/security of Github Actions, there is a meeting of "builds" for ASF this Thursday - where Brian Douglas Github's Staff Developers Advocate will be present.
>>
>> J.
>>
>> ---------- Forwarded message ---------
>> From: Jarek Potiuk <ja...@potiuk.com>
>> Date: Tue, Jan 12, 2021 at 10:42 PM
>> Subject: Re: Builds Meeting this Thursday
>> To: <bu...@apache.org>, <gm...@apache.org>
>>
>>
>> Added my two topics. Thanks Gavin for this opportunity !
>>
>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org> wrote:
>>>
>>> Please list on the cwiki meeting page any questions you have
>>> for Brian so that I may send them to him ahead of time, if
>>> possible.
>>>
>>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>>> wrote:
>>>
>>> > Hi All,
>>> >
>>> > Cwiki page -
>>> > https://cwiki.apache.org/confluence/display
>>
>>
>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org> wrote:
>> Please list on the cwiki meeting page any questions you have
>> for Brian so that I may send them to him ahead of time, if
>> possible.
>>
>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>> wrote:
>>
>> > Hi All,
>> >
>> > Cwiki page -
>> > https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>> >
>> >
>> >
>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>> > wrote:
>>>
>>> >/INFRA/ASF+Builds+Agenda+2021-01-14
>>> >
>>> >
>>> >
>>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>>> > wrote:
>>> >
>>> >> Hi All,
>>> >>
>>> >> Sorry for the last minute notice, this Thursday the 14th January
>>> >> at 1700 UTC time will be our next builds@ meeting.
>>> >>
>>> >> Just confirmed a few minutes ago, there will be a guest
>>> >> representing Github on the call to talk about and answer
>>> >> questions around Github Actions.
>>> >>
>>> >> The remainder of the call are self set topics , so whatever
>>> >> else you guys want to cover.
>>> >>
>>> >> We will try Jitsi again, will a fallback url provided.
>>> >> More details to follow
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >>
>>> >> *Gavin McDonald*
>>> >> Systems Administrator
>>> >> ASF Infrastructure Team
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> > *Gavin McDonald*
>>> > Systems Administrator
>>> > ASF Infrastructure Team
>>> >
>>>
>>>
>>> --
>>>
>>> *Gavin McDonald*
>>> Systems Administrator
>>> ASF Infrastructure Team
>>
>>
>>
>> --
>> +48 660 796 129
>>
>>
>> --
>> +48 660 796 129
Re: Builds Meeting this Thursday
Posted by Tobiasz Kędzierski <to...@polidea.com>.
Thanks Gavin for the detailed response.
> I'll ensure it gets looked into. If you could edit the meeting wiki page
with the above even better :)
Unfortunately I don't have permissions to edit cwiki.
BR
Tobiasz
On Thu, Jan 14, 2021 at 1:35 AM Pablo Estrada <pa...@google.com> wrote:
> Hi all,
> I've found out about this presentation on Apache Builds. Sharing with dev@
> in case it's of interest to anyone. See the agenda:
> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
> Best
> -P.
>
> ---------- Forwarded message ---------
> From: Jarek Potiuk <ja...@potiuk.com>
> Date: Tue, Jan 12, 2021 at 1:45 PM
> Subject: Fwd: Builds Meeting this Thursday
> To: <de...@airflow.apache.org>
>
>
> For those who are interested in performance/security of Github Actions,
> there is a meeting of "builds" for ASF this Thursday - where Brian Douglas
> Github's Staff Developers Advocate will be present.
>
> J.
>
> ---------- Forwarded message ---------
> From: Jarek Potiuk <ja...@potiuk.com>
> Date: Tue, Jan 12, 2021 at 10:42 PM
> Subject: Re: Builds Meeting this Thursday
> To: <bu...@apache.org>, <gm...@apache.org>
>
>
> Added my two topics. Thanks Gavin for this opportunity !
>
> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
>> Please list on the cwiki meeting page any questions you have
>> for Brian so that I may send them to him ahead of time, if
>> possible.
>>
>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>> wrote:
>>
>> > Hi All,
>> >
>> > Cwiki page -
>> > https://cwiki.apache.org/confluence/display
>> <https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14>
>
>
> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
> wrote:
> Please list on the cwiki meeting page any questions you have
> for Brian so that I may send them to him ahead of time, if
> possible.
>
> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
> > Hi All,
> >
> > Cwiki page -
> >
> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
> >
> >
> >
> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
> > wrote:
>
>> >/INFRA/ASF+Builds+Agenda+2021-01-14
>> <https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14>
>> >
>> >
>> >
>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>> > wrote:
>> >
>> >> Hi All,
>> >>
>> >> Sorry for the last minute notice, this Thursday the 14th January
>> >> at 1700 UTC time will be our next builds@ meeting.
>> >>
>> >> Just confirmed a few minutes ago, there will be a guest
>> >> representing Github on the call to talk about and answer
>> >> questions around Github Actions.
>> >>
>> >> The remainder of the call are self set topics , so whatever
>> >> else you guys want to cover.
>> >>
>> >> We will try Jitsi again, will a fallback url provided.
>> >> More details to follow
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> *Gavin McDonald*
>> >> Systems Administrator
>> >> ASF Infrastructure Team
>> >>
>> >
>> >
>> > --
>> >
>> > *Gavin McDonald*
>> > Systems Administrator
>> > ASF Infrastructure Team
>> >
>>
>>
>> --
>>
>> *Gavin McDonald*
>> Systems Administrator
>> ASF Infrastructure Team
>>
>
>
> --
> +48 660 796 129 <+48%20660%20796%20129>
>
>
> --
> +48 660 796 129 <+48%20660%20796%20129>
>
Fwd: Builds Meeting this Thursday
Posted by Pablo Estrada <pa...@google.com>.
Hi all,
I've found out about this presentation on Apache Builds. Sharing with dev@
in case it's of interest to anyone. See the agenda:
https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
Best
-P.
---------- Forwarded message ---------
From: Jarek Potiuk <ja...@potiuk.com>
Date: Tue, Jan 12, 2021 at 1:45 PM
Subject: Fwd: Builds Meeting this Thursday
To: <de...@airflow.apache.org>
For those who are interested in performance/security of Github Actions,
there is a meeting of "builds" for ASF this Thursday - where Brian Douglas
Github's Staff Developers Advocate will be present.
J.
---------- Forwarded message ---------
From: Jarek Potiuk <ja...@potiuk.com>
Date: Tue, Jan 12, 2021 at 10:42 PM
Subject: Re: Builds Meeting this Thursday
To: <bu...@apache.org>, <gm...@apache.org>
Added my two topics. Thanks Gavin for this opportunity !
On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
wrote:
> Please list on the cwiki meeting page any questions you have
> for Brian so that I may send them to him ahead of time, if
> possible.
>
> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
> > Hi All,
> >
> > Cwiki page -
> > https://cwiki.apache.org/confluence/display
> <https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14>
On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
wrote:
Please list on the cwiki meeting page any questions you have
for Brian so that I may send them to him ahead of time, if
possible.
On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
wrote:
> Hi All,
>
> Cwiki page -
>
https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>
>
>
> On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
> wrote:
> >/INFRA/ASF+Builds+Agenda+2021-01-14
> <https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14>
> >
> >
> >
> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
> > wrote:
> >
> >> Hi All,
> >>
> >> Sorry for the last minute notice, this Thursday the 14th January
> >> at 1700 UTC time will be our next builds@ meeting.
> >>
> >> Just confirmed a few minutes ago, there will be a guest
> >> representing Github on the call to talk about and answer
> >> questions around Github Actions.
> >>
> >> The remainder of the call are self set topics , so whatever
> >> else you guys want to cover.
> >>
> >> We will try Jitsi again, will a fallback url provided.
> >> More details to follow
> >>
> >>
> >>
> >> --
> >>
> >> *Gavin McDonald*
> >> Systems Administrator
> >> ASF Infrastructure Team
> >>
> >
> >
> > --
> >
> > *Gavin McDonald*
> > Systems Administrator
> > ASF Infrastructure Team
> >
>
>
> --
>
> *Gavin McDonald*
> Systems Administrator
> ASF Infrastructure Team
>
--
+48 660 796 129 <+48%20660%20796%20129>
--
+48 660 796 129 <+48%20660%20796%20129>
Fwd: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
For those who are interested in performance/security of Github Actions,
there is a meeting of "builds" for ASF this Thursday - where Brian Douglas
Github's Staff Developers Advocate will be present.
J.
---------- Forwarded message ---------
From: Jarek Potiuk <ja...@potiuk.com>
Date: Tue, Jan 12, 2021 at 10:42 PM
Subject: Re: Builds Meeting this Thursday
To: <bu...@apache.org>, <gm...@apache.org>
Added my two topics. Thanks Gavin for this opportunity !
On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
wrote:
> Please list on the cwiki meeting page any questions you have
> for Brian so that I may send them to him ahead of time, if
> possible.
>
> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
> > Hi All,
> >
> > Cwiki page -
> >
> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
> >
> >
> >
> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
> > wrote:
> >
> >> Hi All,
> >>
> >> Sorry for the last minute notice, this Thursday the 14th January
> >> at 1700 UTC time will be our next builds@ meeting.
> >>
> >> Just confirmed a few minutes ago, there will be a guest
> >> representing Github on the call to talk about and answer
> >> questions around Github Actions.
> >>
> >> The remainder of the call are self set topics , so whatever
> >> else you guys want to cover.
> >>
> >> We will try Jitsi again, will a fallback url provided.
> >> More details to follow
> >>
> >>
> >>
> >> --
> >>
> >> *Gavin McDonald*
> >> Systems Administrator
> >> ASF Infrastructure Team
> >>
> >
> >
> > --
> >
> > *Gavin McDonald*
> > Systems Administrator
> > ASF Infrastructure Team
> >
>
>
> --
>
> *Gavin McDonald*
> Systems Administrator
> ASF Infrastructure Team
>
--
+48 660 796 129
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
Sure. My bad and mental shortcut.
>
> Apache Airflow is a PMC. That Committee has *members* that are part of that
> committee. Those members are NOT "PMCs". We have about 200 PMCs at the
> Foundation, established by the Board. Please stop confusing *members* with
> *committees*.
>
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Greg Stein <gs...@gmail.com>.
[offtopic, pet peeve]
On Wed, Jan 13, 2021 at 2:47 AM Jarek Potiuk <ja...@potiuk.com> wrote:
> One of PMCs @Airflow (in ASIA timezone) asked if the meeting can be
Apache Airflow is a PMC. That Committee has *members* that are part of that
committee. Those members are NOT "PMCs". We have about 200 PMCs at the
Foundation, established by the Board. Please stop confusing *members* with
*committees*.
Fwd: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
Unfortunately not recorded, Sumeet :(.
J.
---------- Forwarded message ---------
From: Gavin McDonald <gm...@apache.org>
Date: Wed, Jan 13, 2021 at 5:41 PM
Subject: Re: Builds Meeting this Thursday
To: Jarek Potiuk <ja...@potiuk.com>
Cc: builds <bu...@apache.org>
Hi,
No, sorry, we will not be recording any builds@ meetings.
On Wed, Jan 13, 2021 at 9:47 AM Jarek Potiuk <ja...@potiuk.com> wrote:
> One of PMCs @Airflow (in ASIA timezone) asked if the meeting can be
> recorded ?
>
> J.
>
>
> On Tue, Jan 12, 2021 at 10:42 PM Jarek Potiuk <ja...@potiuk.com> wrote:
>
>> Added my two topics. Thanks Gavin for this opportunity !
>>
>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
>> wrote:
>>
>>> Please list on the cwiki meeting page any questions you have
>>> for Brian so that I may send them to him ahead of time, if
>>> possible.
>>>
>>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>>> wrote:
>>>
>>> > Hi All,
>>> >
>>> > Cwiki page -
>>> >
>>> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>>> >
>>> >
>>> >
>>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>>> > wrote:
>>> >
>>> >> Hi All,
>>> >>
>>> >> Sorry for the last minute notice, this Thursday the 14th January
>>> >> at 1700 UTC time will be our next builds@ meeting.
>>> >>
>>> >> Just confirmed a few minutes ago, there will be a guest
>>> >> representing Github on the call to talk about and answer
>>> >> questions around Github Actions.
>>> >>
>>> >> The remainder of the call are self set topics , so whatever
>>> >> else you guys want to cover.
>>> >>
>>> >> We will try Jitsi again, will a fallback url provided.
>>> >> More details to follow
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >>
>>> >> *Gavin McDonald*
>>> >> Systems Administrator
>>> >> ASF Infrastructure Team
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> > *Gavin McDonald*
>>> > Systems Administrator
>>> > ASF Infrastructure Team
>>> >
>>>
>>>
>>> --
>>>
>>> *Gavin McDonald*
>>> Systems Administrator
>>> ASF Infrastructure Team
>>>
>>
>>
>> --
>> +48 660 796 129
>>
>
>
> --
> +48 660 796 129
>
--
*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Gavin McDonald <gm...@apache.org>.
Hi,
No, sorry, we will not be recording any builds@ meetings.
On Wed, Jan 13, 2021 at 9:47 AM Jarek Potiuk <ja...@potiuk.com> wrote:
> One of PMCs @Airflow (in ASIA timezone) asked if the meeting can be
> recorded ?
>
> J.
>
>
> On Tue, Jan 12, 2021 at 10:42 PM Jarek Potiuk <ja...@potiuk.com> wrote:
>
>> Added my two topics. Thanks Gavin for this opportunity !
>>
>> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
>> wrote:
>>
>>> Please list on the cwiki meeting page any questions you have
>>> for Brian so that I may send them to him ahead of time, if
>>> possible.
>>>
>>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>>> wrote:
>>>
>>> > Hi All,
>>> >
>>> > Cwiki page -
>>> >
>>> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>>> >
>>> >
>>> >
>>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>>> > wrote:
>>> >
>>> >> Hi All,
>>> >>
>>> >> Sorry for the last minute notice, this Thursday the 14th January
>>> >> at 1700 UTC time will be our next builds@ meeting.
>>> >>
>>> >> Just confirmed a few minutes ago, there will be a guest
>>> >> representing Github on the call to talk about and answer
>>> >> questions around Github Actions.
>>> >>
>>> >> The remainder of the call are self set topics , so whatever
>>> >> else you guys want to cover.
>>> >>
>>> >> We will try Jitsi again, will a fallback url provided.
>>> >> More details to follow
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >>
>>> >> *Gavin McDonald*
>>> >> Systems Administrator
>>> >> ASF Infrastructure Team
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> > *Gavin McDonald*
>>> > Systems Administrator
>>> > ASF Infrastructure Team
>>> >
>>>
>>>
>>> --
>>>
>>> *Gavin McDonald*
>>> Systems Administrator
>>> ASF Infrastructure Team
>>>
>>
>>
>> --
>> +48 660 796 129
>>
>
>
> --
> +48 660 796 129
>
--
*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team
Re: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
One of PMCs @Airflow (in ASIA timezone) asked if the meeting can be
recorded ?
J.
On Tue, Jan 12, 2021 at 10:42 PM Jarek Potiuk <ja...@potiuk.com> wrote:
> Added my two topics. Thanks Gavin for this opportunity !
>
> On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
>> Please list on the cwiki meeting page any questions you have
>> for Brian so that I may send them to him ahead of time, if
>> possible.
>>
>> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
>> wrote:
>>
>> > Hi All,
>> >
>> > Cwiki page -
>> >
>> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>> >
>> >
>> >
>> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
>> > wrote:
>> >
>> >> Hi All,
>> >>
>> >> Sorry for the last minute notice, this Thursday the 14th January
>> >> at 1700 UTC time will be our next builds@ meeting.
>> >>
>> >> Just confirmed a few minutes ago, there will be a guest
>> >> representing Github on the call to talk about and answer
>> >> questions around Github Actions.
>> >>
>> >> The remainder of the call are self set topics , so whatever
>> >> else you guys want to cover.
>> >>
>> >> We will try Jitsi again, will a fallback url provided.
>> >> More details to follow
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> *Gavin McDonald*
>> >> Systems Administrator
>> >> ASF Infrastructure Team
>> >>
>> >
>> >
>> > --
>> >
>> > *Gavin McDonald*
>> > Systems Administrator
>> > ASF Infrastructure Team
>> >
>>
>>
>> --
>>
>> *Gavin McDonald*
>> Systems Administrator
>> ASF Infrastructure Team
>>
>
>
> --
> +48 660 796 129
>
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Jarek Potiuk <ja...@potiuk.com>.
Added my two topics. Thanks Gavin for this opportunity !
On Tue, Jan 12, 2021 at 10:20 PM Gavin McDonald <gm...@apache.org>
wrote:
> Please list on the cwiki meeting page any questions you have
> for Brian so that I may send them to him ahead of time, if
> possible.
>
> On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
> > Hi All,
> >
> > Cwiki page -
> >
> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
> >
> >
> >
> > On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
> > wrote:
> >
> >> Hi All,
> >>
> >> Sorry for the last minute notice, this Thursday the 14th January
> >> at 1700 UTC time will be our next builds@ meeting.
> >>
> >> Just confirmed a few minutes ago, there will be a guest
> >> representing Github on the call to talk about and answer
> >> questions around Github Actions.
> >>
> >> The remainder of the call are self set topics , so whatever
> >> else you guys want to cover.
> >>
> >> We will try Jitsi again, will a fallback url provided.
> >> More details to follow
> >>
> >>
> >>
> >> --
> >>
> >> *Gavin McDonald*
> >> Systems Administrator
> >> ASF Infrastructure Team
> >>
> >
> >
> > --
> >
> > *Gavin McDonald*
> > Systems Administrator
> > ASF Infrastructure Team
> >
>
>
> --
>
> *Gavin McDonald*
> Systems Administrator
> ASF Infrastructure Team
>
--
+48 660 796 129
Re: Builds Meeting this Thursday
Posted by Gavin McDonald <gm...@apache.org>.
Please list on the cwiki meeting page any questions you have
for Brian so that I may send them to him ahead of time, if
possible.
On Tue, Jan 12, 2021 at 10:00 PM Gavin McDonald <gm...@apache.org>
wrote:
> Hi All,
>
> Cwiki page -
> https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
>
>
>
> On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org>
> wrote:
>
>> Hi All,
>>
>> Sorry for the last minute notice, this Thursday the 14th January
>> at 1700 UTC time will be our next builds@ meeting.
>>
>> Just confirmed a few minutes ago, there will be a guest
>> representing Github on the call to talk about and answer
>> questions around Github Actions.
>>
>> The remainder of the call are self set topics , so whatever
>> else you guys want to cover.
>>
>> We will try Jitsi again, will a fallback url provided.
>> More details to follow
>>
>>
>>
>> --
>>
>> *Gavin McDonald*
>> Systems Administrator
>> ASF Infrastructure Team
>>
>
>
> --
>
> *Gavin McDonald*
> Systems Administrator
> ASF Infrastructure Team
>
--
*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team
Re: Builds Meeting this Thursday
Posted by Gavin McDonald <gm...@apache.org>.
Hi All,
Cwiki page -
https://cwiki.apache.org/confluence/display/INFRA/ASF+Builds+Agenda+2021-01-14
On Tue, Jan 12, 2021 at 9:53 PM Gavin McDonald <gm...@apache.org> wrote:
> Hi All,
>
> Sorry for the last minute notice, this Thursday the 14th January
> at 1700 UTC time will be our next builds@ meeting.
>
> Just confirmed a few minutes ago, there will be a guest
> representing Github on the call to talk about and answer
> questions around Github Actions.
>
> The remainder of the call are self set topics , so whatever
> else you guys want to cover.
>
> We will try Jitsi again, will a fallback url provided.
> More details to follow
>
>
>
> --
>
> *Gavin McDonald*
> Systems Administrator
> ASF Infrastructure Team
>
--
*Gavin McDonald*
Systems Administrator
ASF Infrastructure Team