You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@community.apache.org by sebb <se...@gmail.com> on 2026/09/14 16:31:14 UTC
Progress on publishing metrics
There is now a preliminary workflow to build the metrics site.
For speed when testing, it currently only builds Attic and skips Git.
The build does not update any files in the repository.
Instead it uploads the output to a run-time artifact which contains
the entire site.
The artifact is also used to cache the output between runs.
The intention is to eventually deploy the artifact to GH pages.
They can be linked from projects.a.o, either as a redirect or a rewrite.
Alternatively, the github-pages artifact can be downloaded to
projects.a.o in a suitable directory.
I have raised an INFRA Jira to enable GH pages [1]
[Some of this explanation needs to be added to README.md ...]
Sebb
[1] https://issues.apache.org/jira/browse/INFRA-28405
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org
Re: Progress on publishing metrics
Posted by sebb <se...@gmail.com>.
On Wed, 16 Sept 2026 at 09:21, sebb <se...@gmail.com> wrote:
>
> On Tue, 15 Sept 2026 at 15:30, Rich Bowen <rb...@rcbowen.com> wrote:
> >
> >
> >
> > > On Sep 15, 2026, at 10:22 AM, sebb <se...@gmail.com> wrote:
> > >
> > > On Mon, 14 Sept 2026 at 17:31, sebb <se...@gmail.com> wrote:
> > >>
> > >> There is now a preliminary workflow to build the metrics site.
> > >> For speed when testing, it currently only builds Attic and skips Git.
> > >>
> > >> The build does not update any files in the repository.
> > >> Instead it uploads the output to a run-time artifact which contains
> > >> the entire site.
> > >> The artifact is also used to cache the output between runs.
> > >>
> > >> The intention is to eventually deploy the artifact to GH pages.
> > >> They can be linked from projects.a.o, either as a redirect or a rewrite.
> > >>
> > >> Alternatively, the github-pages artifact can be downloaded to
> > >> projects.a.o in a suitable directory.
> > >>
> > >> I have raised an INFRA Jira to enable GH pages [1]
> > >
> > > This has now been enabled, and the current partial output is here:
> > > https://apache.github.io/comdev-metrics/
> > >
> > > The site only contains full details for Attic, as it takes a very long
> > > time to gather the stats for all projects.
> >
> >
> > It should be a lot faster after the first time, as it caches everything but the most recent month. But, yeah, that first run took a long time.
>
> It took almost 2 hours, most of which was fetching Git activity, but
> it did complete successfully.
>
> It remains to be seen how long subsequent runs take.
I copied the data files and ran the build locally.
Mail updates took about 5 minutes
Git updates took 50 minutes.
> There are some issues with the output - e.g. podlings show as ids, not
> names (maka rather than Apache Maka)
>
> Can code changes be applied without needing to fetch anything?
>
> Sebb
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
> > For additional commands, e-mail: dev-help@community.apache.org
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org
Re: Progress on publishing metrics
Posted by sebb <se...@gmail.com>.
On Tue, 15 Sept 2026 at 15:30, Rich Bowen <rb...@rcbowen.com> wrote:
>
>
>
> > On Sep 15, 2026, at 10:22 AM, sebb <se...@gmail.com> wrote:
> >
> > On Mon, 14 Sept 2026 at 17:31, sebb <se...@gmail.com> wrote:
> >>
> >> There is now a preliminary workflow to build the metrics site.
> >> For speed when testing, it currently only builds Attic and skips Git.
> >>
> >> The build does not update any files in the repository.
> >> Instead it uploads the output to a run-time artifact which contains
> >> the entire site.
> >> The artifact is also used to cache the output between runs.
> >>
> >> The intention is to eventually deploy the artifact to GH pages.
> >> They can be linked from projects.a.o, either as a redirect or a rewrite.
> >>
> >> Alternatively, the github-pages artifact can be downloaded to
> >> projects.a.o in a suitable directory.
> >>
> >> I have raised an INFRA Jira to enable GH pages [1]
> >
> > This has now been enabled, and the current partial output is here:
> > https://apache.github.io/comdev-metrics/
> >
> > The site only contains full details for Attic, as it takes a very long
> > time to gather the stats for all projects.
>
>
> It should be a lot faster after the first time, as it caches everything but the most recent month. But, yeah, that first run took a long time.
It took almost 2 hours, most of which was fetching Git activity, but
it did complete successfully.
It remains to be seen how long subsequent runs take.
There are some issues with the output - e.g. podlings show as ids, not
names (maka rather than Apache Maka)
Can code changes be applied without needing to fetch anything?
Sebb
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
> For additional commands, e-mail: dev-help@community.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org
Re: Progress on publishing metrics
Posted by Rich Bowen <rb...@rcbowen.com>.
> On Sep 15, 2026, at 10:22 AM, sebb <se...@gmail.com> wrote:
>
> On Mon, 14 Sept 2026 at 17:31, sebb <se...@gmail.com> wrote:
>>
>> There is now a preliminary workflow to build the metrics site.
>> For speed when testing, it currently only builds Attic and skips Git.
>>
>> The build does not update any files in the repository.
>> Instead it uploads the output to a run-time artifact which contains
>> the entire site.
>> The artifact is also used to cache the output between runs.
>>
>> The intention is to eventually deploy the artifact to GH pages.
>> They can be linked from projects.a.o, either as a redirect or a rewrite.
>>
>> Alternatively, the github-pages artifact can be downloaded to
>> projects.a.o in a suitable directory.
>>
>> I have raised an INFRA Jira to enable GH pages [1]
>
> This has now been enabled, and the current partial output is here:
> https://apache.github.io/comdev-metrics/
>
> The site only contains full details for Attic, as it takes a very long
> time to gather the stats for all projects.
It should be a lot faster after the first time, as it caches everything but the most recent month. But, yeah, that first run took a long time.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org
Re: Progress on publishing metrics
Posted by sebb <se...@gmail.com>.
On Mon, 14 Sept 2026 at 17:31, sebb <se...@gmail.com> wrote:
>
> There is now a preliminary workflow to build the metrics site.
> For speed when testing, it currently only builds Attic and skips Git.
>
> The build does not update any files in the repository.
> Instead it uploads the output to a run-time artifact which contains
> the entire site.
> The artifact is also used to cache the output between runs.
>
> The intention is to eventually deploy the artifact to GH pages.
> They can be linked from projects.a.o, either as a redirect or a rewrite.
>
> Alternatively, the github-pages artifact can be downloaded to
> projects.a.o in a suitable directory.
>
> I have raised an INFRA Jira to enable GH pages [1]
This has now been enabled, and the current partial output is here:
https://apache.github.io/comdev-metrics/
The site only contains full details for Attic, as it takes a very long
time to gather the stats for all projects.
I now think that it would be better to move the build to the projects.a.o host.
This would avoid overloading the GH Actions budget, and simplify caching.
Sebb
> [Some of this explanation needs to be added to README.md ...]
>
> Sebb
> [1] https://issues.apache.org/jira/browse/INFRA-28405
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@community.apache.org
For additional commands, e-mail: dev-help@community.apache.org