You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@incubator.apache.org by Henrik Ingo <he...@nyrkio.com> on 2026/05/09 12:58:10 UTC
[ANNOUNCE] Apache Otava 0.8.0-incubating released
Apache Otava 0.8.0-incubating has been released
Apache Otava is a command-line tool that detects and alerts about
statistically significant changes in performance test results (more
generally, time-series data) stored in CSV files or a number of
supported databases.
A typical use-case of Otava is as follows:
1. A set of performance tests is scheduled repeatedly, such as after
each commit is pushed.
2. The resulting metrics of the test runs are stored in a time series
database (Graphite) or appended to CSV files.
3. Otava is launched by a Jenkins/Cron job (or an operator) to analyze
the recorded metrics regularly.
4. Otava notifies about significant changes in recorded metrics by
outputting text reports or sending Slack notifications.
5. Otava is capable of finding even small, but persistent shifts in
metric values, despite noise in data. It adapts automatically to the
level of noise in data and tries to notify only about persistent,
statistically significant changes, be it in the system under test or
in the environment.
*Highlights of this release*
This is our first release under the Apache Incubator program that
contains significant updates and new features. Coincidentally we wish
to congratulate Denis Schepakin for becoming the first committer to
have been voted into the project committer team via the ASF process.
Note that unlike all our prior releases, this release breaks backward
compatibility in various ways, including in names of command line
options, and that the algorithm will find change points that
previously may have been missed (for the same input parameters). We
expect to
continue making breaking changes in future 0.8.x and 0.9.x versions.
Users that wish to have minimal changes in their production use of
Otava, are advised to continue using 0.7 until we release a version
1.0.
- Otava now supports python versions (3.10 - 3.14). We aim to
support all active python versions going forward.
- The core algorithm at the heart of Otava change point detection
was completely rewritten, clean slate, directly from the Matteson &
James 2014 paper. #96 <https://github.com/apache/otava/pull/96>
- A thorough and layperson understandable explanation of the
algorithm and our implementation of it was added #126
<https://github.com/apache/otava/pull/126>
- The independent rewrite directly from primary source detected a
bug that has been in all versions of Otava all the way back to the
first public release by MongoDB performance team in 2020. The bug has
caused the algorithm to miss certain classes of change points as
discussed in #96 <https://github.com/apache/otava/pull/96> and #154
<https://github.com/apache/otava/pull/154> On the other hand this is
somewhat compensated for by either 1) using larger max_pvalue, or 2)
the split-merge and weak change points modifications, that have been
on and remain on by default in this release.
- Note that future Otava releases will likely make further tweaks
to the algorithm or its paremeter(s) as we continue to explore the
practical effects of fixing this bug. For example, we may remove some
of the "hunter enhancements" that in retrospect seem to mostly have
been workaround fixes addressing the symptoms of the bug that is now
fixed. We invite the user community to provide input on this topic as
GitHub issues or on the mailing list.
- Support for AMD and ARM Docker images
- E2e tests for CSV, PostgreSQL and Grafite data sources
- Fixes and more consistent options in ConfigArgParse
*Full Changelog*
0.7.0-incubating...0.8.0-incubating
<https://github.com/apache/otava/compare/0.7.0-incubating...0.8.0-incubating>
*Downloads*
- Source release
https://dist.apache.org/repos/dist/dev/incubator/otava/0.8.0-incubating/
- Github release https://github.com/apache/otava/releases/tag0.8.0-incubating
- PyPI https://pypi.org/project/apache-otava/
- Docker image https://hub.docker.com/r/apache/otava
*Otava resources*
Website: https://otava.apache.org/
Issues: https://github.com/apache/otava/issues
Mailing list: dev@otava.apache.org
Henrik Ingo
On behalf of Apache Otava (incubating) Team
*License*
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with this
work for additional information regarding copyright ownership. The ASF
licenses this file to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance with the
License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
License for the specific language governing permissions and limitations
under the License.
*Disclaimer*
Apache Otava (incubating) is an effort undergoing incubation at the Apache
Software Foundation (ASF), sponsored by the Apache Incubator PMC.
Incubation is required of all newly accepted projects until a further
review indicates that the infrastructure, communications, and decision
making process have stabilized in a manner consistent with other successful
ASF projects.
While incubation status is not necessarily a reflection of the completeness or
stability of the code, it does indicate that the project has yet to be fully
endorsed by the ASF.
Re: [ANNOUNCE] Apache Otava 0.8.0-incubating released
Posted by sebb <se...@gmail.com>.
On Sun, 17 May 2026 at 22:56, Henrik Ingo <he...@nyrkio.com> wrote:
>
> Since there were several points of feedback during our recent release, I
> wanted to also come back to this thread to mention that I now have a PR
> open to correct several of the steps in our release process, and the
> template texts to the various emails that are inolved.
> https://github.com/apache/otava/pull/159
>
> I of course expect our own mentors, in this case particularly 'wave' to
> help with the review work, but wanted to also send this email to invite
> those of you who pointed out areas needing correction to verify whether
> those issues are appropriately addressed.
>
> On Wed, May 13, 2026 at 3:41 PM sebb <se...@gmail.com> wrote:
>
> > > > That is not a valid download location for published releases,
> > > > it is only to be used for development items such as release candidates.
> > > > The clue is in the name.
> > > > Please ask your mentors for advice.
> > > >
> > > >
> > > Ah, thanks for pointing out one more of those. This was brought up during
> > > the voting too, and I'm actively working through these. This link slipped
> > > through. This is from a template and I will be fixing the template now.
> >
> > I think a corrected email should be sent too.
> >
> >
> Sure. To avoid having to re-send the same announcement more than twice, I
> hope it is okay to do it after the above PR is reviewed. The template text
> for the announcement email is part of that PR.
That just adds to the delay; it has already been more than a week
since the incorrect link was published.
> henrik
>
> --
> *nyrkio.com <http://nyrkio.com/>* ~ *Continuous Benchmarking as a Service*
>
> Henrik Ingo, CEO
> henrik@nyrkio.com LinkedIn:
> www.linkedin.com/in/heingo
> +358 40 569 7354 Twitter: twitter.com/h_ingo
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [ANNOUNCE] Apache Otava 0.8.0-incubating released
Posted by Henrik Ingo <he...@nyrkio.com>.
Since there were several points of feedback during our recent release, I
wanted to also come back to this thread to mention that I now have a PR
open to correct several of the steps in our release process, and the
template texts to the various emails that are inolved.
https://github.com/apache/otava/pull/159
I of course expect our own mentors, in this case particularly 'wave' to
help with the review work, but wanted to also send this email to invite
those of you who pointed out areas needing correction to verify whether
those issues are appropriately addressed.
On Wed, May 13, 2026 at 3:41 PM sebb <se...@gmail.com> wrote:
> > > That is not a valid download location for published releases,
> > > it is only to be used for development items such as release candidates.
> > > The clue is in the name.
> > > Please ask your mentors for advice.
> > >
> > >
> > Ah, thanks for pointing out one more of those. This was brought up during
> > the voting too, and I'm actively working through these. This link slipped
> > through. This is from a template and I will be fixing the template now.
>
> I think a corrected email should be sent too.
>
>
Sure. To avoid having to re-send the same announcement more than twice, I
hope it is okay to do it after the above PR is reviewed. The template text
for the announcement email is part of that PR.
henrik
--
*nyrkio.com <http://nyrkio.com/>* ~ *Continuous Benchmarking as a Service*
Henrik Ingo, CEO
henrik@nyrkio.com LinkedIn:
www.linkedin.com/in/heingo
+358 40 569 7354 Twitter: twitter.com/h_ingo
Re: [ANNOUNCE] Apache Otava 0.8.0-incubating released
Posted by sebb <se...@gmail.com>.
On Sun, 10 May 2026 at 20:12, Henrik Ingo <he...@nyrkio.com> wrote:
>
> On Sun, May 10, 2026 at 12:20 PM sebb <se...@gmail.com> wrote:
>
> > > *Downloads*
> > >
> > > - Source release
> > > https://dist.apache.org/repos/dist/dev/incubator/otava/0.8.0-incubating/
> >
> > That is not a valid download location for published releases,
> > it is only to be used for development items such as release candidates.
> > The clue is in the name.
> > Please ask your mentors for advice.
> >
> >
> Ah, thanks for pointing out one more of those. This was brought up during
> the voting too, and I'm actively working through these. This link slipped
> through. This is from a template and I will be fixing the template now.
I think a corrected email should be sent too.
> For full status on this issue: on https://otava.apache.org/docs/download/
> the first and most prominent download link should now be fixed and use the
> closer.lua URL. At the bottom the "All releases" section suffers from
> multiple issues, and is not yet fixed.
>
> henrik
>
> --
> *nyrkio.com <http://nyrkio.com/>* ~ *Continuous Benchmarking as a Service*
>
> Henrik Ingo, CEO
> henrik@nyrkio.com LinkedIn:
> www.linkedin.com/in/heingo
> +358 40 569 7354 Twitter: twitter.com/h_ingo
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org
Re: [ANNOUNCE] Apache Otava 0.8.0-incubating released
Posted by Henrik Ingo <he...@nyrkio.com>.
On Sun, May 10, 2026 at 12:20 PM sebb <se...@gmail.com> wrote:
> > *Downloads*
> >
> > - Source release
> > https://dist.apache.org/repos/dist/dev/incubator/otava/0.8.0-incubating/
>
> That is not a valid download location for published releases,
> it is only to be used for development items such as release candidates.
> The clue is in the name.
> Please ask your mentors for advice.
>
>
Ah, thanks for pointing out one more of those. This was brought up during
the voting too, and I'm actively working through these. This link slipped
through. This is from a template and I will be fixing the template now.
For full status on this issue: on https://otava.apache.org/docs/download/
the first and most prominent download link should now be fixed and use the
closer.lua URL. At the bottom the "All releases" section suffers from
multiple issues, and is not yet fixed.
henrik
--
*nyrkio.com <http://nyrkio.com/>* ~ *Continuous Benchmarking as a Service*
Henrik Ingo, CEO
henrik@nyrkio.com LinkedIn:
www.linkedin.com/in/heingo
+358 40 569 7354 Twitter: twitter.com/h_ingo
Re: [ANNOUNCE] Apache Otava 0.8.0-incubating released
Posted by sebb <se...@gmail.com>.
On Sat, 9 May 2026 at 14:55, Henrik Ingo <he...@nyrkio.com> wrote:
>
> Apache Otava 0.8.0-incubating has been released
>
> Apache Otava is a command-line tool that detects and alerts about
> statistically significant changes in performance test results (more
> generally, time-series data) stored in CSV files or a number of
> supported databases.
>
> A typical use-case of Otava is as follows:
> 1. A set of performance tests is scheduled repeatedly, such as after
> each commit is pushed.
> 2. The resulting metrics of the test runs are stored in a time series
> database (Graphite) or appended to CSV files.
> 3. Otava is launched by a Jenkins/Cron job (or an operator) to analyze
> the recorded metrics regularly.
> 4. Otava notifies about significant changes in recorded metrics by
> outputting text reports or sending Slack notifications.
> 5. Otava is capable of finding even small, but persistent shifts in
> metric values, despite noise in data. It adapts automatically to the
> level of noise in data and tries to notify only about persistent,
> statistically significant changes, be it in the system under test or
> in the environment.
>
> *Highlights of this release*
>
> This is our first release under the Apache Incubator program that
> contains significant updates and new features. Coincidentally we wish
> to congratulate Denis Schepakin for becoming the first committer to
> have been voted into the project committer team via the ASF process.
>
> Note that unlike all our prior releases, this release breaks backward
> compatibility in various ways, including in names of command line
> options, and that the algorithm will find change points that
> previously may have been missed (for the same input parameters). We
> expect to
> continue making breaking changes in future 0.8.x and 0.9.x versions.
> Users that wish to have minimal changes in their production use of
> Otava, are advised to continue using 0.7 until we release a version
> 1.0.
>
> - Otava now supports python versions (3.10 - 3.14). We aim to
> support all active python versions going forward.
> - The core algorithm at the heart of Otava change point detection
> was completely rewritten, clean slate, directly from the Matteson &
> James 2014 paper. #96 <https://github.com/apache/otava/pull/96>
> - A thorough and layperson understandable explanation of the
> algorithm and our implementation of it was added #126
> <https://github.com/apache/otava/pull/126>
> - The independent rewrite directly from primary source detected a
> bug that has been in all versions of Otava all the way back to the
> first public release by MongoDB performance team in 2020. The bug has
> caused the algorithm to miss certain classes of change points as
> discussed in #96 <https://github.com/apache/otava/pull/96> and #154
> <https://github.com/apache/otava/pull/154> On the other hand this is
> somewhat compensated for by either 1) using larger max_pvalue, or 2)
> the split-merge and weak change points modifications, that have been
> on and remain on by default in this release.
> - Note that future Otava releases will likely make further tweaks
> to the algorithm or its paremeter(s) as we continue to explore the
> practical effects of fixing this bug. For example, we may remove some
> of the "hunter enhancements" that in retrospect seem to mostly have
> been workaround fixes addressing the symptoms of the bug that is now
> fixed. We invite the user community to provide input on this topic as
> GitHub issues or on the mailing list.
> - Support for AMD and ARM Docker images
> - E2e tests for CSV, PostgreSQL and Grafite data sources
> - Fixes and more consistent options in ConfigArgParse
>
> *Full Changelog*
>
> 0.7.0-incubating...0.8.0-incubating
> <https://github.com/apache/otava/compare/0.7.0-incubating...0.8.0-incubating>
>
>
> *Downloads*
>
> - Source release
> https://dist.apache.org/repos/dist/dev/incubator/otava/0.8.0-incubating/
That is not a valid download location for published releases,
it is only to be used for development items such as release candidates.
The clue is in the name.
Please ask your mentors for advice.
> - Github release https://github.com/apache/otava/releases/tag0.8.0-incubating
> - PyPI https://pypi.org/project/apache-otava/
> - Docker image https://hub.docker.com/r/apache/otava
>
> *Otava resources*
>
> Website: https://otava.apache.org/
> Issues: https://github.com/apache/otava/issues
> Mailing list: dev@otava.apache.org
>
> Henrik Ingo
> On behalf of Apache Otava (incubating) Team
>
>
>
> *License*
>
> Licensed to the Apache Software Foundation (ASF) under one or more
> contributor license agreements. See the NOTICE file distributed with this
> work for additional information regarding copyright ownership. The ASF
> licenses this file to you under the Apache License, Version 2.0 (the
> "License"); you may not use this file except in compliance with the
> License. You may obtain a copy of the License at
>
> http://www.apache.org/licenses/LICENSE-2.0
>
> Unless required by applicable law or agreed to in writing, software
> distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
> WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
> License for the specific language governing permissions and limitations
> under the License.
>
> *Disclaimer*
>
> Apache Otava (incubating) is an effort undergoing incubation at the Apache
> Software Foundation (ASF), sponsored by the Apache Incubator PMC.
>
> Incubation is required of all newly accepted projects until a further
> review indicates that the infrastructure, communications, and decision
> making process have stabilized in a manner consistent with other successful
> ASF projects.
>
> While incubation status is not necessarily a reflection of the completeness or
> stability of the code, it does indicate that the project has yet to be fully
> endorsed by the ASF.
---------------------------------------------------------------------
To unsubscribe, e-mail: general-unsubscribe@incubator.apache.org
For additional commands, e-mail: general-help@incubator.apache.org