You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@httpd.apache.org by Giannis Christodoulou <io...@gmail.com> on 2026/02/11 14:53:08 UTC
status of httpd test suites
Hi all,
I've been exploring the python test suite (httpd/test) and the perl test
suite (httpd-tests repo), starting my contributions to httpd with the tests.
I wanted to ask about these different test suites, whether they serve
distinct purposes and whether one of them is primary or complementary to
the other.
In general, where should someone add new tests?
Regards,
Giannis
Re: status of httpd test suites
Posted by Stefan Eissing via dev <de...@httpd.apache.org>.
> Am 12.02.2026 um 09:17 schrieb Giannis Christodoulou <io...@gmail.com>:
>
> Hello,
>
> Thanks for the answer and the responsiveness.
> Just one more clarification, the answer to which test suite should be enhanced in each case lies in the already covered areas (modules) of each test suite or is there a preference for the python based one to gradually make it support more test cases and modules?
I'd say do it where you feel it fits and which one you feel more comfortable extending. As a rule of thumb:
- if you have an additional case to add that fits the configuration in the perl test suite, maybe do it there.
- if you need a completely new vhost setup and specials, maybe the pytest one works better for you
(having added the pytest suite, I am biased here, of course.)
Cheers,
Stefan
>
> Regards,
> Giannis
>
> Στις Τετ 11 Φεβ 2026 στις 5:04 μ.μ., ο/η Rainer Jung <ra...@kippdata.de> έγραψε:
> Hi there,
>
> Am 11.02.26 um 15:53 schrieb Giannis Christodoulou:
> > Hi all,
> >
> > I've been exploring the python test suite (httpd/test) and the perl test
> > suite (httpd-tests repo), starting my contributions to httpd with the tests.
>
> Nice!
>
> > I wanted to ask about these different test suites, whether they serve
> > distinct purposes and whether one of them is primary or complementary to
> > the other.
> > In general, where should someone add new tests?
>
> The test suite in httpd/test is mor modern and based on pytest. It
> mostly tests http2 and mod_md (automated certificate handling).
>
> The other test suite is perl based and contains many more tests, but is
> weak on http2 and non-existent on mod_md.
>
> HTH!
>
> Rainer
>
Re: status of httpd test suites
Posted by Eric Covener <co...@gmail.com>.
On Thu, Feb 12, 2026 at 10:39 AM Rainer Jung <ra...@kippdata.de> wrote:
>
> 2nd attempt, had sent it to the OP instead of the list.
>
> Am 12.02.26 um 09:17 schrieb Giannis Christodoulou:
> > Hello,
> >
> > Thanks for the answer and the responsiveness.
> > Just one more clarification, the answer to which test suite should be
> > enhanced in each case lies in the already covered areas (modules)
> > of each test suite or is there a preference for the python based one to
> > gradually make it support more test cases and modules?
>
> My personal opinion: the perl based suite will not go away soon and has
> a lot of value due to the many tests it runs. The barrier for
> contribution might be lower for the python based tests. So
>
> - choose according to the tested modules/functionality
>
> - if adding to the perl based test suite turns out to be too demanding
> for you and the python based one is much simpler for you, adding tests
> there might be better than adding them nowhere.
I only add to the perl suite because I am familiar with it and more
literate in Perl than Python (despite recognizing that python is much
better)
It is relatively easy to find something similar to what you need and copy it.
The python suite did not work on my AIX systems (python too old?)
where I try to test releases, so I am not even in the habit of running
it.
I think it's fine to favor the python suite for new tests / new
contributors, especially if we can put together better and better
simple examples there.
--
Eric Covener
covener@gmail.com
Re: status of httpd test suites
Posted by Rainer Jung <ra...@kippdata.de>.
2nd attempt, had sent it to the OP instead of the list.
Am 12.02.26 um 09:17 schrieb Giannis Christodoulou:
> Hello,
>
> Thanks for the answer and the responsiveness.
> Just one more clarification, the answer to which test suite should be
> enhanced in each case lies in the already covered areas (modules)
> of each test suite or is there a preference for the python based one to
> gradually make it support more test cases and modules?
My personal opinion: the perl based suite will not go away soon and has
a lot of value due to the many tests it runs. The barrier for
contribution might be lower for the python based tests. So
- choose according to the tested modules/functionality
- if adding to the perl based test suite turns out to be too demanding
for you and the python based one is much simpler for you, adding tests
there might be better than adding them nowhere.
Generally start small, contribute a bit and see, what the response from
the project is.
Best regards,
Rainer
Re: status of httpd test suites
Posted by Giannis Christodoulou <io...@gmail.com>.
Hello,
Thanks for the answer and the responsiveness.
Just one more clarification, the answer to which test suite should be
enhanced in each case lies in the already covered areas (modules) of each
test suite or is there a preference for the python based one to gradually
make it support more test cases and modules?
Regards,
Giannis
Στις Τετ 11 Φεβ 2026 στις 5:04 μ.μ., ο/η Rainer Jung <
rainer.jung@kippdata.de> έγραψε:
> Hi there,
>
> Am 11.02.26 um 15:53 schrieb Giannis Christodoulou:
> > Hi all,
> >
> > I've been exploring the python test suite (httpd/test) and the perl test
> > suite (httpd-tests repo), starting my contributions to httpd with the
> tests.
>
> Nice!
>
> > I wanted to ask about these different test suites, whether they serve
> > distinct purposes and whether one of them is primary or complementary to
> > the other.
> > In general, where should someone add new tests?
>
> The test suite in httpd/test is mor modern and based on pytest. It
> mostly tests http2 and mod_md (automated certificate handling).
>
> The other test suite is perl based and contains many more tests, but is
> weak on http2 and non-existent on mod_md.
>
> HTH!
>
> Rainer
>
>
Re: status of httpd test suites
Posted by Rainer Jung <ra...@kippdata.de>.
Hi there,
Am 11.02.26 um 15:53 schrieb Giannis Christodoulou:
> Hi all,
>
> I've been exploring the python test suite (httpd/test) and the perl test
> suite (httpd-tests repo), starting my contributions to httpd with the tests.
Nice!
> I wanted to ask about these different test suites, whether they serve
> distinct purposes and whether one of them is primary or complementary to
> the other.
> In general, where should someone add new tests?
The test suite in httpd/test is mor modern and based on pytest. It
mostly tests http2 and mod_md (automated certificate handling).
The other test suite is perl based and contains many more tests, but is
weak on http2 and non-existent on mod_md.
HTH!
Rainer