You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@httpd.apache.org by Jim Jagielski <ji...@jaguNET.com> on 2018/08/09 15:02:03 UTC

t/apache/getfile.t

Anyone having issues w/ the above test hanging after test 182?

On the 2.4.x branch it runs thru to completion, but on trunk (macOS),
stalls after 182:

    ...
    #lwp request:
    #GET http://localhost:8529/getfiles-perl-pod/perlxstypemap.pod HTTP/1.1
    #User-Agent: libwww-perl/6.26
    #
    #server response:
    #HTTP/1.1 200 OK
    #Connection: close
    #Date: Thu, 09 Aug 2018 14:55:55 GMT
    #Accept-Ranges: bytes
    #ETag: "5c10-553a96d6d2080"
    #Server: Apache/2.4.35-dev (Unix) OpenSSL/1.0.2o
    #Vary: In-If1
    #Content-Length: 23568
    #Last-Modified: Thu, 06 Jul 2017 17:27:14 GMT
    #Client-Date: Thu, 09 Aug 2018 14:55:55 GMT
    #Client-Peer: 127.0.0.1:8529
    #Client-Response-Num: 1
    #DMMATCH1: 1
    #
    # testing : download of /getfiles-perl-pod/perlxstypemap.pod
    # expected: 23568
    # received: 23568
    ok 182
  <<< trunk just hangs here >>>
    #lwp request:
    #GET http://localhost:8529/getfiles-binary-httpd HTTP/1.1
    #User-Agent: libwww-perl/6.26
    #
    #server response:
    #HTTP/1.1 200 OK
    #Connection: close
    #Date: Thu, 09 Aug 2018 14:55:55 GMT
    #Accept-Ranges: bytes
    #ETag: "386e78-57301d0098680"
    #Server: Apache/2.4.35-dev (Unix) OpenSSL/1.0.2o
    #Vary: In-If1
    #Content-Length: 3698296
    #Last-Modified: Thu, 09 Aug 2018 14:55:06 GMT
    #Client-Date: Thu, 09 Aug 2018 14:55:55 GMT
    #Client-Peer: 127.0.0.1:8529
    #Client-Response-Num: 1
    #DMMATCH1: 1
    #
    # testing : download of /getfiles-binary-httpd
    # expected: 3698296
    # received: 3698296
    ok 183
    #lwp request:
    #GET http://localhost:8529/getfiles-binary-perl HTTP/1.1
    #User-Agent: libwww-perl/6.26
    #
    #server response:
    #HTTP/1.1 200 OK
    #Connection: close
    #Date: Thu, 09 Aug 2018 14:55:55 GMT
    #Accept-Ranges: bytes
    #ETag: "18c728-553a96d5dde40"
    #Server: Apache/2.4.35-dev (Unix) OpenSSL/1.0.2o
    #Vary: In-If1
    #Content-Length: 1623848
    #Last-Modified: Thu, 06 Jul 2017 17:27:13 GMT
    #Client-Date: Thu, 09 Aug 2018 14:55:55 GMT
    #Client-Peer: 127.0.0.1:8529
    #Client-Response-Num: 1
    #DMMATCH1: 1
    #
    # testing : download of /getfiles-binary-perl
    # expected: 1623848
    # received: 1623848
    ok 184
    ok
    All tests successful.

Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Jim Jagielski <ji...@jaguNET.com>.
Yeppers... looks like:

   core: axe data_in_in/output_filter from conn_rec.

was done prematurely and/or not completely.

Yann, can you fix this? I'm having a hard time groking your thought process in
the restructuring here.

> On Aug 9, 2018, at 4:10 PM, Jim Jagielski <ji...@jaguNET.com> wrote:
> 
> I had to go all the way back to r1835846 to get trunk stable again...
> r1836239 is the start of the breakage... :<
> 
> 
>> On Aug 9, 2018, at 3:59 PM, Jim Jagielski <ji...@jaguNET.com> wrote:
>> 
>> I've confirmed that this does NOT happen w/ worker or prefork, so it's definitely something broken with the recent churn on the Event MPM.
>> 
>> No doubt, stuff done over the last 2-3 weeks have broken Event.
> 


Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Yann Ylavic <yl...@gmail.com>.
On Fri, Aug 10, 2018 at 6:28 PM, Jim Jagielski <ji...@jagunet.com> wrote:
> even more so w/ r1837823 :)

Great, thanks for testing!

Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Jim Jagielski <ji...@jaguNET.com>.
even more so w/ r1837823 :)

thx

> On Aug 10, 2018, at 12:19 PM, Yann Ylavic <yl...@gmail.com> wrote:
> 
> On Fri, Aug 10, 2018 at 3:40 PM, Jim Jagielski <ji...@jagunet.com> wrote:
>> Looks like some looping (full error log at: http://home.apache.org/~jim/test/error_log)
> 
> Better with r1837822?


Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Yann Ylavic <yl...@gmail.com>.
On Fri, Aug 10, 2018 at 3:40 PM, Jim Jagielski <ji...@jagunet.com> wrote:
> Looks like some looping (full error log at: http://home.apache.org/~jim/test/error_log)

Better with r1837822?

Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Jim Jagielski <ji...@jaguNET.com>.
Looks like some looping (full error log at: http://home.apache.org/~jim/test/error_log)


[Fri Aug 10 13:36:09.607977 2018] [core:trace8] [pid 43559:tid 123145562525696] util_filter.c(935): [client 127.0.0.1:63911] brigade contains: bytes: 0,
 non-file bytes: 0, eor buckets: 1, morphing buckets: 0
[Fri Aug 10 13:36:09.607993 2018] [core:trace6] [pid 43559:tid 123145562525696] util_filter.c(766): [client 127.0.0.1:63911] setaside full brigade to em
pty brigade in 'req_core' output filter
[Fri Aug 10 13:36:09.608040 2018] [core:trace6] [pid 43559:tid 123145563062272] util_filter.c(831): [client 127.0.0.1:63911] reinstate empty brigade to
full brigade in 'req_core' output filter
[Fri Aug 10 13:36:09.608071 2018] [core:trace8] [pid 43559:tid 123145563062272] util_filter.c(935): [client 127.0.0.1:63911] brigade contains: bytes: 0,
 non-file bytes: 0, eor buckets: 1, morphing buckets: 0
[Fri Aug 10 13:36:09.608093 2018] [core:trace6] [pid 43559:tid 123145563062272] util_filter.c(766): [client 127.0.0.1:63911] setaside full brigade to em
pty brigade in 'req_core' output filter
[Fri Aug 10 13:36:09.608134 2018] [core:trace6] [pid 43559:tid 123145563598848] util_filter.c(831): [client 127.0.0.1:63911] reinstate empty brigade to
full brigade in 'req_core' output filter
[Fri Aug 10 13:36:09.608156 2018] [core:trace8] [pid 43559:tid 123145563598848] util_filter.c(935): [client 127.0.0.1:63911] brigade contains: bytes: 0,
 non-file bytes: 0, eor buckets: 1, morphing buckets: 0
[Fri Aug 10 13:36:09.608173 2018] [core:trace6] [pid 43559:tid 123145563598848] util_filter.c(766): [client 127.0.0.1:63911] setaside full brigade to em
pty brigade in 'req_core' output filter
[Fri Aug 10 13:36:09.608220 2018] [core:trace6] [pid 43559:tid 123145550721024] util_filter.c(831): [client 127.0.0.1:63911] reinstate empty brigade to
full brigade in 'req_core' output filter
[Fri Aug 10 13:36:09.608246 2018] [core:trace8] [pid 43559:tid 123145550721024] util_filter.c(935): [client 127.0.0.1:63911] brigade contains: bytes: 0,
 non-file bytes: 0, eor buckets: 1, morphing buckets: 0

Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Jim Jagielski <ji...@jaguNET.com>.
I've just been able to test on macOS lately. Will work on getting you the
requested error info. Thx

> On Aug 10, 2018, at 9:15 AM, Yann Ylavic <yl...@gmail.com> wrote:
> 
> On Thu, Aug 9, 2018 at 10:10 PM, Jim Jagielski <ji...@jagunet.com> wrote:
>> I had to go all the way back to r1835846 to get trunk stable again...
>> r1836239 is the start of the breakage... :<
> 
> Thanks for bisecting, does it happen on OSX only or other platforms
> too? (can't reproduce on my side...)
> An errog_log with "LogLevel trace8" and "DumpIO{Input,Ouput} on" for
> the blocking test (getfile.t?) would be nice too.


Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Yann Ylavic <yl...@gmail.com>.
On Thu, Aug 9, 2018 at 10:10 PM, Jim Jagielski <ji...@jagunet.com> wrote:
> I had to go all the way back to r1835846 to get trunk stable again...
> r1836239 is the start of the breakage... :<

Thanks for bisecting, does it happen on OSX only or other platforms
too? (can't reproduce on my side...)
An errog_log with "LogLevel trace8" and "DumpIO{Input,Ouput} on" for
the blocking test (getfile.t?) would be nice too.

Re: Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Jim Jagielski <ji...@jaguNET.com>.
I had to go all the way back to r1835846 to get trunk stable again...
r1836239 is the start of the breakage... :<


> On Aug 9, 2018, at 3:59 PM, Jim Jagielski <ji...@jaguNET.com> wrote:
> 
> I've confirmed that this does NOT happen w/ worker or prefork, so it's definitely something broken with the recent churn on the Event MPM.
> 
> No doubt, stuff done over the last 2-3 weeks have broken Event.


Event is broken in trunk (Was: Re: t/apache/getfile.t)

Posted by Jim Jagielski <ji...@jaguNET.com>.
I've confirmed that this does NOT happen w/ worker or prefork, so it's definitely something broken with the recent churn on the Event MPM.

No doubt, stuff done over the last 2-3 weeks have broken Event.

Re: t/apache/getfile.t

Posted by Eric Covener <co...@gmail.com>.
On Thu, Aug 9, 2018 at 1:44 PM Eric Covener <co...@gmail.com> wrote:
>
> On Thu, Aug 9, 2018 at 11:02 AM Jim Jagielski <ji...@jagunet.com> wrote:
> >
> > Anyone having issues w/ the above test hanging after test 182?
> >
> > On the 2.4.x branch it runs thru to completion, but on trunk (macOS),
> > stalls after 182:
>
> Seems to be skipped for me, haven't dug into the verify thing yet if
> you happen to know what setup is required.

Was just Bundle::LWP

-- 
Eric Covener
covener@gmail.com

Re: t/apache/getfile.t

Posted by Eric Covener <co...@gmail.com>.
On Thu, Aug 9, 2018 at 11:02 AM Jim Jagielski <ji...@jagunet.com> wrote:
>
> Anyone having issues w/ the above test hanging after test 182?
>
> On the 2.4.x branch it runs thru to completion, but on trunk (macOS),
> stalls after 182:

Seems to be skipped for me, haven't dug into the verify thing yet if
you happen to know what setup is required.

Re: t/apache/getfile.t

Posted by Jim Jagielski <ji...@jaguNET.com>.
Hmmm... 2.4 runs clean, but it did take some time to come up with
a Perl environment that didn't barf... Mostly, I had to use a really old
Perl. Here it is:

/opt/perl5/bin/perl -V
Summary of my perl5 (revision 5 version 20 subversion 3) configuration:

  Platform:
    osname=darwin, osvers=16.6.0, archname=darwin-2level-multi
    uname='darwin jimsys.local 16.6.0 darwin kernel version 16.6.0: fri apr 14 16:21:16 pdt 2017; root:xnu-3789.60.24~6release_x86_64 x86_64 '
    config_args='-des -Dprefix=/opt/perl5 config.sh'
    hint=previous, useposix=true, d_sigaction=define
    useithreads=undef, usemultiplicity=define
    use64bitint=define, use64bitall=define, uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='cc', ccflags ='-fno-common -DPERL_DARWIN -fno-strict-aliasing -pipe -fstack-protector -I/usr/local/include -I/opt/local/include',
    optimize='-O3',
    cppflags='-fno-common -DPERL_DARWIN -fno-strict-aliasing -pipe -fstack-protector -I/usr/local/include -I/opt/local/include -fno-common -DPERL_DARWIN -fno-strict-aliasing -pipe -fstack-protector -I/usr/local/include -I/opt/local/include'
    ccversion='', gccversion='4.2.1 Compatible Apple LLVM 8.1.0 (clang-802.0.42)', gccosandvers=''
    intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
    ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
    alignbytes=8, prototype=define
  Linker and Libraries:
    ld='cc', ldflags =' -fstack-protector -L/usr/local/lib -L/opt/local/lib'
    libpth=/usr/local/lib /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/../lib/clang/8.1.0/lib /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib /usr/lib /opt/local/lib /usr/local/lib /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/../lib/clang/8.1.0/lib /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib /usr/lib
    libs=-lpthread -lgdbm -ldbm -ldl -lm -lutil -lc
    perllibs=-lpthread -ldl -lm -lutil -lc
    libc=, so=dylib, useshrplib=false, libperl=libperl.a
    gnulibc_version=''
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=bundle, d_dlsymun=undef, ccdlflags=' '
    cccdlflags=' ', lddlflags=' -bundle -undefined dynamic_lookup -L/usr/local/lib -L/opt/local/lib -fstack-protector'


Characteristics of this binary (from libperl):
  Compile-time options: HAS_TIMES MULTIPLICITY PERLIO_LAYERS
                        PERL_DONT_CREATE_GVSV
                        PERL_HASH_FUNC_ONE_AT_A_TIME_HARD
                        PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP
                        PERL_NEW_COPY_ON_WRITE PERL_PRESERVE_IVUV
                        USE_64_BIT_ALL USE_64_BIT_INT USE_LARGE_FILES
                        USE_LOCALE USE_LOCALE_COLLATE USE_LOCALE_CTYPE
                        USE_LOCALE_NUMERIC USE_PERLIO USE_PERL_ATOF
  Built under darwin
  Compiled at Jul  6 2017 13:25:29
  %ENV:
    PERL5LIB="/Users/jim/perl5/lib/perl5"
    PERL_LOCAL_LIB_ROOT="/Users/jim/perl5"
    PERL_MB_OPT="--install_base "/Users/jim/perl5""
    PERL_MM_OPT="INSTALL_BASE=/Users/jim/perl5"
  @INC:
    /Users/jim/perl5/lib/perl5/darwin-2level-multi
    /Users/jim/perl5/lib/perl5
    /opt/perl5/lib/site_perl/5.20.3/darwin-2level
    /opt/perl5/lib/site_perl/5.20.3
    /opt/perl5/lib/5.20.3/darwin-2level
    /opt/perl5/lib/5.20.3
    .

Re: t/apache/getfile.t

Posted by Eric Covener <co...@gmail.com>.
On Fri, Aug 10, 2018 at 12:43 PM William A Rowe Jr <wr...@rowe-clan.net> wrote:
>
> On Thu, Aug 9, 2018 at 1:06 PM, Eric Covener <co...@gmail.com> wrote:
>>
>> On Thu, Aug 9, 2018 at 11:02 AM Jim Jagielski <ji...@jagunet.com> wrote:
>> >
>> > Anyone having issues w/ the above test hanging after test 182?
>> >
>> > On the 2.4.x branch it runs thru to completion, but on trunk (macOS),
>> > stalls after 182:
>>
>> For me on trunk at least (2.4 sandbox is unhealthy) it seems to hang
>> in different tests from run to run.
>
>
> Clarification please... do you mean your 2.4 build/test environment, or
> our 2.4.x branch?
>

Just my own env, not the branch.

Re: t/apache/getfile.t

Posted by William A Rowe Jr <wr...@rowe-clan.net>.
On Thu, Aug 9, 2018 at 1:06 PM, Eric Covener <co...@gmail.com> wrote:

> On Thu, Aug 9, 2018 at 11:02 AM Jim Jagielski <ji...@jagunet.com> wrote:
> >
> > Anyone having issues w/ the above test hanging after test 182?
> >
> > On the 2.4.x branch it runs thru to completion, but on trunk (macOS),
> > stalls after 182:
>
> For me on trunk at least (2.4 sandbox is unhealthy) it seems to hang
> in different tests from run to run.
>

Clarification please... do you mean your 2.4 build/test environment, or
our 2.4.x branch?

Re: t/apache/getfile.t

Posted by Eric Covener <co...@gmail.com>.
On Thu, Aug 9, 2018 at 11:02 AM Jim Jagielski <ji...@jagunet.com> wrote:
>
> Anyone having issues w/ the above test hanging after test 182?
>
> On the 2.4.x branch it runs thru to completion, but on trunk (macOS),
> stalls after 182:

For me on trunk at least (2.4 sandbox is unhealthy) it seems to hang
in different tests from run to run.