You are viewing a plain text version of this content. The canonical link for it is here.
Posted to bugs@httpd.apache.org by bu...@apache.org on 2015/08/22 00:43:53 UTC

[Bug 58267] New: " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

            Bug ID: 58267
           Summary: " Error ap_proxy_set_scoreboard_lb(xxx) failed in
                    child xxx for worker xxx " flooding in error log
           Product: Apache httpd-2
           Version: 2.2.31
          Hardware: PC
                OS: Linux
            Status: NEW
          Severity: minor
          Priority: P2
         Component: mod_proxy_balancer
          Assignee: bugs@httpd.apache.org
          Reporter: thomas.schettino@gmail.com

Created attachment 33021
  --> https://bz.apache.org/bugzilla/attachment.cgi?id=33021&action=edit
httpd.conf that will trigger the error

Since the release of apache 2.2.31 our error log has been flooded with the
following 

[Wed Aug 12 08:30:16 2015] [error] proxy: ap_proxy_set_scoreboard_lb(74) failed
in child 19010 for worker ajp://hostname02:8071
[Wed Aug 12 08:30:16 2015] [error] proxy: ap_proxy_set_scoreboard_lb(76) failed
in child 19010 for worker ajp://hostname01:8071
[Wed Aug 12 08:30:16 2015] [error] proxy: ap_proxy_set_scoreboard_lb(78) failed
in child 19010 for worker ajp://hostname02:8071
[Wed Aug 12 08:30:16 2015] [error] proxy: ap_proxy_set_scoreboard_lb(80) failed
in child 19010 for worker ajp://hostname03:8071 

We actually found it in httpd-2.2.15-45.el6.x86_64 but we can confirm the same
behavior is present in 2.2.31 and in 2.2.x branch (2.2.32) too.

Attached a basic httpd.conf that will trigger the error. 

In my test for triggering the error I had to satisfy the following conditions:
- BalanceMember > 16 
- VirtualHost > 2
- "StandAlone" ProxyPass > 2  # Not a Balancer ProxyPass

For example with 17 BalanceMember and 5 childProcess, 5 lines were written in
the error log. 
With 18 BM, 10 lines ; 19BM, 15 lines and so on. 

When I tried to activate more VHost the increment was not linear, for example
with 17 BalancerMember and 5 childProcess I had :
2 vhost 5 lines
3 vhost 90 lines 
4 vhost 175 lines 

The error is triggered at startup, during restart and in some others conditions
(maybe when a child is spawned ? Not sure couldn't replicate in test ).

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #5 from Thomas Schettino <th...@gmail.com> ---
s/was enough/was not enough/

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #2 from Thomas Schettino <th...@gmail.com> ---
Created attachment 33039
  --> https://bz.apache.org/bugzilla/attachment.cgi?id=33039&action=edit
error_log of patch pr58267.diff

Thanks, tried patch but it doesn't fix it. 

I applied patch to both 2.2.31 and 2.2.32-dev (rev 1697759) and with it applied
child repeatedly segfault.

Attached error_log in debug

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #4 from Thomas Schettino <th...@gmail.com> ---
> or at least
> 
> make clean
> <your configure call here> or ./config.nice
> make
> make install
> 
> ?
> 
> Due to the changes to the header file mod_proxy.h you need to do a clean
> rebuild. Otherwise you get the segfaults.

Good catch. Yesterday I did a 
make clean all
before configuring/compiling/installing. 
Didn't know it was enough.

Now with the attached conf is not throwing any error but it still appear when I
use my production configuration.
Maybe it depends on the quantity of vhost and/or proxypass ? Or some
interactions with other proxy_modules ? 
Will try to update later today or tomorrow.

Thanks for you help so far

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #8 from Thomas Schettino <th...@gmail.com> ---
Finally found a minimal configuration of our prod conf that triggers the error.

Will clean it up a little and then attach it.

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #6 from Ruediger Pluem <rp...@apache.org> ---

> 
> Now with the attached conf is not throwing any error but it still appear
> when I use my production configuration.
> Maybe it depends on the quantity of vhost and/or proxypass ? Or some
> interactions with other proxy_modules ? 

Mind to share a simplified / anonymised version of your production
configuration that still shows the error?

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #7 from Thomas Schettino <th...@gmail.com> ---
Sorry didn't really have time to do some more test, neither to prepare you a
"miniprod.conf" .

Will attach it to ticket, I hope, before weekend.

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #10 from Ruediger Pluem <rp...@apache.org> ---
Thanks for confirming. Backported to 2.2.x as r1700408. Will be part of the
next 2.2.x release.

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #9 from Thomas Schettino <th...@gmail.com> ---
Sorry, my bad. 
I didn't notice until now, when I started to anonymize the miniprod.conf, that
we have 

ServerRoot "/etc/httpd"

that means the modules were loaded from /etc/httpd/modules/ (old version)
instead of /usr/local/apache2/modules/ (patched).

Changed the above to 

ServerRoot "/usr/local/apache2"

and now the error is gone with our production configuration too .

Many thanks for your help :)

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #1 from Ruediger Pluem <rp...@apache.org> ---
Created attachment 33038
  --> https://bz.apache.org/bugzilla/attachment.cgi?id=33038&action=edit
Use the same scoreboard slots for inherited workers

Can you please test if the attached patch fixes your issue?

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

--- Comment #3 from Ruediger Pluem <rp...@apache.org> ---
(In reply to Thomas Schettino from comment #2)
> Created attachment 33039 [details]
> error_log of patch pr58267.diff
> 
> Thanks, tried patch but it doesn't fix it. 
> 
> I applied patch to both 2.2.31 and 2.2.32-dev (rev 1697759) and with it
> applied child repeatedly segfault.
>  

Did you do a

make extraclean
./buildconf
<your configure call here> or ./config.nice
make
make install

or at least

make clean
<your configure call here> or ./config.nice
make
make install

?

Due to the changes to the header file mod_proxy.h you need to do a clean
rebuild. Otherwise you get the segfaults.
Apart from the segfaults I don't see the error messages any longer in the
logfile.

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org


[Bug 58267] " Error ap_proxy_set_scoreboard_lb(xxx) failed in child xxx for worker xxx " flooding in error log

Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58267

Ruediger Pluem <rp...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |FIXED

-- 
You are receiving this mail because:
You are the assignee for the bug.

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org