You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Norbert Elbanbuena <no...@teligentip.com> on 2020/01/22 22:30:41 UTC

Tomcat 9.0.27 intermittent JVM crashing on libapr-1.so

Hello and greetings,

I'm running tomcat 9.0.27 using APR and OpenSSL and get intermittent crashes with the hs_err log always pointing that the problematic frame is libapr-1.so.

Our  machine details:
OS: CentOS Linux release 7.6.1810 (Core)
Java: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode)
APR based Apache Tomcat Native library [1.2.23] using APR version [1.4.8]
OpenSSL 1.0.2k-fips

On startup, I don't see any errors on APR/OpenSSL

22-Jan-2020 20:29:14.188 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded APR based Apache Tomcat Native library [1.2.23] using APR version [1.4.8].
22-Jan-2020 20:29:14.188 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].
22-Jan-2020 20:29:14.188 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [true], useOpenSSL [true]
22-Jan-2020 20:29:14.190 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.0.2k-fips  26 Jan 2017]
22-Jan-2020 20:29:14.374 INFO [main] org.apache.coyote.http11.AbstractHttp11Protocol.configureUpgradeProtocol The ["https-openssl-apr-443"] connector has been configured to support negotiation to [h2] via ALPN

And our connector configuration

        <Connector port="443" protocol="org.apache.coyote.http11.Http11AprProtocol" maxThreads="150"
            SSLEnabled="true" scheme="https" secure="true"
            defaultSSLHostConfigName="redacted">

            <UpgradeProtocol className="org.apache.coyote.http2.Http2Protocol"/>
            <SSLHostConfig hostName="redacted">
                <Certificate certificateKeyFile="our.key"
                    certificateFile="our.crt"
                    certificateChainFile="our.ca-bundle"
                    certificateKeyPassword="ourPSK type="RSA"/>
            </SSLHostConfig>

Has anyone experienced the same issue? The issue is hard to reproduce but we get at least one crash a month.

Warm regards,

Norbert Elbanbuena


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat 9.0.27 intermittent JVM crashing on libapr-1.so

Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Norbert,

On 1/23/20 11:17 AM, Norbert Elbanbuena wrote:
> Thank you I will update and observe, interesting that the crash
> only happens on this machine, we have 3 other machines with the
> same setup which I don't see the crashes.

Can you please post both the native and Java stack traces?

- -chris

> -----Original Message----- From: Michael Osipov
> <mi...@apache.org> Sent: Thursday, January 23, 2020 1:52 AM To:
> Tomcat Users List <us...@tomcat.apache.org> Subject: Re: Tomcat
> 9.0.27 intermittent JVM crashing on libapr-1.so
> 
> Am 2020-01-22 um 23:30 schrieb Norbert Elbanbuena:
>> Hello and greetings,
>> 
>> I'm running tomcat 9.0.27 using APR and OpenSSL and get
>> intermittent crashes with the hs_err log always pointing that the
>> problematic frame is libapr-1.so.
>> 
>> Our  machine details: OS: CentOS Linux release 7.6.1810 (Core) 
>> Java: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode) APR
>>  based Apache Tomcat Native library [1.2.23] using APR version
>> [1.4.8] OpenSSL 1.0.2k-fips
>> 
>> On startup, I don't see any errors on APR/OpenSSL
>> 
>> 22-Jan-2020 20:29:14.188 INFO [main]
>> org.apache.catalina.core.AprLifecycleListener.lifecycleEvent
>> Loaded APR based Apache Tomcat Native library [1.2.23] using APR
>> version [1.4.8].
> 
> You should first upgrade your APR version to at least 1.6.x.
> 
> ---------------------------------------------------------------------
>
> 
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
> 
> 
> ---------------------------------------------------------------------
>
> 
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
> 
-----BEGIN PGP SIGNATURE-----
Comment: Using GnuPG with Thunderbird - https://www.enigmail.net/

iQIzBAEBCAAdFiEEMmKgYcQvxMe7tcJcHPApP6U8pFgFAl4rA24ACgkQHPApP6U8
pFhkBxAAuvxL1Wsdo/1Ni9svUBxx+gXSCPCRok/Z84r8L3NLQSUMZT8kbM0QK66f
pHi/bdUIuZyuYhUpXLbQHR50FhQ4gNOxqS1jf9ezIlzcXLEDBAYOm2MGcKB9kzkg
sDh4GMv4PeR0/XXhz4zEf3I516Rp2vXEos6in6AI1lspVuDrafULWHNmMT5d0s3E
WA48KkmaURVGURjoIEJaiMBlKqpaI2FZbIGDuJLn6344lc2MozVsbi8slelU60hf
fRLDQefTlR4QXbNmMduz0xoRlgrtkVjhB8sHMCyHUYxqRLHu+jAjL0HWXP/GcJE6
SO7k/5X5j+TepWBpzBbiT9G6Gb2BzzHQzPEwawKOtaUpAMHidatnO1mhuR17E5c4
qUk9h82sSsl6MkA7+lIschkCJQchFbbhja2Qy5Hko+/tyB52dHaerVKkrCXdv/qC
yy4GIXpjj57JGfV3m0wIZWOOigscpTjfTXRTX0P5lUXffv64kdRk+NshIi7pT0E+
8f3G4gSEpVJFRXTM9NMlnY+z74sEDtA622bmA5JfjJCxqgFt8J7GLfwjx2IFiYt7
3U3DJyewSMWUH+hnf0wMAc6rlSgBesyJ66wA8/RlVdzxYu5dxejcIJMejGkR1hUz
NtTiLL0jaBRegTM2ncMWqEpdZyr0s4GsN2UVcHR1M3oDR4owZFU=
=uRPb
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


RE: Tomcat 9.0.27 intermittent JVM crashing on libapr-1.so

Posted by Norbert Elbanbuena <no...@teligentip.com>.
Hi  Michael,

Thank you I will update and observe, interesting that the crash only happens on this machine, we have 3 other machines with the same setup which I  don't see the crashes. 


Warm regards,

Norbert Elbanbuena

-----Original Message-----
From: Michael Osipov <mi...@apache.org> 
Sent: Thursday, January 23, 2020 1:52 AM
To: Tomcat Users List <us...@tomcat.apache.org>
Subject: Re: Tomcat 9.0.27 intermittent JVM crashing on libapr-1.so

Am 2020-01-22 um 23:30 schrieb Norbert Elbanbuena:
> Hello and greetings,
> 
> I'm running tomcat 9.0.27 using APR and OpenSSL and get intermittent crashes with the hs_err log always pointing that the problematic frame is libapr-1.so.
> 
> Our  machine details:
> OS: CentOS Linux release 7.6.1810 (Core)
> Java: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode) APR 
> based Apache Tomcat Native library [1.2.23] using APR version [1.4.8] 
> OpenSSL 1.0.2k-fips
> 
> On startup, I don't see any errors on APR/OpenSSL
> 
> 22-Jan-2020 20:29:14.188 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded APR based Apache Tomcat Native library [1.2.23] using APR version [1.4.8].

You should first upgrade your APR version to at least 1.6.x.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat 9.0.27 intermittent JVM crashing on libapr-1.so

Posted by Michael Osipov <mi...@apache.org>.
Am 2020-01-22 um 23:30 schrieb Norbert Elbanbuena:
> Hello and greetings,
> 
> I'm running tomcat 9.0.27 using APR and OpenSSL and get intermittent crashes with the hs_err log always pointing that the problematic frame is libapr-1.so.
> 
> Our  machine details:
> OS: CentOS Linux release 7.6.1810 (Core)
> Java: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode)
> APR based Apache Tomcat Native library [1.2.23] using APR version [1.4.8]
> OpenSSL 1.0.2k-fips
> 
> On startup, I don't see any errors on APR/OpenSSL
> 
> 22-Jan-2020 20:29:14.188 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded APR based Apache Tomcat Native library [1.2.23] using APR version [1.4.8].

You should first upgrade your APR version to at least 1.6.x.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org