You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Kiran Badi <ki...@poonam.org> on 2018/05/15 21:58:05 UTC

Amazon EC2 Tomcat 7.0.85 not starting up due to some memory issue

Hi All,

For some reason my application hosted on ec2 is just not starting up. I
know I never had any memory issues in last 1 year or so.

I see below trace in catalina.out file. I am not sure if I need to add swap
space or file permission is an issue here. Something changed in ec2 that is
causing this error.I think they auto updated the tomcat version as well
from 7.0.82 to 7.0.85.

I seriously need some suggestions. I also need some suggestion as how to
prevent bots from trying to access manager app.

May 14, 2018 8:44:46 PM org.apache.catalina.realm.LockOutRealm
filterLockedAccounts
WARNING: An attempt was made to authenticate the locked user "admin"
May 14, 2018 8:44:46 PM org.apache.catalina.realm.LockOutRealm
filterLockedAccounts
WARNING: An attempt was made to authenticate the locked user "admin"
May 14, 2018 8:44:47 PM org.apache.catalina.realm.LockOutRealm
filterLockedAccounts
WARNING: An attempt was made to authenticate the locked user "admin"
May 14, 2018 8:44:47 PM org.apache.catalina.realm.LockOutRealm
filterLockedAccounts
WARNING: An attempt was made to authenticate the locked user "admin"
May 14, 2018 8:44:47 PM org.apache.catalina.realm.LockOutRealm
filterLockedAccounts
WARNING: An attempt was made to authenticate the locked user "admin"
java.util.logging.ErrorManager: 4
java.io.FileNotFoundException:
/usr/share/tomcat7/logs/catalina.2018-05-15.log (Permission denied)
    at java.io.FileOutputStream.open0(Native Method)
    at java.io.FileOutputStream.open(FileOutputStream.java:270)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
    at org.apache.juli.FileHandler.openWriter(FileHandler.java:498)
    at org.apache.juli.FileHandler.publish(FileHandler.java:272)
    at java.util.logging.Logger.log(Logger.java:738)
    at java.util.logging.Logger.doLog(Logger.java:765)
    at java.util.logging.Logger.logp(Logger.java:1042)
    at org.apache.juli.logging.DirectJDKLog.log(DirectJDKLog.java:185)
    at org.apache.juli.logging.DirectJDKLog.error(DirectJDKLog.java:151)
    at
org.apache.catalina.valves.AccessLogValve.open(AccessLogValve.java:1220)
    at
org.apache.catalina.valves.AccessLogValve.rotate(AccessLogValve.java:1015)
    at
org.apache.catalina.valves.AccessLogValve.log(AccessLogValve.java:1155)
    at
org.apache.catalina.valves.AccessLogValve.log(AccessLogValve.java:991)
    at
org.apache.catalina.core.AccessLogAdapter.log(AccessLogAdapter.java:51)
    at
org.apache.catalina.core.ContainerBase.logAccess(ContainerBase.java:1386)
    at
org.apache.catalina.core.ContainerBase.logAccess(ContainerBase.java:1393)
    at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:490)
    at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1115)
    at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
    at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
    at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    at java.lang.Thread.run(Thread.java:748)
May 15, 2018 12:15:03 AM org.apache.catalina.valves.AccessLogValve open
SEVERE: Failed to open access log file
[/usr/share/tomcat7/logs/localhost_access_log.2018-05-15.txt]
java.io.FileNotFoundException:
/usr/share/tomcat7/logs/localhost_access_log.2018-05-15.txt (Permission
denied)
    at java.io.FileOutputStream.open0(Native Method)
    at java.io.FileOutputStream.open(FileOutputStream.java:270)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
    at
org.apache.catalina.valves.AccessLogValve.open(AccessLogValve.java:1212)
    at
org.apache.catalina.valves.AccessLogValve.rotate(AccessLogValve.java:1015)
    at
org.apache.catalina.valves.AccessLogValve.log(AccessLogValve.java:1155)
    at
org.apache.catalina.valves.AccessLogValve.log(AccessLogValve.java:991)
    at
org.apache.catalina.core.AccessLogAdapter.log(AccessLogAdapter.java:51)
    at
org.apache.catalina.core.ContainerBase.logAccess(ContainerBase.java:1386)
    at
org.apache.catalina.core.ContainerBase.logAccess(ContainerBase.java:1393)
    at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:490)
    at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1115)
    at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
    at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
    at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    at java.lang.Thread.run(Thread.java:748)

Java HotSpot(TM) 64-Bit Server VM warning: INFO:
os::commit_memory(0x00007f48f29d0000, 65536, 1) failed; error='Cannot
allocate memory' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 65536 bytes for committing
reserved memory.
# An error report file with more information is saved as:
# /usr/share/tomcat7/hs_err_pid23773.log
#
# Compiler replay data is saved as:

Re: Amazon EC2 Tomcat 7.0.85 not starting up due to some memory issue

Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Kiran,

On 5/15/18 5:58 PM, Kiran Badi wrote:
> For some reason my application hosted on ec2 is just not starting
> up. I know I never had any memory issues in last 1 year or so.
> 
> I see below trace in catalina.out file. I am not sure if I need to
> add swap space or file permission is an issue here. Something
> changed in ec2 that is causing this error.I think they auto updated
> the tomcat version as well from 7.0.82 to 7.0.85.
> 
> I seriously need some suggestions. I also need some suggestion as
> how to prevent bots from trying to access manager app.
> 
> May 14, 2018 8:44:46 PM org.apache.catalina.realm.LockOutRealm 
> filterLockedAccounts WARNING: An attempt was made to authenticate
> the locked user "admin"

It sure looks like Tomcat has started, since it is processing
requests. Are you sure it's not starting?

> java.util.logging.ErrorManager: 4 java.io.FileNotFoundException: 
> /usr/share/tomcat7/logs/catalina.2018-05-15.log (Permission
> denied) at java.io.FileOutputStream.open0(Native Method)

Obviously this is not memory-related. Did you intend to report this as
a part of your problem?
> Java HotSpot(TM) 64-Bit Server VM warning: INFO: 
> os::commit_memory(0x00007f48f29d0000, 65536, 1) failed;
> error='Cannot allocate memory' (errno=12) # # There is insufficient
> memory for the Java Runtime Environment to continue. # Native
> memory allocation (mmap) failed to map 65536 bytes for committing 
> reserved memory. # An error report file with more information is
> saved as: # /usr/share/tomcat7/hs_err_pid23773.log # # Compiler
> replay data is saved as:
> 

The Java stack trace might be helpful, as would the native stack trace.

What are your memory-related JVM launch parameters? What JVM are you
using (version, architecture)?

Odd that allocating 64kib should fail...

- -chris
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQIzBAEBCAAdFiEEMmKgYcQvxMe7tcJcHPApP6U8pFgFAlr8Sa0ACgkQHPApP6U8
pFiBZg/+JmjmrlDUZuzoleg1ypwrxM51NSCCUPxLCxy/tI2UZF2MgRUwDZU3tdXX
iHJsfwZ83bCt8m9eFBVy/4jWUQNjlDK+ahDBTOeqJvDkaNtdYLiLRBMqegtXF9JT
cyt2nQdsetKx+rsI5HGytXBX6OuzJCSAw+bVHzzq2KFiOe4gnyqItsLg8TyXM+50
giB0WlIBldyqj+kD9S8hRwqTTIXkAg4H+tI8+piBKKAojfLpuZB3qGhXhTncEMBA
LL8Udbrz08vU3gXMg5U07pUHc/Vkn8U1axgcn4U3lQ0flKHRkBeabp/wVZ6a1Cuj
a918715HRqZPezqEYoEYJjyUHV13c07T1nKFcLfR97VhFx1WjuTEGuHFriYjsPXN
Qo0J6ej4+z0JItQVJ3w3qxijU9Vt0kEJq53raeclqNgdxhaVvLDDrPOxwZWvT9vz
1FiIyylRTNlC0tEAV3osQ9MFhf4eUgLGPGbEN69U+pEJ4Y2WgTlioKsueVDZcNrs
czS6x0sR1Rd1waYQbnIXNpzIngQNAsnrw9cX73FSTmRVT3VGNdtlIFYzQ9aIl3UX
3cuLlqyumLySIV6BjORu6TgqGefSw+KYOJagTWo6IuExzLeU1vYs4V/ZVGt5qHQO
kKLJmRaQozQ4u+ajMR9Lp5ESsLtjs+TPWy5tu4cQr6SE9PzL1fo=
=Bm4c
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org