You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Ben Gladstone <bg...@gmail.com> on 2011/11/16 20:07:16 UTC
Database connection causes slow startup
Hey all,
I'm running Tomcat 6.0.33, Java 1.6.0_29, and Ubuntu 11.10 64-bit (kernel
3.0.0-12). I'm using Tomcat to connect to 2 databases, defined in my
conf/server.xml file. Before I added these data sources, Tomcat started up
quickly. Now, it takes around 7 minutes to start. It still connects to the
databases, and once it's connected it runs quickly, but it takes quite a
while to connect. Am I doing something wrong? I've attached my server.xml,
context.xml, and catalina.out. Thanks for your help!
Ben
Re: Database connection causes slow startup
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Ben,
On 11/17/11 1:41 PM, Ben Gladstone wrote:
> Thanks for your help. I solved the problem. It turns out the
> problem was in that fastConnectionFailover option. I disabled that,
> and it now starts up in 46 seconds.
But now they won't fail-over fast! ;)
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk7Fa3wACgkQ9CaO5/Lv0PA+LwCdHyp5PHno16IHaLkNg5alsD8n
YmoAoJcBU+XuanyGQFcoMv8wLLygq+So
=sVq4
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: Database connection causes slow startup
Posted by Ben Gladstone <bg...@gmail.com>.
Thanks for your help. I solved the problem. It turns out the problem was in
that fastConnectionFailover option. I disabled that, and it now starts up
in 46 seconds.
On Wed, Nov 16, 2011 at 2:23 PM, Christopher Schultz <
chris@christopherschultz.net> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Ben,
>
> On 11/16/11 2:44 PM, Ben Gladstone wrote:
> > <Resource name="jdbc/PortalDb" auth="Container"
> > type="oracle.jdbc.pool.OracleDataSource"
> > connectionCachingEnabled="true" description="FCF Datasource"
> > driverClassName="oracle.jdbc.OracleDriver"
> > factory="oracle.jdbc.pool.OracleDataSourceFactory"
> > fastConnectionFailoverEnabled="true" onsConfigStr="nodes=PRIVATE"
> >
> > implicitCachingEnabled="true"
> > connectionCacheProperties="(InitialLimit=10, MinLimit=10,
> > MaxLimit=150, ConnectionWaitTimeout=40,
> > AbandonedConnectionTimeout=40, TimeToLiveTimeout=90)"
> > connectionCacheName="portal_connection_pool" user="PRIVATE"
> > password="PRIVATE" url="jdbc:oracle:thin:@
> >
> (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=PRIVATE)(PORT=1521))(LOAD_BALANCE=yes)(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=PRIVATE))"
> >
> >
> />
>
> Note that you are not using Tomcat's connection pooling: you are using
> Oracle's connection pooling because you specified the "factory"
> attribute and told Oracle to create DataSource objects for you.
>
> Try setting type="javax.sql.DataSource" and removing the "factory"
> attribute to use Tomcat's connection pool (which is commons-dbcp).
>
> If Tomcat takes 7 minutes to start up, that sounds like plenty of time
> to take a thread dump to see what's going on.
>
> - -chris
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
> Comment: GPGTools - http://gpgtools.org
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAk7EN+sACgkQ9CaO5/Lv0PBIKQCfXNOu9MyIbT4LTkXm2QxE4Vz3
> NO8AmwZgLbVKc8vHyKCsqvK1mhIp/GNC
> =FhEO
> -----END PGP SIGNATURE-----
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
Re: Database connection causes slow startup
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Ben,
On 11/16/11 2:44 PM, Ben Gladstone wrote:
> <Resource name="jdbc/PortalDb" auth="Container"
> type="oracle.jdbc.pool.OracleDataSource"
> connectionCachingEnabled="true" description="FCF Datasource"
> driverClassName="oracle.jdbc.OracleDriver"
> factory="oracle.jdbc.pool.OracleDataSourceFactory"
> fastConnectionFailoverEnabled="true" onsConfigStr="nodes=PRIVATE"
>
> implicitCachingEnabled="true"
> connectionCacheProperties="(InitialLimit=10, MinLimit=10,
> MaxLimit=150, ConnectionWaitTimeout=40,
> AbandonedConnectionTimeout=40, TimeToLiveTimeout=90)"
> connectionCacheName="portal_connection_pool" user="PRIVATE"
> password="PRIVATE" url="jdbc:oracle:thin:@
> (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=PRIVATE)(PORT=1521))(LOAD_BALANCE=yes)(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=PRIVATE))"
>
>
/>
Note that you are not using Tomcat's connection pooling: you are using
Oracle's connection pooling because you specified the "factory"
attribute and told Oracle to create DataSource objects for you.
Try setting type="javax.sql.DataSource" and removing the "factory"
attribute to use Tomcat's connection pool (which is commons-dbcp).
If Tomcat takes 7 minutes to start up, that sounds like plenty of time
to take a thread dump to see what's going on.
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk7EN+sACgkQ9CaO5/Lv0PBIKQCfXNOu9MyIbT4LTkXm2QxE4Vz3
NO8AmwZgLbVKc8vHyKCsqvK1mhIp/GNC
=FhEO
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: Database connection causes slow startup
Posted by Daniel Mikusa <dm...@vmware.com>.
> <Resource name="jdbc/PortalDb" auth="Container"
> type="oracle.jdbc.pool.OracleDataSource"
> connectionCachingEnabled="true"
> description="FCF Datasource"
> driverClassName="oracle.jdbc.OracleDriver"
> factory="oracle.jdbc.pool.OracleDataSourceFactory"
> fastConnectionFailoverEnabled="true"
> onsConfigStr="nodes=PRIVATE"
>
> implicitCachingEnabled="true"
> connectionCacheProperties="(InitialLimit=10, MinLimit=10,
> MaxLimit=150, ConnectionWaitTimeout=40, AbandonedConnectionTimeout=40,
> TimeToLiveTimeout=90)"
> connectionCacheName="portal_connection_pool"
> user="PRIVATE" password="PRIVATE"
> url="jdbc:oracle:thin:@
> (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=PRIVATE)(PORT=1521))(LOAD_BALANCE=yes)(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=PRIVATE))"
> />
>
> <Resource name="jdbc/WarehouseDB" auth="Container"
> type="oracle.jdbc.pool.OracleDataSource"
> driverClassName="oracle.jdbc.OracleDriver"
> factory="oracle.jdbc.pool.OracleDataSourceFactory"
> connectionCachingEnabled="true"
> implicitCachingEnabled="true"
> connectionCacheProperties="(InitialLimit=3, MinLimit=3,
> MaxLimit=100, ConnectionWaitTimeout=40, AbandonedConnectionTimeout=40,
> TimeToLiveTimeout=90)"
> connectionCacheName="warehouse_connection_pool"
> user="PRIVATE" password="PRIVATE"
> url="jdbc:oracle:thin:@PRIVATE:1521:PRIVATE"
> />
I see an initial limit of 10 for the first DataSource and 3 for the
second DataSource. That seems like it should happen pretty quick.
A couple thoughts...
1.) Do you have any applications deployed to the server? If so, perhaps
it is an application which is causing the startup to take so long. Have
you tried starting Tomcat without any applications deployed? If so, how
long does it take to startup?
2.) Try making a test connection to your database outside of Tomcat from
the same machine. Does the connection take a long time to setup?
Dan
Re: Database connection causes slow startup
Posted by Ben Gladstone <bg...@gmail.com>.
If I'm not mistaken, the data sources are defined in server.xml.
Let's try this again. Here's server.xml:
<?xml version='1.0' encoding='utf-8'?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<!-- Note: A "Server" is not itself a "Container", so you may not
define subcomponents such as "Valves" at this level.
Documentation at /docs/config/server.html
-->
<Server port="8005" shutdown="SHUTDOWN">
<!--APR library loader. Documentation at /docs/apr.html -->
<Listener className="org.apache.catalina.core.AprLifecycleListener"
SSLEngine="on" />
<!--Initialize Jasper prior to webapps are loaded. Documentation at
/docs/jasper-howto.html -->
<Listener className="org.apache.catalina.core.JasperListener" />
<!-- Prevent memory leaks due to use of particular java/javax APIs-->
<Listener
className="org.apache.catalina.core.JreMemoryLeakPreventionListener" />
<!-- JMX Support for the Tomcat server. Documentation at
/docs/non-existent.html -->
<Listener className="org.apache.catalina.mbeans.ServerLifecycleListener"
/>
<Listener
className="org.apache.catalina.mbeans.GlobalResourcesLifecycleListener" />
<!-- Global JNDI resources
Documentation at /docs/jndi-resources-howto.html
-->
<GlobalNamingResources>
<!-- Editable user database that can also be used by
UserDatabaseRealm to authenticate users
-->
<Resource name="UserDatabase" auth="Container"
type="org.apache.catalina.UserDatabase"
description="User database that can be updated and saved"
factory="org.apache.catalina.users.MemoryUserDatabaseFactory"
pathname="conf/tomcat-users.xml" />
<Resource name="jdbc/PortalDb" auth="Container"
type="oracle.jdbc.pool.OracleDataSource"
connectionCachingEnabled="true"
description="FCF Datasource"
driverClassName="oracle.jdbc.OracleDriver"
factory="oracle.jdbc.pool.OracleDataSourceFactory"
fastConnectionFailoverEnabled="true"
onsConfigStr="nodes=PRIVATE"
implicitCachingEnabled="true"
connectionCacheProperties="(InitialLimit=10, MinLimit=10,
MaxLimit=150, ConnectionWaitTimeout=40, AbandonedConnectionTimeout=40,
TimeToLiveTimeout=90)"
connectionCacheName="portal_connection_pool"
user="PRIVATE" password="PRIVATE"
url="jdbc:oracle:thin:@
(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=PRIVATE)(PORT=1521))(LOAD_BALANCE=yes)(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=PRIVATE))"
/>
<Resource name="jdbc/WarehouseDB" auth="Container"
type="oracle.jdbc.pool.OracleDataSource"
driverClassName="oracle.jdbc.OracleDriver"
factory="oracle.jdbc.pool.OracleDataSourceFactory"
connectionCachingEnabled="true"
implicitCachingEnabled="true"
connectionCacheProperties="(InitialLimit=3, MinLimit=3,
MaxLimit=100, ConnectionWaitTimeout=40, AbandonedConnectionTimeout=40,
TimeToLiveTimeout=90)"
connectionCacheName="warehouse_connection_pool"
user="PRIVATE" password="PRIVATE"
url="jdbc:oracle:thin:@PRIVATE:1521:PRIVATE"
/>
</GlobalNamingResources>
<!-- A "Service" is a collection of one or more "Connectors" that share
a single "Container" Note: A "Service" is not itself a "Container",
so you may not define subcomponents such as "Valves" at this level.
Documentation at /docs/config/service.html
-->
<Service name="Catalina">
<!--The connectors can use a shared executor, you can define one or
more named thread pools-->
<!--
<Executor name="tomcatThreadPool" namePrefix="catalina-exec-"
maxThreads="150" minSpareThreads="4"/>
-->
<!-- A "Connector" represents an endpoint by which requests are received
and responses are returned. Documentation at :
Java HTTP Connector: /docs/config/http.html (blocking &
non-blocking)
Java AJP Connector: /docs/config/ajp.html
APR (HTTP/AJP) Connector: /docs/apr.html
Define a non-SSL HTTP/1.1 Connector on port 8080
-->
<Connector port="8080" protocol="HTTP/1.1"
connectionTimeout="20000"
redirectPort="8443" />
<!-- A "Connector" using the shared thread pool-->
<!--
<Connector executor="tomcatThreadPool"
port="8080" protocol="HTTP/1.1"
connectionTimeout="20000"
redirectPort="8443" />
-->
<!-- Define a SSL HTTP/1.1 Connector on port 8443
This connector uses the JSSE configuration, when using APR, the
connector should be using the OpenSSL style configuration
described in the APR documentation -->
<!--
<Connector port="8443" protocol="HTTP/1.1" SSLEnabled="true"
maxThreads="150" scheme="https" secure="true"
clientAuth="false" sslProtocol="TLS" />
-->
<!-- Define an AJP 1.3 Connector on port 8009 -->
<Connector port="8009" protocol="AJP/1.3" redirectPort="8443" />
<!-- An Engine represents the entry point (within Catalina) that
processes
every request. The Engine implementation for Tomcat stand alone
analyzes the HTTP headers included with the request, and passes
them
on to the appropriate Host (virtual host).
Documentation at /docs/config/engine.html -->
<!-- You should set jvmRoute to support load-balancing via AJP ie :
<Engine name="Catalina" defaultHost="localhost"
jvmRoute="jvm1">
-->
<Engine name="Catalina" defaultHost="localhost">
<!--For clustering, please take a look at documentation at:
/docs/cluster-howto.html (simple how to)
/docs/config/cluster.html (reference documentation) -->
<!--
<Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"/>
-->
<!-- The request dumper valve dumps useful debugging information about
the request and response data received and sent by Tomcat.
Documentation at: /docs/config/valve.html -->
<!--
<Valve className="org.apache.catalina.valves.RequestDumperValve"/>
-->
<!-- This Realm uses the UserDatabase configured in the global JNDI
resources under the key "UserDatabase". Any edits
that are performed against this UserDatabase are immediately
available for use by the Realm. -->
<Realm className="org.apache.catalina.realm.UserDatabaseRealm"
resourceName="UserDatabase"/>
<!-- Define the default virtual host
Note: XML Schema validation will not work with Xerces 2.2.
-->
<Host name="localhost" appBase="webapps"
unpackWARs="true" autoDeploy="true"
xmlValidation="false" xmlNamespaceAware="false">
<!-- SingleSignOn valve, share authentication between web
applications
Documentation at: /docs/config/valve.html -->
<!--
<Valve className="org.apache.catalina.authenticator.SingleSignOn" />
-->
<!-- Access log processes all example.
Documentation at: /docs/config/valve.html -->
<!--
<Valve className="org.apache.catalina.valves.AccessLogValve"
directory="logs"
prefix="localhost_access_log." suffix=".txt"
pattern="common" resolveHosts="false"/>
-->
</Host>
</Engine>
</Service>
</Server>
Here's context.xml:
<?xml version='1.0' encoding='utf-8'?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<!-- The contents of this file will be loaded for each web application -->
<Context>
<!-- Default set of monitored resources -->
<WatchedResource>WEB-INF/web.xml</WatchedResource>
<!-- Uncomment this to disable session persistence across Tomcat
restarts -->
<!--
<Manager pathname="" />
-->
<!-- Uncomment this to enable Comet connection tacking (provides events
on session expiration as well as webapp lifecycle) -->
<!--
<Valve
className="org.apache.catalina.valves.CometConnectionManagerValve" />
-->
<ResourceLink global="jdbc/PortalDb" name="jdbc/PortalDb"
type="oracle.jdbc.pool.OracleDataSource" />
<ResourceLink global="jdbc/WarehouseDB" name="jdbc/WarehouseDB"
type="oracle.jdbc.pool.OracleDataSource" />
</Context>
And catalina.out is huge, but the last line is:
INFO: Server startup in 423933 ms
On Wed, Nov 16, 2011 at 11:24 AM, Daniel Mikusa <dm...@vmware.com> wrote:
>
> On Wed, 2011-11-16 at 11:07 -0800, Ben Gladstone wrote:
>
> > I've attached my server.xml, context.xml, and catalina.out.
>
> I don't believe that you can attach files to the list. You'll need to
> copy and paste the information in your email.
>
> > Now, it takes around 7 minutes to start.
>
> This seems long, but it really depends on how many connections you've
> configured the pool to initially make and how long it takes to make each
> connection. Where are you defining your DataSources and what do the
> definitions look like?
>
> Dan
>
>
>
Re: Database connection causes slow startup
Posted by Daniel Mikusa <dm...@vmware.com>.
On Wed, 2011-11-16 at 11:07 -0800, Ben Gladstone wrote:
> I've attached my server.xml, context.xml, and catalina.out.
I don't believe that you can attach files to the list. You'll need to
copy and paste the information in your email.
> Now, it takes around 7 minutes to start.
This seems long, but it really depends on how many connections you've
configured the pool to initially make and how long it takes to make each
connection. Where are you defining your DataSources and what do the
definitions look like?
Dan