You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by sujitha chinnu <ch...@gmail.com> on 2016/05/11 10:00:32 UTC

hikiari pool failing

Hi,

I tried the example code of creating table and inserting the values to the
table using storm jdbc example code.

Here source code I'm using
 https://github.com/apache/storm/tree/master/external/storm-jdbc/src/test

code is working fine but when I increase the the parallelism of bolt above
11 or if I increase setNumtasks above 11 by keeping the bolt parallelism to
1,code is giving me run time exception.

*java.lang.RuntimeException: Fail-fast during pool initialization*
at com.zaxxer.hikari.pool.HikariPool.fillPool(HikariPool.java:475)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:159)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:112)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at com.zaxxer.hikari.HikariDataSource.<init>(HikariDataSource.java:78)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at Demo.ConnectionProvider.prepare(ConnectionProvider.java:26)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at Demo.AbstractJdbcBolt.prepare(AbstractJdbcBolt.java:24)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at Demo.PsqlBolt.prepare(PsqlBolt.java:76)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at
backtype.storm.daemon.executor$fn__6647$fn__6659.invoke(executor.clj:692)
~[storm-core-0.9.5.jar:0.9.5]
at backtype.storm.util$async_loop$fn__459.invoke(util.clj:461)
~[storm-core-0.9.5.jar:0.9.5]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
Caused by: org.postgresql.util.PSQLException:* FATAL: sorry, too many
clients already*
at org.postgresql.Driver$ConnectThread.getResult(Driver.java:361)
~[postgresql-9.3-1102-jdbc4.jar:na]
at org.postgresql.Driver.connect(Driver.java:284)
~[postgresql-9.3-1102-jdbc4.jar:na]
at java.sql.DriverManager.getConnection(DriverManager.java:664)
~[na:1.8.0_74]
at java.sql.DriverManager.getConnection(DriverManager.java:247)
~[na:1.8.0_74]
at
org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:99)
~[postgresql-9.3-1102-jdbc4.jar:na]
at
org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:82)
~[postgresql-9.3-1102-jdbc4.jar:na]
at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:398)
~[storm-streaming-1.0-SNAPSHOT.jar:na]
at com.zaxxer.hikari.pool.HikariPool.fillPool(HikariPool.java:474)
~[storm-streaming-1.0-SNAPSHOT.jar:na]

storm topology is taking all the max connections of db.

 can some one explain why storm is taking all the connections and throwing
run time exception.

Re: hikiari pool failing

Posted by Sai Dilip Reddy Kiralam <dk...@aadhya-analytics.com>.

Hi,

I'm also looking for answer to same question .



*Best regards,*

*K.Sai Dilip Reddy.*

On Wed, May 11, 2016 at 3:30 PM, sujitha chinnu <ch...@gmail.com>
wrote:

> Hi,
>
> I tried the example code of creating table and inserting the values to the
> table using storm jdbc example code.
>
> Here source code I'm using
>  https://github.com/apache/storm/tree/master/external/storm-jdbc/src/test
>
> code is working fine but when I increase the the parallelism of bolt above
> 11 or if I increase setNumtasks above 11 by keeping the bolt parallelism to
> 1,code is giving me run time exception.
>
> *java.lang.RuntimeException: Fail-fast during pool initialization*
> at com.zaxxer.hikari.pool.HikariPool.fillPool(HikariPool.java:475)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:159)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:112)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at com.zaxxer.hikari.HikariDataSource.<init>(HikariDataSource.java:78)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at Demo.ConnectionProvider.prepare(ConnectionProvider.java:26)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at Demo.AbstractJdbcBolt.prepare(AbstractJdbcBolt.java:24)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at Demo.PsqlBolt.prepare(PsqlBolt.java:76)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at
> backtype.storm.daemon.executor$fn__6647$fn__6659.invoke(executor.clj:692)
> ~[storm-core-0.9.5.jar:0.9.5]
> at backtype.storm.util$async_loop$fn__459.invoke(util.clj:461)
> ~[storm-core-0.9.5.jar:0.9.5]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
> Caused by: org.postgresql.util.PSQLException:* FATAL: sorry, too many
> clients already*
> at org.postgresql.Driver$ConnectThread.getResult(Driver.java:361)
> ~[postgresql-9.3-1102-jdbc4.jar:na]
> at org.postgresql.Driver.connect(Driver.java:284)
> ~[postgresql-9.3-1102-jdbc4.jar:na]
> at java.sql.DriverManager.getConnection(DriverManager.java:664)
> ~[na:1.8.0_74]
> at java.sql.DriverManager.getConnection(DriverManager.java:247)
> ~[na:1.8.0_74]
> at
> org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:99)
> ~[postgresql-9.3-1102-jdbc4.jar:na]
> at
> org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:82)
> ~[postgresql-9.3-1102-jdbc4.jar:na]
> at com.zaxxer.hikari.pool.HikariPool.addConnection(HikariPool.java:398)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
> at com.zaxxer.hikari.pool.HikariPool.fillPool(HikariPool.java:474)
> ~[storm-streaming-1.0-SNAPSHOT.jar:na]
>
> storm topology is taking all the max connections of db.
>
>  can some one explain why storm is taking all the connections and throwing
> run time exception.
>
>