You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Vladimir Sitnikov (Jira)" <ji...@apache.org> on 2021/02/05 17:31:00 UTC
[jira] [Commented] (CALCITE-4489) Avatica JdbcMeta statement IDs
Concurrency problem
[ https://issues.apache.org/jira/browse/CALCITE-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17279841#comment-17279841 ]
Vladimir Sitnikov commented on CALCITE-4489:
--------------------------------------------
{quote} We believe that the cause of the problem is unsynchronized increment of connection.statementCount{quote}
The counter looks like a per-connection counter, so it should not be a problem provided you do not share connections between the concurrently executing threads.
AFAIK Connection is not thread-safe.
> Avatica JdbcMeta statement IDs Concurrency problem
> --------------------------------------------------
>
> Key: CALCITE-4489
> URL: https://issues.apache.org/jira/browse/CALCITE-4489
> Project: Calcite
> Issue Type: Bug
> Components: core
> Affects Versions: 1.26.0
> Reporter: Vlad Skarzhevskyy
> Priority: Major
> Attachments: stak-trace.txt
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> We encountered the JdbcMeta statement IDs concurrency problems that lead to errors pulling the data from avatica JDBC remote http server under heavy load.
> The error stack trace for the error is attached.
>
> Our setup: Avatica JDBC remote http server handled by Calcite on the server side.
> For the record we had not been able to reproduce the same problems with Avatica, only remote proxy connected directly to DB.
>
> We believe that the cause of the problem is unsynchronized increment of connection.statementCount
> see MetaImpl.createStatement
> [https://github.com/apache/calcite-avatica/blob/master/core/src/main/java/org/apache/calcite/avatica/MetaImpl.java#L213]
> {code:java}
> public StatementHandle createStatement(ConnectionHandle ch) {
> return new StatementHandle(ch.id, connection.statementCount++, null);
> }{code}
> Suggested fix is to use AtomicInteger for statementCount.
> Our stress tests show that the problem is resolved by the fix..
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)