You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@storm.apache.org by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2017/03/20 09:05:41 UTC

[jira] [Created] (STORM-2425) Storm Hive Bolt not closing open transactions

Arun Mahadevan created STORM-2425:
-------------------------------------

             Summary: Storm Hive Bolt not closing open transactions
                 Key: STORM-2425
                 URL: https://issues.apache.org/jira/browse/STORM-2425
             Project: Apache Storm
          Issue Type: Bug
            Reporter: Arun Mahadevan
            Assignee: Arun Mahadevan


Hive bolt will close connection only if parameter "max_connections" is exceeded or bolt dies. So if we open a connection to Hive via Hive bolt and some time later we stop producing messages to Hive bolt, connection will be maintained and corresponding transactions will be opened. This can be a problem if we launch two topologies and one of them will maintain open transactions doing nothing, and other will work writing messages to hive. At some point hive will launch compactions to collapse small delta files generated by Hive Bolt into one base file. But compaction wont launch if we have opened transactions.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)