You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Satish Duggana (JIRA)" <ji...@apache.org> on 2017/03/22 03:26:41 UTC

[jira] [Updated] (STORM-2425) Storm Hive Bolt not closing open transactions

     [ https://issues.apache.org/jira/browse/STORM-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Satish Duggana updated STORM-2425:
----------------------------------
    Fix Version/s: 1.x
                   2.0.0

> Storm Hive Bolt not closing open transactions
> ---------------------------------------------
>
>                 Key: STORM-2425
>                 URL: https://issues.apache.org/jira/browse/STORM-2425
>             Project: Apache Storm
>          Issue Type: Bug
>    Affects Versions: 2.0.0, 1.x
>            Reporter: Arun Mahadevan
>            Assignee: Arun Mahadevan
>             Fix For: 2.0.0, 1.x
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Hive bolt will close connection only if parameter "max_connections" is exceeded or bolt dies. So if we open a connection to Hive via Hive bolt and some time later we stop producing messages to Hive bolt, connection will be maintained and corresponding transactions will be opened. This can be a problem if we launch two topologies and one of them will maintain open transactions doing nothing, and other will work writing messages to hive. At some point hive will launch compactions to collapse small delta files generated by Hive Bolt into one base file. But compaction wont launch if we have opened transactions.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)