[jira] [Commented] (NIFI-5841) PutHive3Streaming processor Mem Leak

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737798#comment-16737798 ] 

ASF subversion and git services commented on NIFI-5841:
-------------------------------------------------------

Commit e6e4175d71d23157c152e7337e97fc45533b3869 in nifi's branch refs/heads/master from kei miyauchi
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=e6e4175 ]

NIFI-5841 Fix memory leak of PutHive3Streaming.

This closes #3249.

Signed-off-by: Koji Kawamura <ij...@apache.org>


> PutHive3Streaming processor Mem Leak
> ------------------------------------
>
>                 Key: NIFI-5841
>                 URL: https://issues.apache.org/jira/browse/NIFI-5841
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.8.0, 1.7.1
>         Environment: Hive 3.1.*
>            Reporter: Advith Nagappa
>            Priority: Major
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Nifi versions: 1,7.1 and 1.8.0
>  nifi/nifi-nar-bundles/nifi-hive-bundle/nifi-hive3-processors/src/main/java/org/apache/nifi/processors/hive/PutHive3Streaming.java**
>  , line 417 seems redundant,
> {code:java}
> ShutdownHookManager.addShutdownHook(hiveStreamingConnection::close, FileSystem.SHUTDOWN_HOOK_PRIORITY + 1){code}
>  
> Whereas Hive 3.0.0 did not add a shutdownhook within connect() method, Hive 3.1.* does:
>  hive/streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java
> {code:java}
> ShutdownHookManager.addShutdownHook(streamingConnection::close, FileSystem.SHUTDOWN_HOOK_PRIORITY + 1);{code}
> This creates two references to the shutdownhook object per transaction out of which only one is ever cleaned; resulting in a slow/fast degradation of heap space depending on the velocity of transactions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)