You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Prasanth Jayachandran (JIRA)" <ji...@apache.org> on 2019/01/08 20:47:00 UTC

[jira] [Commented] (HIVE-21103) PartitionManagementTask should not modify DN configs to avoid closing persistence manager

    [ https://issues.apache.org/jira/browse/HIVE-21103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16737507#comment-16737507 ] 

Prasanth Jayachandran commented on HIVE-21103:
----------------------------------------------

Thanks [~sankarh] for finding for the root cause of this issue! Since you have more context on this issue can you please review this change? It just removes the DN config change in PartitionManagementTask

> PartitionManagementTask should not modify DN configs to avoid closing persistence manager
> -----------------------------------------------------------------------------------------
>
>                 Key: HIVE-21103
>                 URL: https://issues.apache.org/jira/browse/HIVE-21103
>             Project: Hive
>          Issue Type: Bug
>          Components: Standalone Metastore
>    Affects Versions: 4.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Critical
>         Attachments: HIVE-21103.1.patch
>
>
> HIVE-20707 added automatic partition management which uses thread pools to run parallel msck repair. It also modifies datanucleus connection pool size to avoid explosion of connections to backend database. But object store closes the persistence manager when it detects a change in datanuclues or jdo configs. So when PartitionManagementTask is running and when HS2 tries to connect to metastore HS2 will get persistence manager close exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)