You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Vihang Karajgaonkar (JIRA)" <ji...@apache.org> on 2018/03/24 00:37:00 UTC

[jira] [Created] (HIVE-19041) Thrift deserialization of Partition objects should intern fields

Vihang Karajgaonkar created HIVE-19041:
------------------------------------------

             Summary: Thrift deserialization of Partition objects should intern fields
                 Key: HIVE-19041
                 URL: https://issues.apache.org/jira/browse/HIVE-19041
             Project: Hive
          Issue Type: Improvement
          Components: Metastore
    Affects Versions: 2.3.2, 3.0.0
            Reporter: Vihang Karajgaonkar
            Assignee: Vihang Karajgaonkar


When a client is creating large number of partitions, the thrift objects are deserialized into Partition objects. The read method of these objects does not intern the inputformat, location, outputformat which cause large number of duplicate Strings in the HMS memory. We should intern these objects while deserialization to reduce memory pressure. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)