You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Chao Sun (JIRA)" <ji...@apache.org> on 2017/02/28 19:59:45 UTC

[jira] [Created] (HIVE-16060) GenericUDTFJSONTuple's HashCache could overgrown

Chao Sun created HIVE-16060:
-------------------------------

             Summary: GenericUDTFJSONTuple's HashCache could overgrown 
                 Key: HIVE-16060
                 URL: https://issues.apache.org/jira/browse/HIVE-16060
             Project: Hive
          Issue Type: Bug
          Components: UDF
            Reporter: Chao Sun
            Assignee: Chao Sun


At the moment the [cache object|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFJSONTuple.java#L96] used in {{GenericUDTFJSONTuple}} is a static linked hashmap that is not thread-safe. In the case of HoS it may be accessed concurrently and has race conditions. In particular, its size may overgrow even though the limit is 32. This can be observed from the attached image.

An easy way to fix it is to make it non-static.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)