You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Chao Sun (JIRA)" <ji...@apache.org> on 2017/02/28 19:59:45 UTC

[jira] [Updated] (HIVE-16060) GenericUDTFJSONTuple's json cache could overgrow beyond its limit

     [ https://issues.apache.org/jira/browse/HIVE-16060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chao Sun updated HIVE-16060:
----------------------------
    Summary: GenericUDTFJSONTuple's json cache could overgrow beyond its limit  (was: GenericUDTFJSONTuple's HashCache could overgrown )

> GenericUDTFJSONTuple's json cache could overgrow beyond its limit
> -----------------------------------------------------------------
>
>                 Key: HIVE-16060
>                 URL: https://issues.apache.org/jira/browse/HIVE-16060
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>            Reporter: Chao Sun
>            Assignee: Chao Sun
>
> At the moment the [cache object|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFJSONTuple.java#L96] used in {{GenericUDTFJSONTuple}} is a static linked hashmap that is not thread-safe. In the case of HoS it may be accessed concurrently and has race conditions. In particular, its size may overgrow even though the limit is 32. This can be observed from the attached image.
> An easy way to fix it is to make it non-static.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)