You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2015/03/26 00:23:52 UTC

[jira] [Created] (HIVE-10094) Investigate static cache instance used in SplitGrouper

Siddharth Seth created HIVE-10094:
-------------------------------------

             Summary: Investigate static cache instance used in SplitGrouper
                 Key: HIVE-10094
                 URL: https://issues.apache.org/jira/browse/HIVE-10094
             Project: Hive
          Issue Type: Task
    Affects Versions: 1.0.0
            Reporter: Siddharth Seth


{code}
private static final Map<Map<String, PartitionDesc>, Map<String, PartitionDesc>> cache =
      new HashMap<>();
{code}

Used by HiveFileFormatUtils.getPartitionDescFromPathRecursively(work.getPathToPartitionInfo(), path, cache);

Split generation happens in parallel - so this isn't thread safe. HIVE-9976 moves it to a concurrent map.

Beyond this, a cache of Map to Map seems a little strange. Investigate whether this is working as intended.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)