You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Zsolt Fekete (JIRA)" <ji...@apache.org> on 2017/05/19 16:19:04 UTC

[jira] [Work started] (HIVE-16719) HiveMetaTool fails when the data does not fit in memory

     [ https://issues.apache.org/jira/browse/HIVE-16719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on HIVE-16719 started by Zsolt Fekete.
-------------------------------------------
> HiveMetaTool fails when the data does not fit in memory
> -------------------------------------------------------
>
>                 Key: HIVE-16719
>                 URL: https://issues.apache.org/jira/browse/HIVE-16719
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>            Reporter: Zsolt Fekete
>            Assignee: Zsolt Fekete
>
> Currently HiveMetaTool reads full tables (as DataNucleus entities) into memory by calling PersistenceManager's retrieveAll(). 
> See these methods of ObjectStore: updateMDatabaseURI, updateTblPropURI, updateMStorageDescriptorTblPropURI, updateMStorageDescriptorTblURI, updateSerdeURI.
> This might cause failure when the affected tables (SDS, DBS, TABLE_PARAMS, SD_PARAMS, SERDES, SERDE_PARAMS) are too big.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)