You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/01/23 11:35:00 UTC
[jira] [Updated] (HIVE-26976) Failure in direct SQL processing do not undo the changes made to database before fallback to JDO resulting in stale entries in database forever
[ https://issues.apache.org/jira/browse/HIVE-26976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HIVE-26976:
----------------------------------
Labels: pull-request-available (was: )
> Failure in direct SQL processing do not undo the changes made to database before fallback to JDO resulting in stale entries in database forever
> -----------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-26976
> URL: https://issues.apache.org/jira/browse/HIVE-26976
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Reporter: Venugopal Reddy K
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2023-01-23-15-23-00-975.png
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> *[Description]*
> Failure in direct SQL processing do not undo the changes made to database before falling back to JDO based processing. Thus results in stale/dangling entries in database forever.
> For instance, during dropPartitions() direct SQL processing, after dropping rows from few tables(like PARTITIONS, PARTITION_PARAMS, PARTITION_KEY_VALS etc), it causes typecast exception in dropStorageDescriptors() and fallback to JDO processing. But datanucleus JDO processing cannot delete rows from remaining tables(i.e., from sds, serdes, sds_params, serde_params, sort_cols, bucketing_cols, skewed cols/values/location if any for the partitions) since the partition is already in the same transaction during direct SQL processing.
> !image-2023-01-23-15-23-00-975.png!
>
>
> *[Steps to reproduce]*
> Reproduction steps are described in issue - [https://issues.apache.org/jira/browse/HIVE-26860|https://issues.apache.org/jira/browse/HIVE-26860]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)