You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "mahesh kumar behera (Jira)" <ji...@apache.org> on 2022/07/11 09:42:00 UTC
[jira] [Assigned] (HIVE-26382) Stats generation fails during CTAS for external partitioned table.
[ https://issues.apache.org/jira/browse/HIVE-26382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
mahesh kumar behera reassigned HIVE-26382:
------------------------------------------
> Stats generation fails during CTAS for external partitioned table.
> ------------------------------------------------------------------
>
> Key: HIVE-26382
> URL: https://issues.apache.org/jira/browse/HIVE-26382
> Project: Hive
> Issue Type: Bug
> Components: Hive, HiveServer2
> Affects Versions: 4.0.0-alpha-1
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
>
> As part of HIVE-25990 manifest file was generated to list out the files to be moved. The files are moved in move task by referring to the manifest file. For partitioned table flow, the move is not done. This prevents the dynamic partition creation as the target path will be empty. As stats task needs the partition information, this causes the stat task to fail.
>
> {code:java}
> class="metastore.RetryingHMSHandler" level="ERROR" thread="pool-10-thread-144"] MetaException(message:Unable to update Column stats for ext_par due to: The IN list is empty!)
> org.apache.hadoop.hive.metastore.DirectSqlUpdateStat.updatePartitionColumnStatistics(DirectSqlUpdateStat.java:634)
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.updatePartitionColumnStatisticsBatch(MetaStoreDirectSql.java:2803)
> org.apache.hadoop.hive.metastore.ObjectStore.updatePartitionColumnStatisticsInBatch(ObjectStore.java:10001)
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43 java.lang.reflect.Method.invoke(Method.java:498)
> org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
> com.sun.proxy.$Proxy33.updatePartitionColumnStatisticsInBatch(Unknown Source)
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsForOneBatch(HiveMetaStore.java:7124)
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsInBatch(HiveMetaStore.java:7109) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)