[jira] [Created] (HIVE-26382) Stats generation fails during CTAS for external partitioned table.

["mahesh kumar behera (Jira)" <ji...@apache.org>]

mahesh kumar behera created HIVE-26382:
------------------------------------------

             Summary: Stats generation fails during CTAS for external partitioned table.
                 Key: HIVE-26382
                 URL: https://issues.apache.org/jira/browse/HIVE-26382
             Project: Hive
          Issue Type: Bug
          Components: Hive, HiveServer2
    Affects Versions: 4.0.0-alpha-1
            Reporter: mahesh kumar behera
            Assignee: mahesh kumar behera


As part of HIVE-25990 manifest file was generated to list out the files to be moved. The files are moved in move task by referring to the manifest file. For partitioned table flow, the move is not done. This prevents the dynamic partition creation as the target path will be empty. As stats task needs the partition information, this causes the stat task to fail.

 
{code:java}
class="metastore.RetryingHMSHandler" level="ERROR" thread="pool-10-thread-144"] MetaException(message:Unable to update Column stats for  ext_par due to: The IN list is empty!)
 org.apache.hadoop.hive.metastore.DirectSqlUpdateStat.updatePartitionColumnStatistics(DirectSqlUpdateStat.java:634)
 org.apache.hadoop.hive.metastore.MetaStoreDirectSql.updatePartitionColumnStatisticsBatch(MetaStoreDirectSql.java:2803)
 org.apache.hadoop.hive.metastore.ObjectStore.updatePartitionColumnStatisticsInBatch(ObjectStore.java:10001)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43 java.lang.reflect.Method.invoke(Method.java:498)
 org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
com.sun.proxy.$Proxy33.updatePartitionColumnStatisticsInBatch(Unknown Source)
 org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsForOneBatch(HiveMetaStore.java:7124)
 org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.updatePartitionColStatsInBatch(HiveMetaStore.java:7109) {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)