[jira] [Created] (HIVE-27072) create an sql query to validate a given table for partitions and list out any discrepancies in files/folders, list out empty files etc

["Taraka Rama Rao Lethavadla (Jira)" <ji...@apache.org>]

Taraka Rama Rao Lethavadla created HIVE-27072:
-------------------------------------------------

             Summary: create an sql query to validate a given table for partitions and list out any discrepancies in files/folders, list out empty files etc
                 Key: HIVE-27072
                 URL: https://issues.apache.org/jira/browse/HIVE-27072
             Project: Hive
          Issue Type: New Feature
          Components: HiveServer2
            Reporter: Taraka Rama Rao Lethavadla


There are couple of issues when partitions were corrupted or have additional unwanted files that will intervene query execution and fail. 

If we run query like "validate table table_name [partition(partition=a,..)]", the output should list
 * any unwanted files like empty/metadata files(like _SUCCESS etc)
 * any unwanted folders not confirming to the partition naming convention like test_folder where actual partition name looks like test=23
 * Too many staging directories, if we find many then cleanup is not happening properly after query execution
 * any file permission related issues like table has one owner, partition has another owner etc(Optional)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)