You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Alessandro Solimando (Jira)" <ji...@apache.org> on 2022/04/16 08:12:00 UTC

[jira] [Created] (HIVE-26146) Handle missing hive.acid.key.index in the fixacidkeyindex utility

Alessandro Solimando created HIVE-26146:
-------------------------------------------

             Summary: Handle missing hive.acid.key.index in the fixacidkeyindex utility
                 Key: HIVE-26146
                 URL: https://issues.apache.org/jira/browse/HIVE-26146
             Project: Hive
          Issue Type: Improvement
          Components: ORC, Transactions
    Affects Versions: 4.0.0-alpha-2
            Reporter: Alessandro Solimando
            Assignee: Alessandro Solimando


There is a utility in hive which can validate/fix corrupted _hive.acid.key.index_: 

{code:bash}
hive --service fixacidkeyindex
{code}

At the moment the utility throws a NPE if the _hive.acid.key.index_ metadata entry is missing:

{noformat}
ERROR checking /hive-dev-box/multistripe_ko_acid.orc
java.lang.NullPointerException
        at org.apache.hadoop.hive.ql.io.orc.FixAcidKeyIndex.validate(FixAcidKeyIndex.java:183)
        at org.apache.hadoop.hive.ql.io.orc.FixAcidKeyIndex.checkFile(FixAcidKeyIndex.java:147)
        at org.apache.hadoop.hive.ql.io.orc.FixAcidKeyIndex.checkFiles(FixAcidKeyIndex.java:130)
        at org.apache.hadoop.hive.ql.io.orc.FixAcidKeyIndex.main(FixAcidKeyIndex.java:106)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:308)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:222)
{noformat}

The aim of this ticket is to handle such case in order to support re-generating this metadata entry even when it is missing.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)