You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sankar Hariappan (JIRA)" <ji...@apache.org> on 2017/10/04 09:24:00 UTC

[jira] [Comment Edited] (HIVE-17681) Need to log bootstrap dump progress state property to HS2 logs.

    [ https://issues.apache.org/jira/browse/HIVE-17681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191036#comment-16191036 ] 

Sankar Hariappan edited comment on HIVE-17681 at 10/4/17 9:23 AM:
------------------------------------------------------------------

Added work around as follows to [https://cwiki.apache.org/confluence/display/Hive/HiveReplicationv2Development#HiveReplicationv2Development-REPLDUMP] section.

{quote}When bootstrap dump is in progress, it blocks rename table/partition operations on any tables of the dumped database and throws HiveException. Once bootstrap dump is completed, rename operations are enabled and will work as normal. If HiveServer2 crashes when bootstrap dump in progress, then rename operations will continue to throw HiveException even after HiveServer2 is restored with no REPL DUMP in progress. This abnormal state should be manually fixed using following work around. 
Look up the HiveServer logs for below pair of log messages.
REPL DUMP:: Set property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>, Value: ACTIVE
REPL DUMP:: Reset property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>
If Reset property log is not found for the corresponding Set property log, then user need to manually reset the database property <bootstrap.dump.state.xxxx> with value as "IDLE" using ALTER DATABASE command.{quote}


was (Author: sankarh):
Added work around as follows to [https://cwiki.apache.org/confluence/display/Hive/HiveReplicationv2Development#HiveReplicationv2Development-REPLDUMP] section.

bq. When bootstrap dump is in progress, it blocks rename table/partition operations on any tables of the dumped database and throws HiveException. Once bootstrap dump is completed, rename operations are enabled and will work as normal. If HiveServer2 crashes when bootstrap dump in progress, then rename operations will continue to throw HiveException even after HiveServer2 is restored with no REPL DUMP in progress. This abnormal state should be manually fixed using following work around. 
bq. Look up the HiveServer logs for below pair of log messages.
bq. REPL DUMP:: Set property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>, Value: ACTIVE
bq. REPL DUMP:: Reset property for Database: <db_name>, Property: <bootstrap.dump.state.xxxx>
bq. If Reset property log is not found for the corresponding Set property log, then user need to manually reset the database property <bootstrap.dump.state.xxxx> with value as "IDLE" using ALTER DATABASE command.

> Need to log bootstrap dump progress state property to HS2 logs.
> ---------------------------------------------------------------
>
>                 Key: HIVE-17681
>                 URL: https://issues.apache.org/jira/browse/HIVE-17681
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, repl
>    Affects Versions: 3.0.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>              Labels: DDL, DR, replication
>             Fix For: 3.0.0
>
>
> Currently, rename is disabled if bootstrap dump in progress. This is achieved by setting a "ACTIVE" flag in database properties which is referred by rename operation. If HiveServer2 crashes when dump in progress, then this flag is not unset (to IDLE state) which make the rename operation disabled for ever. 
> User need to manually enable rename in this scenario. So, need to log the property name associated with bootstrap dump which was in progress when HS2 crashes. Using this, user will reset this property of the database to enable rename again.
> Also, need document update for the same.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)