You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Sungwoo Park <gl...@gmail.com> on 2020/10/08 08:26:08 UTC

Question on metadata before and after compaction

Hi,

I have a question on the consistency between data (e.g., on HDFS) and
metadata kept by Metastore before and after compaction.

Here is a scenario:

1. We back up the database for Metastore (before performing compaction).
2. We perform compaction.
3. After performing compaction, we lose the database for Metastore by
accident.

The question is: can we restore and use the backup database for Metastore
along with the data after compaction? As incremental changes/deltas are
stored on data storage, I guess this might be feasible, but not sure. Any
comment would be appreciated.

Thanks,

--- Sungwoo