You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Vladimir Rodionov (Jira)" <ji...@apache.org> on 2019/11/06 21:00:10 UTC
[jira] [Updated] (HBASE-23266) Test case for MOB compaction in a
region's batch mode.
[ https://issues.apache.org/jira/browse/HBASE-23266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vladimir Rodionov updated HBASE-23266:
--------------------------------------
Description:
Major MOB compaction in a general (non-generational) mode can be run in a batched mode (disabled by default). In this mode, only subset of regions at a time are compacted to mitigate possible compaction storms. We need test case for this mode.
Test case description:
{code}
/**
* Mob file compaction chore in batch mode test.
* 1. Enables batch mode for regular MOB compaction,
* Sets batch size to 7 regions.
* 2. Disables periodic MOB compactions, sets minimum age to archive to 10 sec
* 3. Creates MOB table with 20 regions
* 4. Loads MOB data (randomized keys, 1000 rows), flushes data.
* 5. Repeats 4. two more times
* 6. Verifies that we have 20 *3 = 60 mob files (equals to number of regions x 3)
* 7. Runs major MOB compaction.
* 8. Verifies that number of MOB files in a mob directory is 20 x4 = 80
* 9. Waits for a period of time larger than minimum age to archive
* 10. Runs Mob cleaner chore
* 11 Verifies that number of MOB files in a mob directory is 20.
* 12 Runs scanner and checks all 3 * 1000 rows.
*/
{code}
was:Major MOB compaction in a general (non-generational) mode can be run in a batched mode (disabled by default). In this mode, only subset of regions at a time are compacted to mitigate possible compaction storms. We need test case for this mode.
> Test case for MOB compaction in a region's batch mode.
> ------------------------------------------------------
>
> Key: HBASE-23266
> URL: https://issues.apache.org/jira/browse/HBASE-23266
> Project: HBase
> Issue Type: Sub-task
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Priority: Major
>
> Major MOB compaction in a general (non-generational) mode can be run in a batched mode (disabled by default). In this mode, only subset of regions at a time are compacted to mitigate possible compaction storms. We need test case for this mode.
> Test case description:
> {code}
> /**
> * Mob file compaction chore in batch mode test.
> * 1. Enables batch mode for regular MOB compaction,
> * Sets batch size to 7 regions.
> * 2. Disables periodic MOB compactions, sets minimum age to archive to 10 sec
> * 3. Creates MOB table with 20 regions
> * 4. Loads MOB data (randomized keys, 1000 rows), flushes data.
> * 5. Repeats 4. two more times
> * 6. Verifies that we have 20 *3 = 60 mob files (equals to number of regions x 3)
> * 7. Runs major MOB compaction.
> * 8. Verifies that number of MOB files in a mob directory is 20 x4 = 80
> * 9. Waits for a period of time larger than minimum age to archive
> * 10. Runs Mob cleaner chore
> * 11 Verifies that number of MOB files in a mob directory is 20.
> * 12 Runs scanner and checks all 3 * 1000 rows.
> */
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)