Too frequent major compaction

[Hamado Dene <ha...@yahoo.com.INVALID>]

Hi everyone,
Checking the logs of our production installation, we noticed that major compaction is often done. See log below:

 2021-10-27 01:29:06,321 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 3 (all) file(s) in n of 892640aead2517a5c2d24d31a7d919ad into 4f8fa3ae9d32431ca11ebac38d8e47ee(size=861.8 M), total size for store is 861.8 M. This selection was in queue for 0sec, and took 2mins, 31sec to execute.2021-10-27 09:46:52,023 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 3 (all) file(s) in n of 7e8b580af6d2e61daf2a86e6b48653f6 into 983079b144304cc4be672c8b9378a016(size=143.7 M), total size for store is 143.7 M. This selection was in queue for 0sec, and took 26sec to execute.2021-10-27 16:14:50,513 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in n of 0cc0718a81da7f063425378002da2e36 into 1812c63d50264a0b99ada96aa759d9df(size=95.3 M), total size for store is 95.3 M. This selection was in queue for 0sec, and took 17sec to execute.2021-10-29 10:02:56,017 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in n of a77515012c552708ea432b862f06c996 into 0fc840c1d5794cc6aab67d1577033216(size=609.5 M), total size for store is 609.5 M. This selection was in queue for 0sec, and took 1mins, 53sec to execute.2021-10-29 21:07:42,778 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in f of f6d48a99cd76eb601eb08662a2abe6a5 into 1b65fb027b5842ad8d83a8f12ea23f62(size=4.5 K), total size for store is 4.5 K. This selection was in queue for 0sec, and took 0sec to execute.2021-10-30 01:54:54,665 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 4 (all) file(s) in n of d2605f99abcd5cf820b71058a5519446 into 4ff92920942e46eba78444d2ad407a64(size=3.5 G), total size for store is 3.5 G. This selection was in queue for 0sec, and took 10mins, 18sec to execute.2021-10-30 13:51:56,807 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 5 (all) file(s) in d of 2fd1345aefc83e960d45865f283607f9 into 98bb274d1e154f46a1140f80073fd38f(size=647.6 M), total size for store is 647.6 M. This selection was in queue for 0sec, and took 4mins, 13sec to execute.2021-10-31 00:31:47,046 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 3 (all) file(s) in n of 892640aead2517a5c2d24d31a7d919ad into aab6fd42c4a2452babf29e2aaaa1c49d(size=867.0 M), total size for store is 867.0 M. This selection was in queue for 0sec, and took 2mins, 29sec to execute.2021-10-31 00:54:22,897 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in d of f6d48a99cd76eb601eb08662a2abe6a5 into 637cb657d308479c90fafde2bd72fbb2(size=4.5 K), total size for store is 4.5 K. This selection was in queue for 0sec, and took 0sec to execute.2021-10-31 00:54:50,340 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 3 (all) file(s) in n of ef35c22f7b77cd5ed295f749de04187f into 539f7a2f2ac24809b74a5574a78ca02c(size=158.2 M), total size for store is 158.2 M. This selection was in queue for 0sec, and took 27sec to execute.2021-10-31 07:16:28,545 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 3 (all) file(s) in n of ec568756da508db1eb4e6f66c14ec363 into 6d3e5c919e49465fb66c744d06328c4d(size=159.6 M), total size for store is 159.6 M. This selection was in queue for 0sec, and took 27sec to execute.2021-10-31 08:14:47,973 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in d of 75f363168973164e711b2e6bf623b94c into da0fbbc40fa54937bd451db615e5fc01(size=142.9 M), total size for store is 142.9 M. This selection was in queue for 0sec, and took 25sec to execute.2021-10-31 11:04:19,935 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in d of f6cf32328328962e7f8c441e4bf1154c into f0ad97034e22490db1bcf051a464c99e(size=1.1 G), total size for store is 1.1 G. This selection was in queue for 0sec, and took 3mins, 17sec to execute.2021-11-01 09:23:50,338 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 3 (all) file(s) in n of cc9b6eef91dcaf22d01ebdbd9d5dee7f into 082f70aeca084849a70054e4254dfb2a(size=850.7 M), total size for store is 850.7 M. This selection was in queue for 0sec, and took 9mins, 27sec to execute.2021-11-01 20:21:03,471 INFO  [regionserver/$regionserver_hostname:16020-shortCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in n of 5a0dda28df2e7fb40d0b9a6984c65ee4 into b6588da969eb4da68dffd419b8ef10c6(size=1.3 M), total size for store is 1.3 M. This selection was in queue for 0sec, and took 0sec to execute.2021-11-02 00:13:45,058 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 5 (all) file(s) in n of 23b722acf2b929ebe396fc31371c5fc8 into 4fcfdf61a70d4b29a91d3585d2182a0d(size=2.7 G), total size for store is 2.7 G. This selection was in queue for 0sec, and took 8mins, 4sec to execute.2021-11-02 06:12:04,923 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 6 (all) file(s) in d of 9b9b920258c5ee156a332e285804f01f into e6c3f4dce4404c29b139b2928c15f120(size=4.4 G), total size for store is 4.4 G. This selection was in queue for 0sec, and took 13mins, 36sec to execute.2021-11-02 07:28:31,652 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 2 (all) file(s) in d of 4ea0b6b2fb40c7ec2a5a63fb93851dff into b0c6a946837f49468546060f761f0770(size=278.4 M), total size for store is 278.4 M. This selection was in queue for 0sec, and took 48sec to execute.2021-11-02 13:09:18,159 INFO  [regionserver/$regionserver_hostname:16020-longCompactions-0] regionserver.HStore: Completed major compaction of 4 (all) file(s) in n of 145cfaf95741f3ee0e93911332887ad8 into c7d93d346818496fa5837043340a6f2d(size=2.7 G), total size for store is 2.7 G. This selection was in queue for 0sec, and took 8mins, 15sec to execute.


Our configuration is the default one. Then major every 7d.Maybe we missed something?
Thanks in advance,

Hamado Dene