You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2017/02/25 23:51:44 UTC
[jira] [Commented] (HBASE-17674) Major compaction may be cancelled
in CompactionChecker
[ https://issues.apache.org/jira/browse/HBASE-17674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884442#comment-15884442 ]
Hudson commented on HBASE-17674:
--------------------------------
SUCCESS: Integrated in Jenkins build HBase-Trunk_matrix #2571 (See [https://builds.apache.org/job/HBase-Trunk_matrix/2571/])
HBASE-17674 Major compaction may be cancelled in CompactionChecker (tedyu: rev f4bf375ea113090e103e9e8d2ca5c58a7be629f2)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
> Major compaction may be cancelled in CompactionChecker
> ------------------------------------------------------
>
> Key: HBASE-17674
> URL: https://issues.apache.org/jira/browse/HBASE-17674
> Project: HBase
> Issue Type: Bug
> Components: Compaction
> Affects Versions: 2.0.0, 1.3.0, 1.2.4, 0.98.24
> Reporter: Guangxu Cheng
> Attachments: HBASE-17674-master-v1.patch
>
>
> CompactionChecker will periodically check whether a region should perform a major compaction.
> If a region should perform a major compact, a request is submitted. But before the request is submitted, the variable forceMajor is not set to true by calling triggerMajorCompaction.
> When filtering a storefile, the large storefile may cause the request to be canceled or became minor compact.
> {code:title=HRegionServer.java|borderStyle=solid}
> @Override
> protected void chore() {
> for (Region r : this.instance.onlineRegions.values()) {
> if (r == null)
> continue;
> for (Store s : r.getStores()) {
> try {
> long multiplier = s.getCompactionCheckMultiplier();
> assert multiplier > 0;
> if (iteration % multiplier != 0) continue;
> if (s.needsCompaction()) {
> // Queue a compaction. Will recognize if major is needed.
> this.instance.compactSplitThread.requestSystemCompaction(r, s, getName()
> + " requests compaction");
> } else if (s.isMajorCompaction()) {
> if (majorCompactPriority == DEFAULT_PRIORITY
> || majorCompactPriority > ((HRegion)r).getCompactPriority()) {
> this.instance.compactSplitThread.requestCompaction(r, s, getName()
> + " requests major compaction; use default priority", null);
> } else {
> this.instance.compactSplitThread.requestCompaction(r, s, getName()
> + " requests major compaction; use configured priority",
> this.majorCompactPriority, null, null);
> }
> }
> } catch (IOException e) {
> LOG.warn("Failed major compaction check on " + r, e);
> }
> }
> }
> iteration = (iteration == Long.MAX_VALUE) ? 0 : (iteration + 1);
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)