You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "ShuMing Li (JIRA)" <ji...@apache.org> on 2017/09/18 12:08:00 UTC
[jira] [Commented] (AMBARI-20056) FIFO compaction resulting in too
many store files on large cluster
[ https://issues.apache.org/jira/browse/AMBARI-20056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169930#comment-16169930 ]
ShuMing Li commented on AMBARI-20056:
-------------------------------------
My distributed Hbase version is 1.2.6, use default compaction policy, we get the exception below:
> java.io.IOException: java.io.IOException: Unable to load configured store engine 'org.apache.hadoop.hbase.regionserver.DateTieredStoreEngine'
So which compaction policy should we use?
> FIFO compaction resulting in too many store files on large cluster
> ------------------------------------------------------------------
>
> Key: AMBARI-20056
> URL: https://issues.apache.org/jira/browse/AMBARI-20056
> Project: Ambari
> Issue Type: Bug
> Components: ambari-metrics
> Affects Versions: 2.5.0
> Reporter: Aravindan Vijayan
> Assignee: Aravindan Vijayan
> Priority: Critical
> Fix For: 2.5.0
>
> Attachments: AMBARI-20056.patch
>
>
> Set Data Tiered compaction for all tables except METRIC_RECORD
> This will allow number of store files to go down over time. On a 500 node cluster AMS can become in-operational after creating 18K store files and no compaction.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)