You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "ShuMing Li (JIRA)" <ji...@apache.org> on 2017/09/18 12:08:00 UTC

[jira] [Commented] (AMBARI-20056) FIFO compaction resulting in too many store files on large cluster

    [ https://issues.apache.org/jira/browse/AMBARI-20056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169930#comment-16169930 ] 

ShuMing Li commented on AMBARI-20056:
-------------------------------------

My distributed Hbase version is 1.2.6, use default compaction policy, we get the exception below:

>  java.io.IOException: java.io.IOException: Unable to load configured store engine 'org.apache.hadoop.hbase.regionserver.DateTieredStoreEngine'

So which compaction policy should we use? 

> FIFO compaction resulting in too many store files on large cluster
> ------------------------------------------------------------------
>
>                 Key: AMBARI-20056
>                 URL: https://issues.apache.org/jira/browse/AMBARI-20056
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics
>    Affects Versions: 2.5.0
>            Reporter: Aravindan Vijayan
>            Assignee: Aravindan Vijayan
>            Priority: Critical
>             Fix For: 2.5.0
>
>         Attachments: AMBARI-20056.patch
>
>
> Set Data Tiered compaction for all tables except METRIC_RECORD
> This will allow number of store files to go down over time.  On a 500 node cluster AMS can become in-operational after creating 18K store files and no compaction.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)