[jira] [Resolved] (HBASE-15973) PeriodicMemstoreFlusher is causing excessive flushes when back-in-time inserts are happening

["Enis Soztutar (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Enis Soztutar resolved HBASE-15973.
-----------------------------------
    Resolution: Not A Problem

I've checked the code again, we are doing the correct thing: 
{code}
  private void setOldestEditTimeToNow() {
    if (timeOfOldestEdit == Long.MAX_VALUE) {
      timeOfOldestEdit = EnvironmentEdgeManager.currentTime();
    }
  }
{code}

I don't have the logs saved, so closing this for now, since I am not sure whether there were any other issues or not. 

> PeriodicMemstoreFlusher is causing excessive flushes when back-in-time inserts are happening
> --------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15973
>                 URL: https://issues.apache.org/jira/browse/HBASE-15973
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>             Fix For: 2.0.0, 1.3.0, 1.4.0
>
>
> In a production cluster, we have noticed a case where flushes were happening for 200-400KB in sizes. Turns out the periodic memstore flusher is force flushing because cells with older timestamps (in this case days old) were being inserted. 
> We have periodic memstore flusher with 1 hour defaulted, so in a case where replication is lagging, or phoenix secondary index rebuild or the user doing back-in-time inserts with cell timestamps older than 1 hour, we will flush extremely frequently. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)