[jira] [Created] (HBASE-19478) Utilize multi-get to speed up WAL file checking in BackupLogCleaner

["Ted Yu (JIRA)" <ji...@apache.org>]

Ted Yu created HBASE-19478:
------------------------------

             Summary: Utilize multi-get to speed up WAL file checking in BackupLogCleaner
                 Key: HBASE-19478
                 URL: https://issues.apache.org/jira/browse/HBASE-19478
             Project: HBase
          Issue Type: Improvement
            Reporter: Ted Yu


Currently BackupLogCleaner#getDeletableFiles() issues one Get per WAL file:
{code}
      for (FileStatus file : files) {
        String wal = file.getPath().toString();
        boolean logInSystemTable = table.isWALFileDeletable(wal);
{code}
This is rather inefficient considering the number of WAL files in production can get quite large.

We should use multi-get to reduce the number of calls to backup table (which normally resides on another server).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)