You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Zach York (JIRA)" <ji...@apache.org> on 2018/08/17 22:42:00 UTC

[jira] [Created] (HBASE-21070) SnapshotFileCache won't update for snapshots stored in S3

Zach York created HBASE-21070:
---------------------------------

             Summary: SnapshotFileCache won't update for snapshots stored in S3
                 Key: HBASE-21070
                 URL: https://issues.apache.org/jira/browse/HBASE-21070
             Project: HBase
          Issue Type: Bug
          Components: snapshots
    Affects Versions: 3.0.0, 2.1.1, 1.4.7
            Reporter: Zach York
            Assignee: Zach York


The SnapshotFileCache depends on last modified time to determine whether to update the Snapshot HFile cache. However, in S3, real 'folders' don't exist. S3 filesystems create a dummy file in place of a folder, but the dummy file last modified time is not updated when files are changed 'under' it. This means that the SnapshotFileCache doesn't pick up new snapshot HFiles and these files aren't removed from the HFileCleaner and can be eligible for deletion.

 

My patch removes the lastmodified assumption.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)