You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Brett Konold (Jira)" <ji...@apache.org> on 2020/01/28 08:25:00 UTC

[jira] [Created] (SAMZA-2447) Checkpoint dir removal should only search in valid store dirs

Brett Konold created SAMZA-2447:
-----------------------------------

             Summary: Checkpoint dir removal should only search in valid store dirs
                 Key: SAMZA-2447
                 URL: https://issues.apache.org/jira/browse/SAMZA-2447
             Project: Samza
          Issue Type: Bug
    Affects Versions: 1.3
            Reporter: Brett Konold
            Assignee: Brett Konold


removeOldCheckpoints in TransactionalStateTaskStorageManager currently treats every file in the logged store base directory as if it is a directory; not always true as there is no guarantee that the base directory has _only_ stores in it (there could be other files unrelated to stores depending on how the user has configured the directory).

We should only be calling listFiles on files that we know to be directories.

Bonus points if we can search only directories we know to be stores



--
This message was sent by Atlassian Jira
(v8.3.4#803005)