You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2022/01/19 15:41:00 UTC

[jira] [Closed] (FLINK-25405) Let BlobServer/BlobCache detect & delete corrupted blobs

     [ https://issues.apache.org/jira/browse/FLINK-25405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Till Rohrmann closed FLINK-25405.
---------------------------------
    Resolution: Fixed

Fixed via

137a03f35e2471a1978d395ace06c4b06bc41cc1
ea52732dc48a4f1c5be0925890cd8aa1ea2a11ed

> Let BlobServer/BlobCache detect & delete corrupted blobs
> --------------------------------------------------------
>
>                 Key: FLINK-25405
>                 URL: https://issues.apache.org/jira/browse/FLINK-25405
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Coordination
>    Affects Versions: 1.15.0
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.15.0
>
>
> In order to make the BlobServer and BlobCache work together with the local working directories, they have be able to detect corrupted blobs (e.g. due to process crashes when downloading blobs) and delete them. Therefore, I propose to let the BlobServer and BlobCache verify by recomputing their checksums which blobs are valid and to delete those that did not pass.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)