[jira] [Updated] (STORM-3583) Handle exceptions when AsyncLocalizer tries to get local resources

["Ethan Li (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/STORM-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Li updated STORM-3583:
----------------------------
    Summary: Handle exceptions when AsyncLocalizer tries to get local resources  (was: Localizer should not cause supervisor restart on FileNotFoundException)

> Handle exceptions when AsyncLocalizer tries to get local resources
> ------------------------------------------------------------------
>
>                 Key: STORM-3583
>                 URL: https://issues.apache.org/jira/browse/STORM-3583
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: storm-server
>            Reporter: Kishor Patil
>            Assignee: Rui Li
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.2.0
>
>          Time Spent: 4h 50m
>  Remaining Estimate: 0h
>
> Supervisor relies on AsyncLocalizer to download blobs from blob store.
> AsyncLocalizer uses downloadService pool to process CompletableFuture objects in parallel.
> We have noticed a case that while the downloading task is waiting for a thread to execute, new assignment changes will try to release the slot by dereferences all of the related local resources.
> However, reading local resources assumes two base blob downloading task have been completed which is not always true.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)