You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Matthias Pohl (Jira)" <ji...@apache.org> on 2022/04/12 13:09:00 UTC

[jira] [Created] (FLINK-27204) FileSystemJobResultStore should operator on the ioExecutor

Matthias Pohl created FLINK-27204:
-------------------------------------

             Summary: FileSystemJobResultStore should operator on the ioExecutor
                 Key: FLINK-27204
                 URL: https://issues.apache.org/jira/browse/FLINK-27204
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.16.0
            Reporter: Matthias Pohl


The {{JobResultStore}} interface is synchronous currently. For the {{FileSystemJobResultStore}} this means that (possibly) IO-heavy operations have to be explicitly called moved to the ioExecutor within the Dispatcher.

Instead, we could change the {{JobResultStore}} interface in a way that it returns {{CompletableFuture}} instances instead. That would enable us to run the {{FileSystemJobResultStore}} operations in the ioExecutor which would be set when initializing the {{{}FileSystemJobResultStore{}}}. This would move the responsibility of where to run the operation from the {{Dispatcher}} into the {{JobResultStore.}}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)