You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (JIRA)" <ji...@apache.org> on 2018/06/20 10:37:00 UTC

[jira] [Created] (FLINK-9623) Move zipping logic out of blobservice

Chesnay Schepler created FLINK-9623:
---------------------------------------

             Summary: Move zipping logic out of blobservice
                 Key: FLINK-9623
                 URL: https://issues.apache.org/jira/browse/FLINK-9623
             Project: Flink
          Issue Type: Improvement
          Components: Job-Submission
    Affects Versions: 1.6.0
            Reporter: Chesnay Schepler
            Assignee: Chesnay Schepler
             Fix For: 1.6.0


Directories given to the blob-service (primarily a use-case for the distributed cache) are currently silently zipped, and later unzipped by the {{FileCache}}. This tightly coupled the zipping logic in the blob-service to the unzipping logic of the {{FileCache}}. The blob-service neither unzipped the directory if the blob was requested, nor did it provide any means of doing so manually, nor did it inform the user as to whether the requested blob is a zip or not.

My conclusion in is that the blob-service should not support directories _for now_, and that instead directories for the {{distributed cache}} should be explicitly zipped beforehand, given that this is the only use-case we have at the moment.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)