You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (JIRA)" <ji...@apache.org> on 2018/06/21 15:31:00 UTC

[jira] [Closed] (FLINK-9623) Move zipping logic out of blobservice

     [ https://issues.apache.org/jira/browse/FLINK-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chesnay Schepler closed FLINK-9623.
-----------------------------------
    Resolution: Fixed

master: 3f07ecc652c07101ae1b1a8fb17f89a2d1206e1e

> Move zipping logic out of blobservice
> -------------------------------------
>
>                 Key: FLINK-9623
>                 URL: https://issues.apache.org/jira/browse/FLINK-9623
>             Project: Flink
>          Issue Type: Improvement
>          Components: Job-Submission
>    Affects Versions: 1.6.0
>            Reporter: Chesnay Schepler
>            Assignee: Chesnay Schepler
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.6.0
>
>
> Directories given to the blob-service (primarily a use-case for the distributed cache) are currently silently zipped, and later unzipped by the {{FileCache}}. This tightly coupled the zipping logic in the blob-service to the unzipping logic of the {{FileCache}}. The blob-service neither unzipped the directory if the blob was requested, nor did it provide any means of doing so manually, nor did it inform the user as to whether the requested blob is a zip or not.
> My conclusion in is that the blob-service should not support directories _for now_, and that instead directories for the {{distributed cache}} should be explicitly zipped beforehand, given that this is the only use-case we have at the moment.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)