You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Kostas Kloudas (Jira)" <ji...@apache.org> on 2020/07/30 10:18:00 UTC

[jira] [Closed] (FLINK-13838) Support shipping archives for Yarn deployment

     [ https://issues.apache.org/jira/browse/FLINK-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kostas Kloudas closed FLINK-13838.
----------------------------------
    Fix Version/s: 1.12.0
         Assignee: Yang Wang  (was: Yang Wang)
       Resolution: Fixed

Merged on master with 0e10fd5b8ee09bc7638d3b964beaf0a6e6c53eb9

> Support shipping archives for Yarn deployment
> ---------------------------------------------
>
>                 Key: FLINK-13838
>                 URL: https://issues.apache.org/jira/browse/FLINK-13838
>             Project: Flink
>          Issue Type: New Feature
>          Components: Command Line Client
>            Reporter: Yang Wang
>            Assignee: Yang Wang
>            Priority: Major
>             Fix For: 1.12.0
>
>
> Currently we could use --yarnship to transfer jars, files and directory for cluster and add them to classpath. However, compressed package could not be supported. If we have a compressed package including some config files, so files and jars, the --yarnshipArchives will be very useful.
>  
> What’s the difference between -yt and -yta?
> '-yt' [file:///tmp|file:///tmp/a.tar.gz] Only directory could be supported. And the file will be transferred by Yarn and keep the original compressed file(not be unpacked) in the workdir of jobmanager/taskmanager container. If we have a {{a.tar.gz}} under /tmp directory, it will be shipped in the original name and format.
> '-yta' [file:///tmp/a.tar.gz#dict1] A tar or zip file could be supported. The file will be transferred by Yarn and unpacked to a new directory with name dict1 in the workdir. If no new name is specified, a directory with name same will be used(a directory named with a.tar.gz).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)