[jira] [Commented] (FLINK-20811) Support HTTP paths for yarn ship files/archives

["Zhenqiu Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257677#comment-17257677 ] 

Zhenqiu Huang commented on FLINK-20811:
---------------------------------------

[~fly_in_gis]
Echo to Xintong's questions. If the variable userJars in a Jobgraph has a jar with Http path (It could be set by user configuration for example pipeline.jars), it will be added it as LocalResource in Yarn. How K8 handle the Http libs needed in runtime?

> Support HTTP paths for yarn ship files/archives
> -----------------------------------------------
>
>                 Key: FLINK-20811
>                 URL: https://issues.apache.org/jira/browse/FLINK-20811
>             Project: Flink
>          Issue Type: New Feature
>          Components: Deployment / YARN
>            Reporter: Xintong Song
>            Priority: Major
>
> Flink's Yarn integration supports shipping workload-specific local files/directories/archives to the Yarn cluster.
> As discussed in FLINK-20505, it would be helpful to support directly downloading contents from HTTP paths to the Yarn cluster, so that users won't need to first download the contents locally and then upload it to the Yarn cluster.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)