You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Nicholas Jiang (Jira)" <ji...@apache.org> on 2020/12/30 11:33:01 UTC

[jira] [Comment Edited] (FLINK-20811) Support HTTP paths for yarn ship files/archives

    [ https://issues.apache.org/jira/browse/FLINK-20811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256472#comment-17256472 ] 

Nicholas Jiang edited comment on FLINK-20811 at 12/30/20, 11:32 AM:
--------------------------------------------------------------------

[~xintongsong],[~fly_in_gis],[~zoucao], IMO, the changes could be adding the YarnRemoteResourceDescriptor which describe the remote path for yarn ship files/archives and enable to download contents from various paths like HTTP, HDFS etc to the Yarn cluster.



was (Author: nicholasjiang):
[~xintongsong][~fly_in_gis][~zoucao], IMO, the changes could be adding the YarnRemoteResourceDescriptor which describe the remote path for yarn ship files/archives and enable to download contents from various paths like HTTP, HDFS etc to the Yarn cluster.


> Support HTTP paths for yarn ship files/archives
> -----------------------------------------------
>
>                 Key: FLINK-20811
>                 URL: https://issues.apache.org/jira/browse/FLINK-20811
>             Project: Flink
>          Issue Type: New Feature
>          Components: Deployment / YARN
>            Reporter: Xintong Song
>            Priority: Major
>
> Flink's Yarn integration supports shipping workload-specific local files/directories/archives to the Yarn cluster.
> As discussed in FLINK-20505, it would be helpful to support directly downloading contents from HTTP paths to the Yarn cluster, so that users won't need to first download the contents locally and then upload it to the Yarn cluster.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)