You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Vijayendra Yadav <co...@gmail.com> on 2020/09/03 18:01:50 UTC
FLINK YARN SHIP from S3 Directory
Hi Team,
Is there any feature to be able to ship directory to containers from s3
Directory instead of local.
-yt,--yarnship <arg> Ship files in the specified directory
(t for transfer)
Re: FLINK YARN SHIP from S3 Directory
Posted by Vijayendra Yadav <co...@gmail.com>.
Thank You Gordon. I am still on 1.10.0. I will try 1.11.0 When I get there.
Regards,
Vijay
On Fri, Sep 4, 2020 at 12:52 AM Tzu-Li (Gordon) Tai <tz...@apache.org>
wrote:
> Hi,
>
> As far as I can tell from a recent change [1], this seems to be possible
> now starting from Flink 1.11.x. Have you already tried this with the latest
> Flink version?
> Also including Klou in this email, who might be able to confirm this.
>
> Cheers,
> Gordon
>
> [1] https://issues.apache.org/jira/browse/FLINK-17632
>
> On Fri, Sep 4, 2020 at 2:02 AM Vijayendra Yadav <co...@gmail.com>
> wrote:
>
>> Hi Team,
>>
>> Is there any feature to be able to ship directory to containers from s3
>> Directory instead of local.
>>
>> -yt,--yarnship <arg> Ship files in the specified directory
>> (t for transfer)
>>
>>
Re: FLINK YARN SHIP from S3 Directory
Posted by "Tzu-Li (Gordon) Tai" <tz...@apache.org>.
Hi,
As far as I can tell from a recent change [1], this seems to be possible
now starting from Flink 1.11.x. Have you already tried this with the latest
Flink version?
Also including Klou in this email, who might be able to confirm this.
Cheers,
Gordon
[1] https://issues.apache.org/jira/browse/FLINK-17632
On Fri, Sep 4, 2020 at 2:02 AM Vijayendra Yadav <co...@gmail.com>
wrote:
> Hi Team,
>
> Is there any feature to be able to ship directory to containers from s3
> Directory instead of local.
>
> -yt,--yarnship <arg> Ship files in the specified directory
> (t for transfer)
>
>