[jira] [Closed] (FLINK-12343) Allow set file.replication in Yarn Configuration

["Zili Chen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-12343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zili Chen closed FLINK-12343.
-----------------------------
    Fix Version/s: 1.11.0
       Resolution: Fixed

master via 9d91aac49bb57b0701d97f9585b96b8ca2b224d1

> Allow set file.replication in Yarn Configuration
> ------------------------------------------------
>
>                 Key: FLINK-12343
>                 URL: https://issues.apache.org/jira/browse/FLINK-12343
>             Project: Flink
>          Issue Type: Improvement
>          Components: Command Line Client, Deployment / YARN
>    Affects Versions: 1.6.4, 1.7.2, 1.8.0
>            Reporter: Zhenqiu Huang
>            Assignee: Zhenqiu Huang
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 1.11.0
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Currently, FlinkYarnSessionCli upload jars into hdfs with default 3 replications. From our production experience, we find that 3 replications will block big job (256 containers) to launch, when the HDFS is slow due to big workload for batch pipelines. Thus, we want to make the factor customizable from FlinkYarnSessionCli by adding an option.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)