You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2019/09/02 16:43:08 UTC
[GitHub] [flink] HuangZhenQiu commented on issue #8303: [FLINK-12343]
[flink-yarn] add file replication config for yarn configuration
HuangZhenQiu commented on issue #8303: [FLINK-12343] [flink-yarn] add file replication config for yarn configuration
URL: https://github.com/apache/flink/pull/8303#issuecomment-527202411
@tillrohrmann @wangyang0918 Yes. Thanks for pointing out theoretic feasibility. We do this for a use case that needs 800 containers for backfill with streaming mode. So both the starting TM executor with Flink RM and Jar downloading from hdfs. We internally tried this change, and find the reduce the start time as the jar download parallelism is increased. We also waiting for this https://issues.apache.org/jira/browse/FLINK-13184 to merge. BTW, build always fail due to some unstable test cases. Let me rebase master and try again.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services