You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2019/07/10 03:21:08 UTC

[GitHub] [flink] wangyang0918 commented on issue #8303: [FLINK-12343] [flink-yarn] add file replication config for yarn configuration

wangyang0918 commented on issue #8303: [FLINK-12343] [flink-yarn] add file replication config for yarn configuration
URL: https://github.com/apache/flink/pull/8303#issuecomment-509891566
 
 
   > @xintongsong
   > It is wired that the default value of dfs.replication in YarnConfiguration is 1. The setting will not be used for starting MiniYarnCluster, in which the dfs.replication will be set as 3 by default. It caused the error. Thus, I have to set dfs.replication in YarnConfiguration to make the test case pass.
   
   Hi @HuangZhenQiu 
   I'm afraid we cannot simply set the `dfs.replication` in `YARN_CONFIGURATION`.  We have to find the root cause why the replication of `ResourceManager#createTaskExecutorContext` is different from flink client. They should have the same configuration. I will help to find out the root cause. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services