[GitHub] [flink] rmetzger commented on issue #8303: [FLINK-12343]add file replication config for yarn configuration

[GitBox <gi...@apache.org>]

rmetzger commented on issue #8303: [FLINK-12343]add file replication config for yarn configuration
URL: https://github.com/apache/flink/pull/8303#issuecomment-490370551
 
 
   @xintongsong Thanks a lot for taking a look at the PR.
   Isn't it a good thing (in this case), that the `copyFromLocalFile` blocks until the file has been replicated? If it happens asynchronously, we might run into a situation where the files are not yet replicated, and the deployment of the YARN cluster won't benefit from a higher replication.
   
    > It is easy to control which files should be affected while preserve the dfs default replication for the others, by passing an argument into the utility.
   
   Of course, we should only set the replication factor of the files uploaded by the YARN client and AM, needed for the deployment, not the operation of Flink.
   
   This should be validated through a test in Flink.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services