You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2019/02/26 15:53:00 UTC
[jira] [Closed] (FLINK-1928) BlobManager can be a bottleneck on
large deployments
[ https://issues.apache.org/jira/browse/FLINK-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Till Rohrmann closed FLINK-1928.
--------------------------------
Resolution: Duplicate
> BlobManager can be a bottleneck on large deployments
> ----------------------------------------------------
>
> Key: FLINK-1928
> URL: https://issues.apache.org/jira/browse/FLINK-1928
> Project: Flink
> Issue Type: Improvement
> Components: Distributed Coordination, JobManager
> Affects Versions: 0.9
> Reporter: Robert Metzger
> Priority: Minor
>
> The BlobManager needed more than 2 minutes to distribute 220+ jar files to 50 TaskManagers in a user's setup.
> Serving the files for all the TMs from one JM might will quickly make the network of the JM a bottleneck when distributing the files.
> Potential solutions could be:
> - Use a torrent-style distribution mode
> - Use HDFS
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)