You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by huanglr <hu...@CeBiTec.Uni-Bielefeld.DE> on 2015/07/24 16:12:50 UTC

Broadcast HashMap much slower than Array

Hi,

When I try to broadcast a hashmap, it runs much slower than the same data broadcast in array.
It hangs in "SparkContext: Created broadcast 0" for few secondes (30s), while an array does not.
The broadcast dataset is about 1G.


best!


huanglr