You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Manish Gupta 8 <mg...@sapient.com> on 2015/03/26 11:38:37 UTC

Port configuration for BlockManagerId

Hi,

I am running spark-shell and connecting with a yarn cluster with deploy mode as "client". In our environment, there are some security policies that doesn't allow us to open all TCP port.
Issue I am facing is: Spark Shell driver is using a random port for BlockManagerID - BlockManagerId(<driver>, host-name, 52131).

Is there any configuration I can use to fix this random port behavior?

I am running Spark 1.2.0 on CDH 5.3.0.

Thanks,
Manish