Fine grained control over receiving framework messages

[Arpan Ghosh <ar...@gmail.com>]

Hi,

We are running a a job on spark using mesos. We are using Mesos framework
messages to communicate intermediate results between the Spark master and
workers. The number of messages per second is really big . The spark worker
spawns a new thread for receiving each framework message but stops
receiving these message very soon. We think its probably because too many
threads are being launched.

Is there any way to control/ configure the thread behavior for receiving
Framework messages. We do intend to switch to actors for sending and
receiving these messages in the near future.


Thanks


Arpan, Joseph, Rajesh