Receiver/DStream storage level

[Michael Allman <mi...@videoamp.com>]

I'm implementing a custom ReceiverInputDStream and I'm not sure how to initialize the Receiver with the storage level. The storage level is set on the DStream, but there doesn't seem to be a way to pass it to the Receiver. At the same time, setting the storage level separately on the Receiver seems to introduce potential confusion as the storage level of the DStream can be set separately. Is this desired behavior---to have distinct DStream and Receiver storage levels? Perhaps I'm missing something? Also, the storageLevel property of the Receiver[T] class is undocumented.

Cheers,

Michael
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org