答复: Can spark-streaming work with spark-on-yarn mode?

[林武康 <vb...@gmail.com>]

Thank you Tathagata, I will try  it out later.

-----原始邮件-----
发件人: "Tathagata Das" <ta...@gmail.com>
发送时间: ‎2014/‎2/‎22 11:12
收件人: "user@spark.incubator.apache.org" <us...@spark.incubator.apache.org>
主题: Re: Can spark-streaming work with spark-on-yarn mode?

Yes, Spark and Spark Streaming programs can be deployed on YARN. Here is the documentation.


TD



On Thu, Feb 20, 2014 at 11:16 PM, 林武康 <vb...@gmail.com> wrote:

hi all,
I am a very newbie of apache spark, recently I have tried spark on yarn, it works for batch process. Now we want to try streaming process using spark-streaming, and still, use yarn for resource scheduler as we want to manager all the resource of the cluster used for computing tasks in a unified way.  Can this works? 
any suggestions are welcome!


--------------------------------------------------------------------------------

Best Regards！