You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/05/16 16:13:07 UTC

Monitoring Spark application progress

Hi,
I would like to know the approach and tools please to get the full performance for a Spark app running through Spark-shell and Spark-sumbit
   
   - Through Spark GUI at 4040?
   - Through OS utilities top, SAR 
   - Through Java tools like jbuilder etc
   - Through integration Spark with monitoring tools.

Thanks

Re: Monitoring Spark application progress

Posted by Василец Дмитрий <pr...@gmail.com>.
hello
use google translate and
https://mkdev.me/posts/ci-i-monitoring-spark-prilozheniy

On Mon, May 16, 2016 at 6:13 PM, Ashok Kumar <as...@yahoo.com.invalid>
wrote:

> Hi,
>
> I would like to know the approach and tools please to get the full
> performance for a Spark app running through Spark-shell and Spark-sumbit
>
>
>    1. Through Spark GUI at 4040?
>    2. Through OS utilities top, SAR
>    3. Through Java tools like jbuilder etc
>    4. Through integration Spark with monitoring tools.
>
>
> Thanks
>

Re: Monitoring Spark application progress

Posted by Василец Дмитрий <pr...@gmail.com>.
spark + zabbix + jmx
https://translate.google.ru/translate?sl=ru&tl=en&js=y&prev=_t&hl=en&ie=UTF-8&u=https%3A%2F%2Fmkdev.me%2Fposts%2Fci-i-monitoring-spark-prilozheniy&edit-text=

On Mon, May 16, 2016 at 6:13 PM, Ashok Kumar <as...@yahoo.com.invalid>
wrote:

> Hi,
>
> I would like to know the approach and tools please to get the full
> performance for a Spark app running through Spark-shell and Spark-sumbit
>
>
>    1. Through Spark GUI at 4040?
>    2. Through OS utilities top, SAR
>    3. Through Java tools like jbuilder etc
>    4. Through integration Spark with monitoring tools.
>
>
> Thanks
>