You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by danilopds <da...@gmail.com> on 2014/10/02 21:29:42 UTC

Re: Can not see any spark metrics on ganglia-web

Hi tsingfu,

I want to see metrics in ganglia too.
But I don't understand this step:
./make-distribution.sh --tgz --skip-java-test -Phadoop-2.3 -Pyarn -Phive
-Pspark-ganglia-lgpl 

Are you installing the hadoop, yarn, hive AND ganglia??

If I want to install just ganglia?
Can you suggest me something?

Thanks!



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p15631.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Can not see any spark metrics on ganglia-web

Posted by danilopds <da...@gmail.com>.

I used the command below because I'm using Spark 1.0.2 built with SBT and it
worked. 

SPARK_HADOOP_VERSION=2.2.0 SPARK_YARN=true SPARK_GANGLIA_LGPL=true sbt/sbt
assembly



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p20384.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Can not see any spark metrics on ganglia-web

Posted by danilopds <da...@gmail.com>.

Ok Krishna Sankar,

In relation to this information on Spark monitoring webpage,
"For sbt users, set the SPARK_GANGLIA_LGPL environment variable before
building. For Maven users, enable the -Pspark-ganglia-lgpl profile"

Do you know what I need to do to install with sbt?
Thanks.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p15636.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Can not see any spark metrics on ganglia-web

Posted by Krishna Sankar <ks...@gmail.com>.

Hi,
   I am sure you can use the -Pspark-ganglia-lgpl switch to enable Ganglia.
This step only adds the support for Hadoop,Yarn,Hive et al in the spark
executable.No need to run if one is not using them.
Cheers
<k/>

On Thu, Oct 2, 2014 at 12:29 PM, danilopds <da...@gmail.com> wrote:

> Hi tsingfu,
>
> I want to see metrics in ganglia too.
> But I don't understand this step:
> ./make-distribution.sh --tgz --skip-java-test -Phadoop-2.3 -Pyarn -Phive
> -Pspark-ganglia-lgpl
>
> Are you installing the hadoop, yarn, hive AND ganglia??
>
> If I want to install just ganglia?
> Can you suggest me something?
>
> Thanks!
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Can-not-see-any-spark-metrics-on-ganglia-web-tp14981p15631.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>