You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Edmon Begoli <eb...@gmail.com> on 2015/03/22 01:43:47 UTC

Reducing Spark's logging verbosity

Hi,
Does anyone have concrete recommendations how to reduce Spark's logging
verbosity.

We have attempted on several occasions to address this by setting various
log4j properties, both in configuration property files and in
$SPARK_HOME/conf/ spark-env.sh; however, all of those attempts have failed.

Any suggestions are welcome.

Thank you,
Edmon

Re: Reducing Spark's logging verbosity

Posted by Emre Sevinc <em...@gmail.com>.
Hello Edmon,

Does the following help?

http://stackoverflow.com/questions/27248997/how-to-suppress-spark-logging-in-unit-tests/27360000#27360000

--
Emre Sevinç
http://www.bigindustries.be
On Mar 22, 2015 1:44 AM, "Edmon Begoli" <eb...@gmail.com> wrote:

> Hi,
> Does anyone have concrete recommendations how to reduce Spark's logging
> verbosity.
>
> We have attempted on several occasions to address this by setting various
> log4j properties, both in configuration property files and in
> $SPARK_HOME/conf/ spark-env.sh; however, all of those attempts have failed.
>
> Any suggestions are welcome.
>
> Thank you,
> Edmon
>