You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by canan chen <cc...@gmail.com> on 2015/07/30 04:01:35 UTC
How to set log level in spark-submit ?
Anyone know how to set log level in spark-submit ? Thanks
Re: How to set log level in spark-submit ?
Posted by Dean Wampler <de...@gmail.com>.
Did you use an absolute path in $path_to_file? I just tried this with
spark-shell v1.4.1 and it worked for me. If the URL is wrong, you should
see an error message from log4j that it can't find the file. For windows it
would be something like file:/c:/path/to/file, I believe.
Dean Wampler, Ph.D.
Author: Programming Scala, 2nd Edition
<http://shop.oreilly.com/product/0636920033073.do> (O'Reilly)
Typesafe <http://typesafe.com>
@deanwampler <http://twitter.com/deanwampler>
http://polyglotprogramming.com
On Thu, Jul 30, 2015 at 4:41 AM, Alexander Krasheninnikov <
a.krasheninnikov@corp.badoo.com> wrote:
> I saw such example in docs:
> --conf "spark.driver.extraJavaOptions=-Dlog4j.configuration=
> file://$path_to_file"
> but, unfortunately, it does not work for me.
>
>
> On 30.07.2015 05:12, canan chen wrote:
>
> Yes, that should work. What I mean is is there any option in spark-submit
> command that I can specify for the log level
>
>
> On Thu, Jul 30, 2015 at 10:05 AM, Jonathan Coveney <jc...@gmail.com>
> wrote:
>
>> Put a log4j.properties file in conf/. You can copy
>> log4j.properties.template as a good base
>>
>>
>> El miércoles, 29 de julio de 2015, canan chen <cc...@gmail.com>
>> escribió:
>>
>>> Anyone know how to set log level in spark-submit ? Thanks
>>>
>>
>
>
Re: How to set log level in spark-submit ?
Posted by Alexander Krasheninnikov <a....@corp.badoo.com>.
I saw such example in docs:
--conf
"spark.driver.extraJavaOptions=-Dlog4j.configuration=file://$path_to_file"
but, unfortunately, it does not work for me.
On 30.07.2015 05:12, canan chen wrote:
> Yes, that should work. What I mean is is there any option in
> spark-submit command that I can specify for the log level
>
>
> On Thu, Jul 30, 2015 at 10:05 AM, Jonathan Coveney <jcoveney@gmail.com
> <ma...@gmail.com>> wrote:
>
> Put a log4j.properties file in conf/. You can copy
> log4j.properties.template as a good base
>
>
> El miércoles, 29 de julio de 2015, canan chen <ccnfdu@gmail.com
> <ma...@gmail.com>> escribió:
>
> Anyone know how to set log level in spark-submit ? Thanks
>
>
Re: How to set log level in spark-submit ?
Posted by canan chen <cc...@gmail.com>.
Yes, that should work. What I mean is is there any option in spark-submit
command that I can specify for the log level
On Thu, Jul 30, 2015 at 10:05 AM, Jonathan Coveney <jc...@gmail.com>
wrote:
> Put a log4j.properties file in conf/. You can copy
> log4j.properties.template as a good base
>
>
> El miércoles, 29 de julio de 2015, canan chen <cc...@gmail.com> escribió:
>
>> Anyone know how to set log level in spark-submit ? Thanks
>>
>
Re: How to set log level in spark-submit ?
Posted by Jonathan Coveney <jc...@gmail.com>.
Put a log4j.properties file in conf/. You can copy
log4j.properties.template as a good base
El miércoles, 29 de julio de 2015, canan chen <cc...@gmail.com> escribió:
> Anyone know how to set log level in spark-submit ? Thanks
>