You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Sourav Chandra <so...@livestream.com> on 2014/12/11 12:32:06 UTC

spark logging issue

Hi,

I am using spark 1.1.0 and setting below properties while creating spark
context.


*spark.executor.logs.rolling.maxRetainedFiles = 10*

*spark.executor.logs.rolling.size.maxBytes = 104857600*
*spark.executor.logs.rolling.strategy = size*

Even though I am setting to rollover after 100 MB, the log files (i.e.
stderr) file is not rolled over.

What am I missing here?

-- 

Sourav Chandra

Senior Software Engineer

· · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · ·

sourav.chandra@livestream.com

o: +91 80 4121 8723

m: +91 988 699 3746

skype: sourav.chandra

Livestream

"Ajmera Summit", First Floor, #3/D, 68 Ward, 3rd Cross, 7th C Main, 3rd
Block, Koramangala Industrial Area,

Bangalore 560034

www.livestream.com