Solr Log rotation

[shruti suri <er...@gmail.com>]

Hi,

My log size is growing larger and it take most of the space. Please suggest
how to handle this. Also Is there a way for log cleanup other than on
startup as my servers didn't restart daily and the size keep on increasing.


log4j.properties

#  Logging level
solr.log=/var/log/solr
log4j.rootLogger=INFO, file, CONSOLE

log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender

log4j.appender.CONSOLE.layout=org.apache.log4j.EnhancedPatternLayout
log4j.appender.CONSOLE.layout.ConversionPattern=%-4r %-5p (%t)
[%X{collection} %X{shard} %X{replica} %X{core}] %c{1.} %m%n

#- size rotation with log cleanup.
log4j.appender.file=org.apache.log4j.RollingFileAppender
log4j.appender.file.MaxFileSize=10MB
log4j.appender.file.MaxBackupIndex=10

#- File to log to and log format
log4j.appender.file.File=${solr.log}/solr.log
log4j.appender.file.layout=org.apache.log4j.EnhancedPatternLayout
log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss.SSS}
%-5p (%t) [%X{collection} %X{shard} %X{replica} %X{core}] %c{1.} %m%n

log4j.logger.org.apache.zookeeper=WARN
log4j.logger.org.apache.hadoop=WARN

# set to INFO to enable infostream log messages
log4j.logger.org.apache.solr.update.LoggingInfoStream=OFF

Thanks
Shruti






-----
Regards
Shruti
--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr Log rotation

[Erick Erickson <er...@gmail.com>]

Shouldn’t be happening like this, you should have 10, approximately 10M files. Did you by any chance upgrade to a Solr that uses Log4j2 and keep the old config files? log4j2.xml should be your config if so and it has a much different format than what you’re showing.

The when to purge decision is made whenever a hard commit happens, do the next question is do you hard commit? See: https://lucidworks.com/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/

Or do you have CDCR enabled?

In short, something about your setup is changed from the standard distribution, you need to identify what..

Best,
Erick

> On May 3, 2019, at 4:22 AM, shruti suri <er...@gmail.com> wrote:
> 
> Hi,
> 
> My log size is growing larger and it take most of the space. Please suggest
> how to handle this. Also Is there a way for log cleanup other than on
> startup as my servers didn't restart daily and the size keep on increasing.
> 
> 
> log4j.properties
> 
> #  Logging level
> solr.log=/var/log/solr
> log4j.rootLogger=INFO, file, CONSOLE
> 
> log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
> 
> log4j.appender.CONSOLE.layout=org.apache.log4j.EnhancedPatternLayout
> log4j.appender.CONSOLE.layout.ConversionPattern=%-4r %-5p (%t)
> [%X{collection} %X{shard} %X{replica} %X{core}] %c{1.} %m%n
> 
> #- size rotation with log cleanup.
> log4j.appender.file=org.apache.log4j.RollingFileAppender
> log4j.appender.file.MaxFileSize=10MB
> log4j.appender.file.MaxBackupIndex=10
> 
> #- File to log to and log format
> log4j.appender.file.File=${solr.log}/solr.log
> log4j.appender.file.layout=org.apache.log4j.EnhancedPatternLayout
> log4j.appender.file.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss.SSS}
> %-5p (%t) [%X{collection} %X{shard} %X{replica} %X{core}] %c{1.} %m%n
> 
> log4j.logger.org.apache.zookeeper=WARN
> log4j.logger.org.apache.hadoop=WARN
> 
> # set to INFO to enable infostream log messages
> log4j.logger.org.apache.solr.update.LoggingInfoStream=OFF
> 
> Thanks
> Shruti
> 
> 
> 
> 
> 
> 
> -----
> Regards
> Shruti
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html