You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by ~$alpha` <la...@gmail.com> on 2017/02/20 13:06:34 UTC
Sorl 6 with jetty issues
Issues with solr settings while migrating from solr 4.0 to solr6.0.
Issue Faced: My CPU consumption goes to unacceptable levels. ie. load on
solr4.0 is between 6 to 10 while the load on solr 6 reaches 100 and since
its the production i rolled back quickly.
My Solr4 setting
- Running on tomcat
- JVM Memory : 16GB
- 24 core cpu
- JVM settings :
- JVM Runtime Java HotSpot(TM) 64-Bit Server VM (24.45-b08)
- Processors 24
- Args : Paths mentioned here
**My Solr6 setting**
- Running on jetty
- JVM Memory : 20GB
- 32 core cpu
- JVM settings :
- Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_45 25.45-b02
- Processors 32
- Args
- DSTOP.KEY=solrrocks
- DSTOP.PORT=7983
- Djetty.home=/usr/local/solr-6.4.1/server-Djetty.port=8983
-
Dlog4j.configuration=file:/usr/local/solr-6.4.1/example/resources/log4j.properties
-
Dsolr.install.dir=/usr/local/solr-6.4.1-Dsolr.log.dir=/usr/local/solr-6.4.1/example/techproducts/solr/../logs
- Dsolr.log.muteconsole
-
Dsolr.solr.home=/usr/local/solr-6.4.1/example/techproducts/solr-Duser.timezone=US/Eastern
- XX:+AggressiveOpts
- XX:+CMSParallelRemarkEnabled
- XX:+CMSScavengeBeforeRemark
- XX:+ParallelRefProcEnabled
- XX:+PrintGCApplicationStoppedTime
- XX:+PrintGCDateStamps
- XX:+PrintGCDetails
- XX:+PrintGCTimeStamps
- XX:+PrintHeapAtGC
- XX:+PrintTenuringDistribution
- XX:+UseCMSInitiatingOccupancyOnly
- XX:+UseConcMarkSweepGC
- XX:+UseGCLogFileRotation
- XX:-UseSuperWord
- XX:CMSFullGCsBeforeCompaction=1
- XX:CMSInitiatingOccupancyFraction=70
- XX:CMSMaxAbortablePrecleanTime=6000
- XX:CMSTriggerPermRatio=80
- XX:GCLogFileSize=20M
- XX:MaxTenuringThreshold=8
- XX:NewRatio=2
- XX:NumberOfGCLogFiles=9
- XX:OnOutOfMemoryError=/usr/local/solr-6.4.1/bin/oom_solr.sh 8983
/usr/local/solr-6.4.1/example/techproducts/solr/../logs
- XX:PretenureSizeThreshold=64m
- XX:SurvivorRatio=15
-
XX:TargetSurvivorRatio=90-Xloggc:/usr/local/solr-6.4.1/example/techproducts/solr/../logs/solr_gc.log-Xms21g-Xmx21g-Xss256k-verbose:gc
What i looking for
My guess its related to gc setting of jetty as i am not expert in
jetty(java8).please help how to tune these settings. Also how should i
chosoe these values or how to to debug these issue ?
--
View this message in context: http://lucene.472066.n3.nabble.com/Sorl-6-with-jetty-issues-tp4321291.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Sorl 6 with jetty issues
Posted by ~$alpha` <la...@gmail.com>.
Face similar issue on solr 6.1.0
--
View this message in context: http://lucene.472066.n3.nabble.com/Sorl-6-with-jetty-issues-tp4321291p4321308.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Sorl 6 with jetty issues
Posted by Walter Underwood <wa...@gmail.com>.
Use Solr 6.3.0. For us, 6.4.x is using about 10X as much CPU under heavy query load.
wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/ (my blog)
> On Feb 20, 2017, at 5:11 AM, Michael Kuhlmann <ku...@solr.info> wrote:
>
> This may be related to SOLR-10130.
>
> Am 20.02.2017 um 14:06 schrieb ~$alpha`:
>> Issues with solr settings while migrating from solr 4.0 to solr6.0.
>>
>> Issue Faced: My CPU consumption goes to unacceptable levels. ie. load on
>> solr4.0 is between 6 to 10 while the load on solr 6 reaches 100 and since
>> its the production i rolled back quickly.
>>
>> My Solr4 setting
>>
>> - Running on tomcat
>> - JVM Memory : 16GB
>> - 24 core cpu
>> - JVM settings :
>> - JVM Runtime Java HotSpot(TM) 64-Bit Server VM (24.45-b08)
>> - Processors 24
>> - Args : Paths mentioned here
>>
>>
>> **My Solr6 setting**
>>
>> - Running on jetty
>> - JVM Memory : 20GB
>> - 32 core cpu
>> - JVM settings :
>> - Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_45 25.45-b02
>> - Processors 32
>> - Args
>> - DSTOP.KEY=solrrocks
>> - DSTOP.PORT=7983
>> - Djetty.home=/usr/local/solr-6.4.1/server-Djetty.port=8983
>> -
>> Dlog4j.configuration=file:/usr/local/solr-6.4.1/example/resources/log4j.properties
>> -
>> Dsolr.install.dir=/usr/local/solr-6.4.1-Dsolr.log.dir=/usr/local/solr-6.4.1/example/techproducts/solr/../logs
>> - Dsolr.log.muteconsole
>> -
>> Dsolr.solr.home=/usr/local/solr-6.4.1/example/techproducts/solr-Duser.timezone=US/Eastern
>> - XX:+AggressiveOpts
>> - XX:+CMSParallelRemarkEnabled
>> - XX:+CMSScavengeBeforeRemark
>> - XX:+ParallelRefProcEnabled
>> - XX:+PrintGCApplicationStoppedTime
>> - XX:+PrintGCDateStamps
>> - XX:+PrintGCDetails
>> - XX:+PrintGCTimeStamps
>> - XX:+PrintHeapAtGC
>> - XX:+PrintTenuringDistribution
>> - XX:+UseCMSInitiatingOccupancyOnly
>> - XX:+UseConcMarkSweepGC
>> - XX:+UseGCLogFileRotation
>> - XX:-UseSuperWord
>> - XX:CMSFullGCsBeforeCompaction=1
>> - XX:CMSInitiatingOccupancyFraction=70
>> - XX:CMSMaxAbortablePrecleanTime=6000
>> - XX:CMSTriggerPermRatio=80
>> - XX:GCLogFileSize=20M
>> - XX:MaxTenuringThreshold=8
>> - XX:NewRatio=2
>> - XX:NumberOfGCLogFiles=9
>> - XX:OnOutOfMemoryError=/usr/local/solr-6.4.1/bin/oom_solr.sh 8983
>> /usr/local/solr-6.4.1/example/techproducts/solr/../logs
>> - XX:PretenureSizeThreshold=64m
>> - XX:SurvivorRatio=15
>> -
>> XX:TargetSurvivorRatio=90-Xloggc:/usr/local/solr-6.4.1/example/techproducts/solr/../logs/solr_gc.log-Xms21g-Xmx21g-Xss256k-verbose:gc
>> What i looking for
>>
>> My guess its related to gc setting of jetty as i am not expert in
>> jetty(java8).please help how to tune these settings. Also how should i
>> chosoe these values or how to to debug these issue ?
>>
>>
>>
>> --
>> View this message in context: http://lucene.472066.n3.nabble.com/Sorl-6-with-jetty-issues-tp4321291.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
Re: Sorl 6 with jetty issues
Posted by Michael Kuhlmann <ku...@solr.info>.
This may be related to SOLR-10130.
Am 20.02.2017 um 14:06 schrieb ~$alpha`:
> Issues with solr settings while migrating from solr 4.0 to solr6.0.
>
> Issue Faced: My CPU consumption goes to unacceptable levels. ie. load on
> solr4.0 is between 6 to 10 while the load on solr 6 reaches 100 and since
> its the production i rolled back quickly.
>
> My Solr4 setting
>
> - Running on tomcat
> - JVM Memory : 16GB
> - 24 core cpu
> - JVM settings :
> - JVM Runtime Java HotSpot(TM) 64-Bit Server VM (24.45-b08)
> - Processors 24
> - Args : Paths mentioned here
>
>
> **My Solr6 setting**
>
> - Running on jetty
> - JVM Memory : 20GB
> - 32 core cpu
> - JVM settings :
> - Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_45 25.45-b02
> - Processors 32
> - Args
> - DSTOP.KEY=solrrocks
> - DSTOP.PORT=7983
> - Djetty.home=/usr/local/solr-6.4.1/server-Djetty.port=8983
> -
> Dlog4j.configuration=file:/usr/local/solr-6.4.1/example/resources/log4j.properties
> -
> Dsolr.install.dir=/usr/local/solr-6.4.1-Dsolr.log.dir=/usr/local/solr-6.4.1/example/techproducts/solr/../logs
> - Dsolr.log.muteconsole
> -
> Dsolr.solr.home=/usr/local/solr-6.4.1/example/techproducts/solr-Duser.timezone=US/Eastern
> - XX:+AggressiveOpts
> - XX:+CMSParallelRemarkEnabled
> - XX:+CMSScavengeBeforeRemark
> - XX:+ParallelRefProcEnabled
> - XX:+PrintGCApplicationStoppedTime
> - XX:+PrintGCDateStamps
> - XX:+PrintGCDetails
> - XX:+PrintGCTimeStamps
> - XX:+PrintHeapAtGC
> - XX:+PrintTenuringDistribution
> - XX:+UseCMSInitiatingOccupancyOnly
> - XX:+UseConcMarkSweepGC
> - XX:+UseGCLogFileRotation
> - XX:-UseSuperWord
> - XX:CMSFullGCsBeforeCompaction=1
> - XX:CMSInitiatingOccupancyFraction=70
> - XX:CMSMaxAbortablePrecleanTime=6000
> - XX:CMSTriggerPermRatio=80
> - XX:GCLogFileSize=20M
> - XX:MaxTenuringThreshold=8
> - XX:NewRatio=2
> - XX:NumberOfGCLogFiles=9
> - XX:OnOutOfMemoryError=/usr/local/solr-6.4.1/bin/oom_solr.sh 8983
> /usr/local/solr-6.4.1/example/techproducts/solr/../logs
> - XX:PretenureSizeThreshold=64m
> - XX:SurvivorRatio=15
> -
> XX:TargetSurvivorRatio=90-Xloggc:/usr/local/solr-6.4.1/example/techproducts/solr/../logs/solr_gc.log-Xms21g-Xmx21g-Xss256k-verbose:gc
> What i looking for
>
> My guess its related to gc setting of jetty as i am not expert in
> jetty(java8).please help how to tune these settings. Also how should i
> chosoe these values or how to to debug these issue ?
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Sorl-6-with-jetty-issues-tp4321291.html
> Sent from the Solr - User mailing list archive at Nabble.com.