You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Vijay Ram <ne...@live.com> on 2013/11/19 03:07:53 UTC

ERROR org.apache.solr.servlet.SolrDispatchFilter â null:org.apache.solr.common.SolrException: SolrCore 'ecps-shard1-replica-1' is not available due to init failure: Could not start JMX monitoring

Dear All,
I am looking for your support on this, recently we have added a two new
fileds in the scheam.xml file. After this additon, I have restarted the
tomcat service, its throwing the below error message at console,
Can you please provide your support, 


Web Console error message here ->

SolrCore Initialization Failures
ecps-collection_shard3_replica1:
java.lang.RuntimeException:java.lang.RuntimeException: Could not start JMX
monitoring
ecps-shard1-replica-1:
java.lang.RuntimeException:java.lang.RuntimeException: Could not start JMX
monitoring
Please check your logs for more information 


Error message for Log here --.


569324 [http-bio-8080-exec-10] ERROR
org.apache.solr.servlet.SolrDispatchFilter  â
null:org.apache.solr.common.SolrException: SolrCore 'ecps-shard1-replica-1'
is not available due to init failure: Could not start JMX monitoring
        at
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
243)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
158)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
FilterChain.java:243)
        at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
ain.java:210)
        at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
va:222)
        at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
va:123)
        at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171
)
        at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
        at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
        at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
:118)
        at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
        at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce
ssor.java:1023)
        at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac
tProtocol.java:589)
        at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:
310)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
va:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9
08)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: Could not start JMX monitoring
        at
org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:103)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:713)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
        at
org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:270)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:655)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        ... 3 more
Caused by: java.io.IOException: Cannot bind to URL
[rmi://localhost:9999/solr]: javax.naming.ServiceUnavailableException [Root
exception is java.rmi.ConnectException: Connection refused to host:
localhost; nested exception is:
        java.net.ConnectException: Connection refused]
        at
javax.management.remote.rmi.RMIConnectorServer.newIOException(RMIConnectorSe
rver.java:804)
        at
javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
:417)
        at
org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:98)
        ... 14 more
Caused by: javax.naming.ServiceUnavailableException [Root exception is
java.rmi.ConnectException: Connection refused to host: localhost; nested
exception is:
        java.net.ConnectException: Connection refused]
        at
com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:126)
        at
com.sun.jndi.toolkit.url.GenericURLContext.bind(GenericURLContext.java:208)
        at javax.naming.InitialContext.bind(InitialContext.java:400)
        at
javax.management.remote.rmi.RMIConnectorServer.bind(RMIConnectorServer.java:
625)
        at
javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
:412)
        ... 15 more
Caused by: java.rmi.ConnectException: Connection refused to host: localhost;
nested exception is:
        java.net.ConnectException: Connection refused
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
        at
sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
        at
sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
        at
com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:120)
        ... 19 more
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at java.net.Socket.connect(Socket.java:478)
        at java.net.Socket.<init>(Socket.java:375)
        at java.net.Socket.<init>(Socket.java:189)
        at
sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketF
actory.java:22)
        at
sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketF
actory.java:128)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
        ... 24 more

629320 [http-bio-8080-exec-1] ERROR
org.apache.solr.servlet.SolrDispatchFilter  â
null:org.apache.solr.common.SolrException: SolrCore
'ecps-collection_shard3_replica1' is not available due to init failure:
Could not start JMX monitoring
        at
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
243)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
158)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
FilterChain.java:243)
        at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
ain.java:210)
        at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
va:222)
        at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
va:123)
        at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171
)
        at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
        at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
        at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
:118)
        at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
        at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce
ssor.java:1023)
        at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac
tProtocol.java:589)
        at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:
310)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
va:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9
08)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: Could not start JMX monitoring
        at
org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:103)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:713)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
        at
org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:270)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:655)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        ... 3 more
Caused by: java.io.IOException: Cannot bind to URL
[rmi://localhost:9999/solr]: javax.naming.ServiceUnavailableException [Root
exception is java.rmi.ConnectException: Connection refused to host:
localhost; nested exception is:
        java.net.ConnectException: Connection refused]
        at
javax.management.remote.rmi.RMIConnectorServer.newIOException(RMIConnectorSe
rver.java:804)
        at
javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
:417)
        at
org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:98)
        ... 14 more
Caused by: javax.naming.ServiceUnavailableException [Root exception is
java.rmi.ConnectException: Connection refused to host: localhost; nested
exception is:
        java.net.ConnectException: Connection refused]
        at
com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:126)
        at
com.sun.jndi.toolkit.url.GenericURLContext.bind(GenericURLContext.java:208)
        at javax.naming.InitialContext.bind(InitialContext.java:400)
        at
javax.management.remote.rmi.RMIConnectorServer.bind(RMIConnectorServer.java:
625)
        at
javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
:412)
        ... 15 more
Caused by: java.rmi.ConnectException: Connection refused to host: localhost;
nested exception is:
        java.net.ConnectException: Connection refused
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
        at
sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
        at
sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
        at
com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:120)
        ... 19 more
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at java.net.Socket.connect(Socket.java:478)
        at java.net.Socket.<init>(Socket.java:375)
        at java.net.Socket.<init>(Socket.java:189)
        at
sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketF
actory.java:22)
        at
sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketF
actory.java:128)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
        ... 24 more

629324 [http-bio-8080-exec-6] ERROR
org.apache.solr.servlet.SolrDispatchFilter  â
null:org.apache.solr.common.SolrException: SolrCore 'ecps-shard1-replica-1'
is not available due to init failure: Could not start JMX monitoring
        at
org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
243)
        at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
158)
        at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
FilterChain.java:243)
        at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
ain.java:210)
        at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
va:222)
        at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
va:123)
        at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171
)
        at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
        at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
        at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
:118)
        at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
        at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce
ssor.java:1023)
        at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac
tProtocol.java:589)
        at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:
310)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
va:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9
08)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: Could not start JMX monitoring
        at
org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:103)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:713)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
        at
org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:270)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:655)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        ... 3 more
Caused by: java.io.IOException: Cannot bind to URL
[rmi://localhost:9999/solr]: javax.naming.ServiceUnavailableException [Root
exception is java.rmi.ConnectException: Connection refused to host:
localhost; nested exception is:
        java.net.ConnectException: Connection refused]
        at
javax.management.remote.rmi.RMIConnectorServer.newIOException(RMIConnectorSe
rver.java:804)
        at
javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
:417)
        at
org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:98)
        ... 14 more
Caused by: javax.naming.ServiceUnavailableException [Root exception is
java.rmi.ConnectException: Connection refused to host: localhost; nested
exception is:
        java.net.ConnectException: Connection refused]
        at
com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:126)
        at
com.sun.jndi.toolkit.url.GenericURLContext.bind(GenericURLContext.java:208)
        at javax.naming.InitialContext.bind(InitialContext.java:400)
        at
javax.management.remote.rmi.RMIConnectorServer.bind(RMIConnectorServer.java:
625)
        at
javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
:412)
        ... 15 more
Caused by: java.rmi.ConnectException: Connection refused to host: localhost;
nested exception is:
        java.net.ConnectException: Connection refused
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
        at
sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
        at
sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
        at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
        at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
        at
com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:120)
        ... 19 more
Caused by: java.net.ConnectException: Connection refused
       at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at
java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at java.net.Socket.connect(Socket.java:478)
        at java.net.Socket.<init>(Socket.java:375)
        at java.net.Socket.<init>(Socket.java:189)
        at
sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketF
actory.java:22)
        at
sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketF
actory.java:128)
        at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
        ... 24 more

1088004 [http-bio-8080-exec-2] INFO
org.apache.solr.servlet.SolrDispatchFilter  â [admin] webapp=null
path=/admin/cores params={indexInfo=false&_=1384824919936&wt=json} status=0
QTime=1
1088060 [http-bio-8080-exec-2] INFO  org.apache.solr.core.SolrCore  â
[log-collection_shard2_replica1] webapp=/solr path=/admin/system
params={_=1384824919983&wt=json} status=0 QTime=9
1125995 [http-bio-8080-exec-3] INFO
org.apache.solr.servlet.SolrDispatchFilter  â [admin] webapp=null
path=/admin/cores params={indexInfo=false&_=1384824957923&wt=json} status=0
QTime=1
1126041 [http-bio-8080-exec-6] INFO  org.apache.solr.core.SolrCore  â
[log-collection_shard2_replica1] webapp=/solr path=/admin/system
params={_=1384824957969&wt=json} status=0 QTime=7
2090453 [http-bio-8080-exec-7] INFO
org.apache.solr.servlet.SolrDispatchFilter  â [admin] webapp=null
path=/admin/cores params={indexInfo=false&_=1384825922277&wt=json} status=0
QTime=1
2090650 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  â
[log-collection_shard2_replica1] webapp=/solr path=/admin/system
params={_=1384825922514&wt=json} status=0 QTime=8
2102689 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  â
[shard1-replica-1] webapp=/solr path=/admin/file/
params={file=admin-extra.menu-top.html&_=1384825934543&contentType=text/html
;charset%3Dutf-8} status=0 QTime=7
2102795 [http-bio-8080-exec-5] INFO  org.apache.solr.core.SolrCore  â
[shard1-replica-1] webapp=/solr path=/admin/file/
params={file=admin-extra.menu-bottom.html&_=1384825934544&contentType=text/h
tml;charset%3Dutf-8} status=0 QTime=4
2102935 [http-bio-8080-exec-4] INFO  org.apache.solr.core.SolrCore  â
[shard1-replica-1] webapp=/solr path=/admin/luke
params={numTerms=0&_=1384825934794&show=index&wt=json} status=0 QTime=15
2102943 [http-bio-8080-exec-5] INFO  org.apache.solr.core.SolrCore  â
[shard1-replica-1] webapp=/solr path=/replication
params={command=details&_=1384825934798&wt=json} status=0 QTime=16
2103052 [http-bio-8080-exec-10] INFO  org.apache.solr.core.SolrCore  â
[shard1-replica-1] webapp=/solr path=/admin/file/
params={file=admin-extra.html&_=1384825934801} status=0 QTime=4
2103060 [http-bio-8080-exec-6] INFO  org.apache.solr.core.SolrCore  â
[shard1-replica-1] webapp=/solr path=/admin/ping
params={action=status&_=1384825934803&wt=json} status=503 QTime=6


Re: ERROR org.apache.solr.servlet.SolrDispatchFilter â null:org.apache.solr.common.SolrException: SolrCore 'ecps-shard1-replica-1' is not available due to init failure: Could not start JMX monitoring

Posted by Erick Erickson <er...@gmail.com>.
First thing I would do is look for solr logging. In Tomcat,
that goes to catalina.out unless you've configured it
differently.

"What was the last thing you changed?" Apparently schema.xml.
I hypothesize that you've introduced, say, a syntax error when
you added the two fields and what you're seeing is the result of
the core not loading.

A quick test of that would to put your schema.xml file in the
stock Solr (stand-alone) distro collection1/conf and fire it up. My
bet would be that you'll see an immediate failure and a clue what
is wrong with your schema. Just use the stock Jetty startup, no
need to set this up in Tomcat to test.

I could be totally off base, but the last thing I changed before
I see a problem is the first place I look.

Best,
Erick


On Mon, Nov 18, 2013 at 9:07 PM, Vijay Ram <ne...@live.com> wrote:

> Dear All,
> I am looking for your support on this, recently we have added a two new
> fileds in the scheam.xml file. After this additon, I have restarted the
> tomcat service, its throwing the below error message at console,
> Can you please provide your support,
>
>
> Web Console error message here ->
>
> SolrCore Initialization Failures
> ecps-collection_shard3_replica1:
> java.lang.RuntimeException:java.lang.RuntimeException: Could not start JMX
> monitoring
> ecps-shard1-replica-1:
> java.lang.RuntimeException:java.lang.RuntimeException: Could not start JMX
> monitoring
> Please check your logs for more information
>
>
> Error message for Log here --.
>
>
> 569324 [http-bio-8080-exec-10] ERROR
> org.apache.solr.servlet.SolrDispatchFilter  â
> null:org.apache.solr.common.SolrException: SolrCore 'ecps-shard1-replica-1'
> is not available due to init failure: Could not start JMX monitoring
>         at
> org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
> 243)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
> 158)
>         at
>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
> FilterChain.java:243)
>         at
>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
> ain.java:210)
>         at
>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
> va:222)
>         at
>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
> va:123)
>         at
>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171
> )
>         at
>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>         at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
>         at
>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
> :118)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
>         at
>
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce
> ssor.java:1023)
>         at
>
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac
> tProtocol.java:589)
>         at
>
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:
> 310)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
> va:886)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9
> 08)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.RuntimeException: Could not start JMX monitoring
>         at
> org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:103)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:713)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
>         at
> org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:270)
>         at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:655)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         ... 3 more
> Caused by: java.io.IOException: Cannot bind to URL
> [rmi://localhost:9999/solr]: javax.naming.ServiceUnavailableException [Root
> exception is java.rmi.ConnectException: Connection refused to host:
> localhost; nested exception is:
>         java.net.ConnectException: Connection refused]
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.newIOException(RMIConnectorSe
> rver.java:804)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
> :417)
>         at
> org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:98)
>         ... 14 more
> Caused by: javax.naming.ServiceUnavailableException [Root exception is
> java.rmi.ConnectException: Connection refused to host: localhost; nested
> exception is:
>         java.net.ConnectException: Connection refused]
>         at
> com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:126)
>         at
> com.sun.jndi.toolkit.url.GenericURLContext.bind(GenericURLContext.java:208)
>         at javax.naming.InitialContext.bind(InitialContext.java:400)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.bind(RMIConnectorServer.java:
> 625)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
> :412)
>         ... 15 more
> Caused by: java.rmi.ConnectException: Connection refused to host:
> localhost;
> nested exception is:
>         java.net.ConnectException: Connection refused
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
>         at
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
>         at
> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
>         at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
>         at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
>         at
> com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:120)
>         ... 19 more
> Caused by: java.net.ConnectException: Connection refused
>         at java.net.PlainSocketImpl.socketConnect(Native Method)
>         at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>         at
> java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>         at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>         at java.net.Socket.connect(Socket.java:529)
>         at java.net.Socket.connect(Socket.java:478)
>         at java.net.Socket.<init>(Socket.java:375)
>         at java.net.Socket.<init>(Socket.java:189)
>         at
>
> sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketF
> actory.java:22)
>         at
>
> sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketF
> actory.java:128)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
>         ... 24 more
>
> 629320 [http-bio-8080-exec-1] ERROR
> org.apache.solr.servlet.SolrDispatchFilter  â
> null:org.apache.solr.common.SolrException: SolrCore
> 'ecps-collection_shard3_replica1' is not available due to init failure:
> Could not start JMX monitoring
>         at
> org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
> 243)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
> 158)
>         at
>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
> FilterChain.java:243)
>         at
>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
> ain.java:210)
>         at
>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
> va:222)
>         at
>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
> va:123)
>         at
>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171
> )
>         at
>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>         at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
>         at
>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
> :118)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
>         at
>
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce
> ssor.java:1023)
>         at
>
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac
> tProtocol.java:589)
>         at
>
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:
> 310)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
> va:886)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9
> 08)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.RuntimeException: Could not start JMX monitoring
>         at
> org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:103)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:713)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
>         at
> org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:270)
>         at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:655)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         ... 3 more
> Caused by: java.io.IOException: Cannot bind to URL
> [rmi://localhost:9999/solr]: javax.naming.ServiceUnavailableException [Root
> exception is java.rmi.ConnectException: Connection refused to host:
> localhost; nested exception is:
>         java.net.ConnectException: Connection refused]
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.newIOException(RMIConnectorSe
> rver.java:804)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
> :417)
>         at
> org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:98)
>         ... 14 more
> Caused by: javax.naming.ServiceUnavailableException [Root exception is
> java.rmi.ConnectException: Connection refused to host: localhost; nested
> exception is:
>         java.net.ConnectException: Connection refused]
>         at
> com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:126)
>         at
> com.sun.jndi.toolkit.url.GenericURLContext.bind(GenericURLContext.java:208)
>         at javax.naming.InitialContext.bind(InitialContext.java:400)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.bind(RMIConnectorServer.java:
> 625)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
> :412)
>         ... 15 more
> Caused by: java.rmi.ConnectException: Connection refused to host:
> localhost;
> nested exception is:
>         java.net.ConnectException: Connection refused
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
>         at
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
>         at
> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
>         at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
>         at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
>         at
> com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:120)
>         ... 19 more
> Caused by: java.net.ConnectException: Connection refused
>         at java.net.PlainSocketImpl.socketConnect(Native Method)
>         at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>         at
> java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>         at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>         at java.net.Socket.connect(Socket.java:529)
>         at java.net.Socket.connect(Socket.java:478)
>         at java.net.Socket.<init>(Socket.java:375)
>         at java.net.Socket.<init>(Socket.java:189)
>         at
>
> sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketF
> actory.java:22)
>         at
>
> sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketF
> actory.java:128)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
>         ... 24 more
>
> 629324 [http-bio-8080-exec-6] ERROR
> org.apache.solr.servlet.SolrDispatchFilter  â
> null:org.apache.solr.common.SolrException: SolrCore 'ecps-shard1-replica-1'
> is not available due to init failure: Could not start JMX monitoring
>         at
> org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:860)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
> 243)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:
> 158)
>         at
>
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application
> FilterChain.java:243)
>         at
>
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh
> ain.java:210)
>         at
>
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja
> va:222)
>         at
>
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja
> va:123)
>         at
>
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171
> )
>         at
>
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>         at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
>         at
>
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java
> :118)
>         at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
>         at
>
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce
> ssor.java:1023)
>         at
>
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac
> tProtocol.java:589)
>         at
>
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:
> 310)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja
> va:886)
>         at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:9
> 08)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.RuntimeException: Could not start JMX monitoring
>         at
> org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:103)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:713)
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
>         at
> org.apache.solr.core.ZkContainer.createFromZk(ZkContainer.java:270)
>         at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:655)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:364)
>         at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:356)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
>         at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         ... 3 more
> Caused by: java.io.IOException: Cannot bind to URL
> [rmi://localhost:9999/solr]: javax.naming.ServiceUnavailableException [Root
> exception is java.rmi.ConnectException: Connection refused to host:
> localhost; nested exception is:
>         java.net.ConnectException: Connection refused]
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.newIOException(RMIConnectorSe
> rver.java:804)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
> :417)
>         at
> org.apache.solr.core.JmxMonitoredMap.<init>(JmxMonitoredMap.java:98)
>         ... 14 more
> Caused by: javax.naming.ServiceUnavailableException [Root exception is
> java.rmi.ConnectException: Connection refused to host: localhost; nested
> exception is:
>         java.net.ConnectException: Connection refused]
>         at
> com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:126)
>         at
> com.sun.jndi.toolkit.url.GenericURLContext.bind(GenericURLContext.java:208)
>         at javax.naming.InitialContext.bind(InitialContext.java:400)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.bind(RMIConnectorServer.java:
> 625)
>         at
>
> javax.management.remote.rmi.RMIConnectorServer.start(RMIConnectorServer.java
> :412)
>         ... 15 more
> Caused by: java.rmi.ConnectException: Connection refused to host:
> localhost;
> nested exception is:
>         java.net.ConnectException: Connection refused
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:601)
>         at
> sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:198)
>         at
> sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:184)
>         at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:322)
>         at sun.rmi.registry.RegistryImpl_Stub.bind(Unknown Source)
>         at
> com.sun.jndi.rmi.registry.RegistryContext.bind(RegistryContext.java:120)
>         ... 19 more
> Caused by: java.net.ConnectException: Connection refused
>        at java.net.PlainSocketImpl.socketConnect(Native Method)
>         at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>         at
> java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
>         at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>         at java.net.Socket.connect(Socket.java:529)
>         at java.net.Socket.connect(Socket.java:478)
>         at java.net.Socket.<init>(Socket.java:375)
>         at java.net.Socket.<init>(Socket.java:189)
>         at
>
> sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketF
> actory.java:22)
>         at
>
> sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketF
> actory.java:128)
>         at
> sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:595)
>         ... 24 more
>
> 1088004 [http-bio-8080-exec-2] INFO
> org.apache.solr.servlet.SolrDispatchFilter  â [admin] webapp=null
> path=/admin/cores params={indexInfo=false&_=1384824919936&wt=json} status=0
> QTime=1
> 1088060 [http-bio-8080-exec-2] INFO  org.apache.solr.core.SolrCore  â
> [log-collection_shard2_replica1] webapp=/solr path=/admin/system
> params={_=1384824919983&wt=json} status=0 QTime=9
> 1125995 [http-bio-8080-exec-3] INFO
> org.apache.solr.servlet.SolrDispatchFilter  â [admin] webapp=null
> path=/admin/cores params={indexInfo=false&_=1384824957923&wt=json} status=0
> QTime=1
> 1126041 [http-bio-8080-exec-6] INFO  org.apache.solr.core.SolrCore  â
> [log-collection_shard2_replica1] webapp=/solr path=/admin/system
> params={_=1384824957969&wt=json} status=0 QTime=7
> 2090453 [http-bio-8080-exec-7] INFO
> org.apache.solr.servlet.SolrDispatchFilter  â [admin] webapp=null
> path=/admin/cores params={indexInfo=false&_=1384825922277&wt=json} status=0
> QTime=1
> 2090650 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  â
> [log-collection_shard2_replica1] webapp=/solr path=/admin/system
> params={_=1384825922514&wt=json} status=0 QTime=8
> 2102689 [http-bio-8080-exec-7] INFO  org.apache.solr.core.SolrCore  â
> [shard1-replica-1] webapp=/solr path=/admin/file/
>
> params={file=admin-extra.menu-top.html&_=1384825934543&contentType=text/html
> ;charset%3Dutf-8} status=0 QTime=7
> 2102795 [http-bio-8080-exec-5] INFO  org.apache.solr.core.SolrCore  â
> [shard1-replica-1] webapp=/solr path=/admin/file/
>
> params={file=admin-extra.menu-bottom.html&_=1384825934544&contentType=text/h
> tml;charset%3Dutf-8} status=0 QTime=4
> 2102935 [http-bio-8080-exec-4] INFO  org.apache.solr.core.SolrCore  â
> [shard1-replica-1] webapp=/solr path=/admin/luke
> params={numTerms=0&_=1384825934794&show=index&wt=json} status=0 QTime=15
> 2102943 [http-bio-8080-exec-5] INFO  org.apache.solr.core.SolrCore  â
> [shard1-replica-1] webapp=/solr path=/replication
> params={command=details&_=1384825934798&wt=json} status=0 QTime=16
> 2103052 [http-bio-8080-exec-10] INFO  org.apache.solr.core.SolrCore  â
> [shard1-replica-1] webapp=/solr path=/admin/file/
> params={file=admin-extra.html&_=1384825934801} status=0 QTime=4
> 2103060 [http-bio-8080-exec-6] INFO  org.apache.solr.core.SolrCore  â
> [shard1-replica-1] webapp=/solr path=/admin/ping
> params={action=status&_=1384825934803&wt=json} status=503 QTime=6
>
>