You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Mark Fenbers <ma...@noaa.gov> on 2015/09/05 21:56:26 UTC

ghostly config issues

The log data is from solr.log.  There are a couple of puzzling items.

 1. On line 2015-09-05 19:19:56.678, it shows a "lib" subdir
    (/localapps/dev/EventLog/lib) which doesn't exist and isn't
    specified anywhere that I can find (lots of "find | grep"
    commands).  I did, at one point, specify this in a version of
    solrconfig.xml that I was experimenting with, but have since removed
    that long ago.  The fact that this still appears is strange, as if
    it is using an old cache or something.
 2. On line 2015-09-05 19:19:57.455, it shows a .../conf/conf/... and I
    can't figure out where the double "conf" is coming from.
    /localapps/dev/EventLog/solr/conf/conf/solrconfig.xml doesn't exist,
    and solrconfig.xml resides in
    /localapps/dev/EventLog/solr/conf/ (just one conf) where it belongs!

Can someone give me clues how to uncover these ghostly configuration 
settings?
Mark


2015-09-05 19:19:54.416 INFO  (main) [   ] o.e.j.u.log Logging 
initialized @902ms
2015-09-05 19:19:54.815 INFO  (main) [   ] o.e.j.s.Server 
jetty-9.2.11.v20150529
2015-09-05 19:19:54.851 WARN  (main) [   ] o.e.j.s.h.RequestLogHandler 
!RequestLog
2015-09-05 19:19:54.856 INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider 
Deployment monitor [file:/localapps/dev/solr-5.3.0/server/contexts/] at 
interval 0
2015-09-05 19:19:56.027 INFO  (main) [   ] 
o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not 
find org.apache.jasper.servlet.JspServlet
2015-09-05 19:19:56.057 WARN  (main) [   ] o.e.j.s.SecurityHandler 
ServletContext@o.e.j.w.WebAppContext@51cc87e3{/solr,file:/localapps/dev/solr-5.3.0/server/solr-webapp/webapp/,STARTING}{/localapps/dev/solr-5.3.0/server/solr-webapp/webapp} 
has uncovered http methods for path: /
2015-09-05 19:19:56.076 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init(): WebAppClassLoader=784350225@2ec03c11
2015-09-05 19:19:56.110 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
JNDI not configured for solr (NoInitialContextEx)
2015-09-05 19:19:56.111 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
using system property solr.solr.home: /localapps/dev/EventLog/
2015-09-05 19:19:56.116 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
new SolrResourceLoader for directory: '/localapps/dev/EventLog/'
2015-09-05 19:19:56.449 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading 
container configuration from /localapps/dev/EventLog/solr.xml
2015-09-05 19:19:56.621 INFO  (main) [   ] o.a.s.c.CoresLocator 
Config-defined core root directory: /localapps/dev/EventLog
2015-09-05 19:19:56.677 INFO  (main) [   ] o.a.s.c.CoreContainer New 
CoreContainer 748968642
2015-09-05 19:19:56.678 INFO  (main) [   ] o.a.s.c.CoreContainer Loading 
cores into CoreContainer [instanceDir=/localapps/dev/EventLog/]
2015-09-05 19:19:56.678 INFO  (main) [   ] o.a.s.c.CoreContainer loading 
shared library: /localapps/dev/EventLog/lib
2015-09-05 19:19:56.678 WARN  (main) [   ] o.a.s.c.SolrResourceLoader 
Can't find (or read) directory to add to classloader: lib (resolved as: 
/localapps/dev/EventLog/lib).
2015-09-05 19:19:56.721 INFO  (main) [   ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
2015-09-05 19:19:57.120 INFO  (main) [   ] o.a.s.u.UpdateShardHandler 
Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
2015-09-05 19:19:57.129 INFO  (main) [   ] o.a.s.l.LogWatcher SLF4J impl 
is org.slf4j.impl.Log4jLoggerFactory
2015-09-05 19:19:57.132 INFO  (main) [   ] o.a.s.l.LogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
2015-09-05 19:19:57.139 INFO  (main) [   ] o.a.s.c.CoreContainer 
Security conf doesn't exist. Skipping setup for authorization module.
2015-09-05 19:19:57.140 INFO  (main) [   ] o.a.s.c.CoreContainer No 
authentication plugin used.
2015-09-05 19:19:57.225 INFO  (main) [   ] o.a.s.c.CoresLocator Looking 
for core definitions underneath /localapps/dev/EventLog
2015-09-05 19:19:57.409 INFO  (main) [   ] o.a.s.c.SolrCore Created 
CoreDescriptor: {name=EventLog, config=solrconfig.xml, transient=false, 
schema=schema.xml, loadOnStartup=true, 
configSetProperties=configsetprops.json, 
instanceDir=/localapps/dev/EventLog/solr/conf, 
absoluteInstDir=/localapps/dev/EventLog/solr/conf/, 
coreNodeName=core_node5, dataDir=/localapps/dev/EventLog}
2015-09-05 19:19:57.411 INFO  (main) [   ] o.a.s.c.CoresLocator Found 
core EventLog in /localapps/dev/EventLog/solr/conf/
2015-09-05 19:19:57.415 INFO  (main) [   ] o.a.s.c.CoresLocator Found 1 
core definitions
2015-09-05 19:19:57.425 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/localapps/dev/EventLog/solr/conf/'
2015-09-05 19:19:57.426 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter 
user.dir=/localapps/dev/solr-5.3.0/server
2015-09-05 19:19:57.426 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
2015-09-05 19:19:57.455 ERROR (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.CoreContainer Error creating core [EventLog]: Could not load 
conf for core EventLog: Error loading solr config from 
/localapps/dev/EventLog/solr/conf/conf/solrconfig.xml
org.apache.solr.common.SolrException: Could not load conf for core 
EventLog: Error loading solr config from 
/localapps/dev/EventLog/solr/conf/conf/solrconfig.xml
     at 
org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:80)
     at org.apache.solr.core.CoreContainer.create(CoreContainer.java:725)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:447)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:438)
     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
     at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210)
     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Error loading solr 
config from /localapps/dev/EventLog/solr/conf/conf/solrconfig.xml
     at 
org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:186)
     at 
org.apache.solr.core.ConfigSetService.createSolrConfig(ConfigSetService.java:94)
     at 
org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:74)
     ... 8 more
Caused by: org.apache.solr.core.SolrResourceNotFoundException: Can't 
find resource 'solrconfig.xml' in classpath or 
'/localapps/dev/EventLog/solr/conf/conf'
     at 
org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
     at 
org.apache.solr.core.SolrResourceLoader.openConfig(SolrResourceLoader.java:309)
     at org.apache.solr.core.Config.<init>(Config.java:122)
     at org.apache.solr.core.Config.<init>(Config.java:92)
     at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:201)
     at 
org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:178)
     ... 10 more
2015-09-05 19:19:57.467 ERROR (coreContainerWorkExecutor-2-thread-1) [   
] o.a.s.c.CoreContainer Error waiting for SolrCore to be created
java.util.concurrent.ExecutionException: 
org.apache.solr.common.SolrException: Unable to create core [EventLog]
     at java.util.concurrent.FutureTask.report(FutureTask.java:122)
     at java.util.concurrent.FutureTask.get(FutureTask.java:188)
     at org.apache.solr.core.CoreContainer$2.run(CoreContainer.java:476)
     at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
     at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210)
     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Unable to create core 
[EventLog]
     at org.apache.solr.core.CoreContainer.create(CoreContainer.java:741)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:447)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:438)
     ... 5 more
Caused by: org.apache.solr.common.SolrException: Could not load conf for 
core EventLog: Error loading solr config from 
/localapps/dev/EventLog/solr/conf/conf/solrconfig.xml
     at 
org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:80)
     at org.apache.solr.core.CoreContainer.create(CoreContainer.java:725)
     ... 7 more
Caused by: org.apache.solr.common.SolrException: Error loading solr 
config from /localapps/dev/EventLog/solr/conf/conf/solrconfig.xml
     at 
org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:186)
     at 
org.apache.solr.core.ConfigSetService.createSolrConfig(ConfigSetService.java:94)
     at 
org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:74)
     ... 8 more
Caused by: org.apache.solr.core.SolrResourceNotFoundException: Can't 
find resource 'solrconfig.xml' in classpath or 
'/localapps/dev/EventLog/solr/conf/conf'
     at 
org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
     at 
org.apache.solr.core.SolrResourceLoader.openConfig(SolrResourceLoader.java:309)
     at org.apache.solr.core.Config.<init>(Config.java:122)
     at org.apache.solr.core.Config.<init>(Config.java:92)
     at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:201)
     at 
org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:178)
     ... 10 more
2015-09-05 19:19:57.467 INFO  (main) [   ] o.e.j.s.h.ContextHandler 
Started 
o.e.j.w.WebAppContext@51cc87e3{/solr,file:/localapps/dev/solr-5.3.0/server/solr-webapp/webapp/,AVAILABLE}{/localapps/dev/solr-5.3.0/server/solr-webapp/webapp}
2015-09-05 19:19:57.500 INFO  (main) [   ] o.e.j.s.ServerConnector 
Started ServerConnector@7b33b1a1{HTTP/1.1}{0.0.0.0:8983}
2015-09-05 19:19:57.501 INFO  (main) [   ] o.e.j.s.Server Started @3992ms
2015-09-05 19:21:43.834 INFO  (qtp1079648883-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/cores 
params={indexInfo=false&_=1441480903794&wt=json} status=0 QTime=33
2015-09-05 19:21:43.935 INFO  (qtp1079648883-28) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/system 
params={_=1441480903903&wt=json} status=0 QTime=28


Re: ghostly config issues

Posted by Mark Fenbers <ma...@noaa.gov>.
On 9/7/2015 4:52 PM, Shawn Heisey wrote:
>
> The only files that should be in server/lib is jetty and servlet jars.
> The only files that should be in server/lib/ext is logging jars (slf4j,
> log4j, etc).
>
> In the server/lib directory on Solr 5.3.0:
>
> ext/
> javax.servlet-api-3.1.0.jar
> jetty-continuation-9.2.11.v20150529.jar
> jetty-deploy-9.2.11.v20150529.jar
> jetty-http-9.2.11.v20150529.jar
> jetty-io-9.2.11.v20150529.jar
> jetty-jmx-9.2.11.v20150529.jar
> jetty-rewrite-9.2.11.v20150529.jar
> jetty-security-9.2.11.v20150529.jar
> jetty-server-9.2.11.v20150529.jar
> jetty-servlet-9.2.11.v20150529.jar
> jetty-servlets-9.2.11.v20150529.jar
> jetty-util-9.2.11.v20150529.jar
> jetty-webapp-9.2.11.v20150529.jar
> jetty-xml-9.2.11.v20150529.jar
>
> In the server/lib/ext directory on Solr 5.3.0:
>
> jcl-over-slf4j-1.7.7.jar
> jul-to-slf4j-1.7.7.jar
> log4j-1.2.17.jar
> slf4j-api-1.7.7.jar
> slf4j-log4j12-1.7.7.jar
>
>
Excellent!!  Based on this info, I decided to blow away the Solr 
installation and reinstall from the tarball file.  After "tar -xzvf", I 
created a "lib" subdir under /localapps/dev/EventLog and copied my 
postgres jar and the dist/dataImportHandler jar into the "lib".  I 
restarted solr and "Viola!"  All works as designed!  It even indexed my 
entire database on the first try of a full-import! Woohooo!

Thanks for your help.  I would have abandoned this project without your 
persistence.

Mark

Re: ghostly config issues

Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/7/2015 5:31 AM, Mark Fenbers wrote:
> On 9/6/2015 4:25 PM, Shawn Heisey wrote:
> I did as you prescribed.  Being my solr.xml did not have a "sharedLib"
> line in it,  I added
> 
> <str name="sharedLib">libtest</str>
> 
> between the <solr> and the <solrcloud> tags because I'm not running in
> cloud mode -- at least, not yet.
> 
> I also renamed <installDir>/server/lib to <installDir>/server/libtest,
> then restarted solr.  This time, solr did not start at all and nothing
> was written to solr.log.  In solr.xml, I also tried the following (one
> at a time):

The only files that should be in server/lib is jetty and servlet jars.
The only files that should be in server/lib/ext is logging jars (slf4j,
log4j, etc).

In the server/lib directory on Solr 5.3.0:

ext/
javax.servlet-api-3.1.0.jar
jetty-continuation-9.2.11.v20150529.jar
jetty-deploy-9.2.11.v20150529.jar
jetty-http-9.2.11.v20150529.jar
jetty-io-9.2.11.v20150529.jar
jetty-jmx-9.2.11.v20150529.jar
jetty-rewrite-9.2.11.v20150529.jar
jetty-security-9.2.11.v20150529.jar
jetty-server-9.2.11.v20150529.jar
jetty-servlet-9.2.11.v20150529.jar
jetty-servlets-9.2.11.v20150529.jar
jetty-util-9.2.11.v20150529.jar
jetty-webapp-9.2.11.v20150529.jar
jetty-xml-9.2.11.v20150529.jar

In the server/lib/ext directory on Solr 5.3.0:

jcl-over-slf4j-1.7.7.jar
jul-to-slf4j-1.7.7.jar
log4j-1.2.17.jar
slf4j-api-1.7.7.jar
slf4j-log4j12-1.7.7.jar

Renaming server/lib to server/libtest like you did will prevent Jetty
(and by extension, Solr) from starting.  Your extra jars should not go
in either of these two directories.  These are part of the *program*
install for Solr, and should not be modified, because doing so will
complicate upgrades.

> <str name="sharedLib">server/libtest</str> <str
> name="sharedLib">/localapps/dev/solr-5.3.0/server/libtest</str> <str
> name="sharedLib">${sharedLib:libtest}</str> ...all with the same
> no-start results. Instead of removing the sharedLib line from solr.xml,
> I left it like this: <str name="sharedLib">${sharedLib:}</str> and
> renamed my libtest back to lib Doing so allowed Solr to restart, albeit
> with the return of DataImportHandler error, as before.

The lib directory that I have been talking about is the one in the solr
home, not in server.  Your solr home is /localapps/dev/EventLog ... so
/localapps/dev/EventLog/lib should be renamed to
/localapps/dev/EventLog/libtest, and sharedLib should be just "libtest"
... not "server/libtest".  There needs to be exactly one sharedLib entry
in solr.xml.  You have mentioned three of them above.

> So does this tell us that we are barking up the wrong tree??  Does this
> mean it *is* a multiple jar version problem?  If so, there may be
> multiple jars (caused by my copying things around to try to get this
> working, and my lack of knowledge of where all the places are that it
> looks for jars), but they would be the same versions.

I did not see any evidence of multiple or conflicting jars in the log
that you sent before, just jars loading twice, which SOLR-6188 will fix
for everyone in 5.4.  By renaming the lib directory in the solr home to
libtest and adding a sharedLib config to explicitly load that directory,
we are making a similar change to the patch on SOLR-6188 through
configuration alone.

Make sure that server/lib and server/lib/ext are clean, only containing
the specific jars I mentioned above.

Thanks,
Shawn


Re: ghostly config issues

Posted by Mark Fenbers <ma...@noaa.gov>.
On 9/6/2015 4:25 PM, Shawn Heisey wrote:
>
> If we assume that it cannot be a problem with multiple jar versions,
> which sounds pretty reasonable, then I think SOLR-6188 is probably to blame.
>
> https://issues.apache.org/jira/browse/SOLR-6188
>
> I think you should try this as a troubleshooting step:  Rename that lib
> directory where you have the jars to something like libtest and
> add/change the sharedLib setting in your solr.xml to libtest.  The
> following line should do it:
>
>    <str name="sharedLib">libtest</str>
>
> See this wiki page for more information about solr.xml:
>
> https://wiki.apache.org/solr/Solr.xml%204.4%20and%20beyond
>
> If this troubleshooting step fixes the problem, then I think it's
> definitely SOLR-6188, and you have a viable workaround that should
> continue to work even after SOLR-6188 is fixed.
>
> Thanks,
> Shawn

I did as you prescribed.  Being my solr.xml did not have a "sharedLib" 
line in it,  I added

<str name="sharedLib">libtest</str>

between the <solr> and the <solrcloud> tags because I'm not running in 
cloud mode -- at least, not yet.

I also renamed <installDir>/server/lib to <installDir>/server/libtest, 
then restarted solr.  This time, solr did not start at all and nothing 
was written to solr.log.  In solr.xml, I also tried the following (one 
at a time):

<str name="sharedLib">server/libtest</str> <str 
name="sharedLib">/localapps/dev/solr-5.3.0/server/libtest</str> <str 
name="sharedLib">${sharedLib:libtest}</str> ...all with the same 
no-start results. Instead of removing the sharedLib line from solr.xml, 
I left it like this: <str name="sharedLib">${sharedLib:}</str> and 
renamed my libtest back to lib Doing so allowed Solr to restart, albeit 
with the return of DataImportHandler error, as before.

So does this tell us that we are barking up the wrong tree??  Does this 
mean it *is* a multiple jar version problem?  If so, there may be 
multiple jars (caused by my copying things around to try to get this 
working, and my lack of knowledge of where all the places are that it 
looks for jars), but they would be the same versions.

Unfortunately, the piece of Solr that is not working for me 
(DataImportHandler) is the very piece I need for my project. :-((

Mark


Re: ghostly config issues

Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/6/2015 11:27 AM, Mark Fenbers wrote:
> This issue still persists. :-((
> 
> I have moved all the jars to <instanceDir>/lib.  I have commented out
> all <lib> references in solrconfig.xml.  I have moved all jars to
> <solrhome>/lib and removed them from <instanceDir>/lib.  But nothing has
> changed with any of these steps.
> 
> I only heard of Solr/Lucene about a week ago, and so I downloaded the
> package since then.  If I have multiple versions of things, then it
> would have had to come packaged that way because I only
> downloaded/installed it once.
> 
> In my solrconfig.xml, I reference a file for my particular database
> details in a <requestHandler> tag.  In it, I deliberately misspelled the
> class name because I wanted to see if I got a different error.  I did,
> so I know that my issue isn't because it can't find the class.  (I since
> changed it back.)  The contents of my db-data-config.xml file are
> attached (below).  Do you see anything obviously incorrect about my
> config?  Could this be where the source of the DataImportHandler error
> originates?

If we assume that it cannot be a problem with multiple jar versions,
which sounds pretty reasonable, then I think SOLR-6188 is probably to blame.

https://issues.apache.org/jira/browse/SOLR-6188

I think you should try this as a troubleshooting step:  Rename that lib
directory where you have the jars to something like libtest and
add/change the sharedLib setting in your solr.xml to libtest.  The
following line should do it:

  <str name="sharedLib">libtest</str>

See this wiki page for more information about solr.xml:

https://wiki.apache.org/solr/Solr.xml%204.4%20and%20beyond

If this troubleshooting step fixes the problem, then I think it's
definitely SOLR-6188, and you have a viable workaround that should
continue to work even after SOLR-6188 is fixed.

Thanks,
Shawn


Re: ghostly config issues

Posted by Mark Fenbers <ma...@noaa.gov>.
On 9/6/2015 12:00 PM, Shawn Heisey wrote:
> It looks like you have jars in the solrhome/lib directory, which is
> good.  You probably don't need the dataimporthandler jar for -extras if
> you just want to load from a database.
>
> It does appear that you also have <lib> directives in your
> solrconfig.xml, which are loading after the dataimport jars load.
> Loading jars from multiple locations complicates the classloader, and
> has been known to cause a huge number of problems.  I don't know if it
> is why you are having a class cast exception, but it would be my first
> guess.  Since you are using the solrhome/lib directory, you should put
> ALL jars that you need there, remove all jars from any instanceDir/lib
> directory, and also remove all <lib> configuration elements from your
> solrconfig.xml.
>
> It looks like the jars that are loading are for Solr 5.3.0.  Do you have
> any jars from another Solr or Lucene version in a directory that might
> somehow be on the classpath -- loaded into the system java directories
> via operating system packages or something?
>
> There *might* be a problem with jars loading twice.  That appears to be
> causing other problems, described in this issue:
>
> https://issues.apache.org/jira/browse/SOLR-6188
>
> If loading the dataimport jar twice IS causing this problem, then you
> could probably fix it by removing the jars from the solrhome/lib
> directory and loading them with <lib> elements in solrconfig.xml instead
> -- this is the opposite of the advice I gave you earlier in this message.
>
> I do not like to load jars that way, because each core ends up loading
> the jars into its own classloader, so for me they would get loaded
> multiple times ... but it might be a viable workaround, especially if
> you are not going to have a large number of cores.
>
> Thanks,
> Shawn

This issue still persists. :-((

I have moved all the jars to <instanceDir>/lib.  I have commented out 
all <lib> references in solrconfig.xml.  I have moved all jars to 
<solrhome>/lib and removed them from <instanceDir>/lib.  But nothing has 
changed with any of these steps.

I only heard of Solr/Lucene about a week ago, and so I downloaded the 
package since then.  If I have multiple versions of things, then it 
would have had to come packaged that way because I only 
downloaded/installed it once.

In my solrconfig.xml, I reference a file for my particular database 
details in a <requestHandler> tag.  In it, I deliberately misspelled the 
class name because I wanted to see if I got a different error.  I did, 
so I know that my issue isn't because it can't find the class.  (I since 
changed it back.)  The contents of my db-data-config.xml file are 
attached (below).  Do you see anything obviously incorrect about my 
config?  Could this be where the source of the DataImportHandler error 
originates?

Thanks!
Mark

<dataConfig>
     <dataSource driver="org.postgresql.Driver" 
url="jdbc:postgresql://dx1f/OHRFC" user="awips" />
     <document>
         <entity name="eventlogtext" query="SELECT * FROM eventlogtext"
                 deltaQuery="SELECT posttime FROM eventlogtext WHERE 
lastmodtime > '${dataimporter.last_index_time}'">
             <entity name="categorytypes" query="SELECT catname FROM 
categorytypes WHERE catid='${eventlogtext.category}'">
             </entity>
         </entity>
     </document>
</dataConfig>



Re: ghostly config issues

Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/6/2015 5:28 AM, Mark Fenbers wrote:
> Yes, indeed.  Moving core.properties up to the parent directory did the
> trick.  I also created a lib subdir and copied the postgres jar file and
> the Solr import handlers into it -- according to the advice from Kevin
> Lee responding to my "Config error mystery" post.  This brought me back
> to my original problem, which is shown in the log data below (java stack
> trace).  Perhaps is it an issue with multiple versions of the same jar
> as you suggested in your response to "Config error mystery", but the log
> (below) does not seem to indicate that it has found a duplicate jar.  
> Though Solr is running, I am not able to create an index from my
> database data.
> 
> What do you make of the information in the log file?

It looks like you have jars in the solrhome/lib directory, which is
good.  You probably don't need the dataimporthandler jar for -extras if
you just want to load from a database.

It does appear that you also have <lib> directives in your
solrconfig.xml, which are loading after the dataimport jars load.
Loading jars from multiple locations complicates the classloader, and
has been known to cause a huge number of problems.  I don't know if it
is why you are having a class cast exception, but it would be my first
guess.  Since you are using the solrhome/lib directory, you should put
ALL jars that you need there, remove all jars from any instanceDir/lib
directory, and also remove all <lib> configuration elements from your
solrconfig.xml.

It looks like the jars that are loading are for Solr 5.3.0.  Do you have
any jars from another Solr or Lucene version in a directory that might
somehow be on the classpath -- loaded into the system java directories
via operating system packages or something?

There *might* be a problem with jars loading twice.  That appears to be
causing other problems, described in this issue:

https://issues.apache.org/jira/browse/SOLR-6188

If loading the dataimport jar twice IS causing this problem, then you
could probably fix it by removing the jars from the solrhome/lib
directory and loading them with <lib> elements in solrconfig.xml instead
-- this is the opposite of the advice I gave you earlier in this message.

I do not like to load jars that way, because each core ends up loading
the jars into its own classloader, so for me they would get loaded
multiple times ... but it might be a viable workaround, especially if
you are not going to have a large number of cores.

Thanks,
Shawn


Re: ghostly config issues

Posted by Mark Fenbers <ma...@noaa.gov>.
On 9/5/2015 10:40 PM, Shawn Heisey wrote:
> Your solr home is /localapps/dev/EventLog ... Solr automatically loads
> any jar found in the lib directory in the solr home, so it is attempting
> to use /localapps/dev/EventLog/lib for the classloader.
>
> For the other things you noticed, I believe I know why that is happening
> too.
>
> This SHOULD be the structure of a core instanceDir, if "collection1" is
> the name of that directory.  This is highly simplified and missing
> things you would likely find in the directory structure:
>
> collection1/
> |-core.properties
> |-conf/
> |--solrconfig.xml
> |--schema.xml
> |--stopwords.txt
> |-data/
> |--index/
> |---[Lucene index files go here]
>
> The directory with the core.properties file is the instanceDir.  The
> instanceDir is supposed to contain a conf directory and a data directory.
>
> It appears that you have this of structure in your solr home (leaving a
> lot of things out on this one):
>
> solr/
> |-conf/
> |--core.properties
> |--solrconfig.xml
> |--schema.xml
>
> This is why it is looking in a path that has "conf" twice -- it is going
> to the instanceDir (where it found core.properties) and assuming that it
> will find a conf directory there.  The conf directory is not supposed to
> be the instanceDir.
>
> Thanks,
> Shawn

Yes, indeed.  Moving core.properties up to the parent directory did the 
trick.  I also created a lib subdir and copied the postgres jar file and 
the Solr import handlers into it -- according to the advice from Kevin 
Lee responding to my "Config error mystery" post.  This brought me back 
to my original problem, which is shown in the log data below (java stack 
trace).  Perhaps is it an issue with multiple versions of the same jar 
as you suggested in your response to "Config error mystery", but the log 
(below) does not seem to indicate that it has found a duplicate jar.   
Though Solr is running, I am not able to create an index from my 
database data.

What do you make of the information in the log file?

Mark

2015-09-06 11:02:30.674 INFO  (main) [   ] o.e.j.u.log Logging 
initialized @853ms
2015-09-06 11:02:31.075 INFO  (main) [   ] o.e.j.s.Server 
jetty-9.2.11.v20150529
2015-09-06 11:02:31.110 WARN  (main) [   ] o.e.j.s.h.RequestLogHandler 
!RequestLog
2015-09-06 11:02:31.115 INFO  (main) [   ] o.e.j.d.p.ScanningAppProvider 
Deployment monitor [file:/localapps/dev/solr-5.3.0/server/contexts/] at 
interval 0
2015-09-06 11:02:32.261 INFO  (main) [   ] 
o.e.j.w.StandardDescriptorProcessor NO JSP Support for /solr, did not 
find org.apache.jasper.servlet.JspServlet
2015-09-06 11:02:32.290 WARN  (main) [   ] o.e.j.s.SecurityHandler 
ServletContext@o.e.j.w.WebAppContext@27cd61b{/solr,file:/localapps/dev/solr-5.3.0/server/solr-webapp/webapp/,STARTING}{/localapps/dev/solr-5.3.0/server/solr-webapp/webapp} 
has uncovered http methods for path: /
2015-09-06 11:02:32.308 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init(): WebAppClassLoader=365733477@15cca665
2015-09-06 11:02:32.343 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
JNDI not configured for solr (NoInitialContextEx)
2015-09-06 11:02:32.344 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
using system property solr.solr.home: /localapps/dev/EventLog/
2015-09-06 11:02:32.349 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
new SolrResourceLoader for directory: '/localapps/dev/EventLog/'
2015-09-06 11:02:32.355 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
Adding 'file:/localapps/dev/EventLog/lib/pg.jar' to classloader
2015-09-06 11:02:32.355 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
Adding 
'file:/localapps/dev/EventLog/lib/solr-dataimporthandler-5.3.0.jar' to 
classloader
2015-09-06 11:02:32.356 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
Adding 
'file:/localapps/dev/EventLog/lib/solr-dataimporthandler-extras-5.3.0.jar' 
to classloader
2015-09-06 11:02:32.700 INFO  (main) [   ] o.a.s.c.SolrXmlConfig Loading 
container configuration from /localapps/dev/EventLog/solr.xml
2015-09-06 11:02:32.871 INFO  (main) [   ] o.a.s.c.CoresLocator 
Config-defined core root directory: /localapps/dev/EventLog
2015-09-06 11:02:32.928 INFO  (main) [   ] o.a.s.c.CoreContainer New 
CoreContainer 574322827
2015-09-06 11:02:32.928 INFO  (main) [   ] o.a.s.c.CoreContainer Loading 
cores into CoreContainer [instanceDir=/localapps/dev/EventLog/]
2015-09-06 11:02:32.929 INFO  (main) [   ] o.a.s.c.CoreContainer loading 
shared library: /localapps/dev/EventLog/lib
2015-09-06 11:02:32.931 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
Adding 'file:/localapps/dev/EventLog/lib/pg.jar' to classloader
2015-09-06 11:02:32.931 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
Adding 
'file:/localapps/dev/EventLog/lib/solr-dataimporthandler-5.3.0.jar' to 
classloader
2015-09-06 11:02:32.931 INFO  (main) [   ] o.a.s.c.SolrResourceLoader 
Adding 
'file:/localapps/dev/EventLog/lib/solr-dataimporthandler-extras-5.3.0.jar' 
to classloader
2015-09-06 11:02:32.983 INFO  (main) [   ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
2015-09-06 11:02:33.395 INFO  (main) [   ] o.a.s.u.UpdateShardHandler 
Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
2015-09-06 11:02:33.401 INFO  (main) [   ] o.a.s.l.LogWatcher SLF4J impl 
is org.slf4j.impl.Log4jLoggerFactory
2015-09-06 11:02:33.403 INFO  (main) [   ] o.a.s.l.LogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
2015-09-06 11:02:33.407 INFO  (main) [   ] o.a.s.c.CoreContainer 
Security conf doesn't exist. Skipping setup for authorization module.
2015-09-06 11:02:33.408 INFO  (main) [   ] o.a.s.c.CoreContainer No 
authentication plugin used.
2015-09-06 11:02:33.484 INFO  (main) [   ] o.a.s.c.CoresLocator Looking 
for core definitions underneath /localapps/dev/EventLog
2015-09-06 11:02:33.591 INFO  (main) [   ] o.a.s.c.SolrCore Created 
CoreDescriptor: {name=EventLog, config=solrconfig.xml, transient=false, 
schema=schema.xml, loadOnStartup=true, 
configSetProperties=configsetprops.json, 
instanceDir=/localapps/dev/EventLog/solr, 
absoluteInstDir=/localapps/dev/EventLog/solr/, coreNodeName=core_node5, 
dataDir=/localapps/dev/EventLog}
2015-09-06 11:02:33.593 INFO  (main) [   ] o.a.s.c.CoresLocator Found 
core EventLog in /localapps/dev/EventLog/solr/
2015-09-06 11:02:33.594 INFO  (main) [   ] o.a.s.c.CoresLocator Found 1 
core definitions
2015-09-06 11:02:33.605 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/localapps/dev/EventLog/solr/'
2015-09-06 11:02:33.606 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter 
user.dir=/localapps/dev/solr-5.3.0/server
2015-09-06 11:02:33.607 INFO  (main) [   ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
2015-09-06 11:02:33.650 INFO  (main) [   ] o.e.j.s.h.ContextHandler 
Started 
o.e.j.w.WebAppContext@27cd61b{/solr,file:/localapps/dev/solr-5.3.0/server/solr-webapp/webapp/,AVAILABLE}{/localapps/dev/solr-5.3.0/server/solr-webapp/webapp}
2015-09-06 11:02:33.680 INFO  (main) [   ] o.e.j.s.ServerConnector 
Started ServerConnector@48cf768b{HTTP/1.1}{0.0.0.0:8983}
2015-09-06 11:02:33.681 INFO  (main) [   ] o.e.j.s.Server Started @3864ms
2015-09-06 11:02:33.765 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrConfig current version of requestparams : 0
2015-09-06 11:02:33.794 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrConfig Adding specified lib dirs to ClassLoader
2015-09-06 11:02:33.805 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar' 
to classloader
2015-09-06 11:02:33.805 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar' 
to classloader
2015-09-06 11:02:33.806 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/aspectjrt-1.8.0.jar' 
to classloader
2015-09-06 11:02:33.807 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/bcmail-jdk15-1.45.jar' 
to classloader
2015-09-06 11:02:33.808 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/bcprov-jdk15-1.45.jar' 
to classloader
2015-09-06 11:02:33.809 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/boilerpipe-1.1.0.jar' 
to classloader
2015-09-06 11:02:33.810 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/commons-compress-1.8.1.jar' 
to classloader
2015-09-06 11:02:33.810 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/fontbox-1.8.8.jar' to 
classloader
2015-09-06 11:02:33.811 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/icu4j-54.1.jar' 
to classloader
2015-09-06 11:02:33.812 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/isoparser-1.0.2.jar' 
to classloader
2015-09-06 11:02:33.813 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/java-libpst-0.8.1.jar' 
to classloader
2015-09-06 11:02:33.814 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/jdom-1.0.jar' to 
classloader
2015-09-06 11:02:33.814 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/jempbox-1.8.8.jar' to 
classloader
2015-09-06 11:02:33.815 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/jmatio-1.0.jar' 
to classloader
2015-09-06 11:02:33.816 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/juniversalchardet-1.0.3.jar' 
to classloader
2015-09-06 11:02:33.816 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/metadata-extractor-2.6.2.jar' 
to classloader
2015-09-06 11:02:33.817 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/pdfbox-1.8.8.jar' 
to classloader
2015-09-06 11:02:33.817 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/poi-3.11.jar' to 
classloader
2015-09-06 11:02:33.818 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/poi-ooxml-3.11.jar' 
to classloader
2015-09-06 11:02:33.818 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/poi-ooxml-schemas-3.11.jar' 
to classloader
2015-09-06 11:02:33.819 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/poi-scratchpad-3.11.jar' 
to classloader
2015-09-06 11:02:33.820 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/rome-1.0.jar' to 
classloader
2015-09-06 11:02:33.820 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/tagsoup-1.2.1.jar' to 
classloader
2015-09-06 11:02:33.821 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/tika-core-1.7.jar' to 
classloader
2015-09-06 11:02:33.821 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/tika-java7-1.7.jar' 
to classloader
2015-09-06 11:02:33.822 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/tika-parsers-1.7.jar' 
to classloader
2015-09-06 11:02:33.822 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/tika-xmp-1.7.jar' 
to classloader
2015-09-06 11:02:33.823 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/vorbis-java-core-0.6.jar' 
to classloader
2015-09-06 11:02:33.824 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/vorbis-java-tika-0.6.jar' 
to classloader
2015-09-06 11:02:33.824 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/xercesImpl-2.9.1.jar' 
to classloader
2015-09-06 11:02:33.825 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/xmlbeans-2.6.0.jar' 
to classloader
2015-09-06 11:02:33.825 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/xmpcore-5.1.2.jar' to 
classloader
2015-09-06 11:02:33.826 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/extraction/lib/xz-1.5.jar' to 
classloader
2015-09-06 11:02:33.830 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/dist/solr-cell-5.3.0.jar' to classloader
2015-09-06 11:02:33.834 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/attributes-binder-1.2.1.jar' 
to classloader
2015-09-06 11:02:33.835 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/carrot2-mini-3.9.0.jar' 
to classloader
2015-09-06 11:02:33.835 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/hppc-0.5.2.jar' 
to classloader
2015-09-06 11:02:33.836 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/jackson-core-asl-1.9.13.jar' 
to classloader
2015-09-06 11:02:33.836 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/jackson-mapper-asl-1.9.13.jar' 
to classloader
2015-09-06 11:02:33.837 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/mahout-collections-1.0.jar' 
to classloader
2015-09-06 11:02:33.838 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/mahout-math-0.6.jar' 
to classloader
2015-09-06 11:02:33.838 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/clustering/lib/simple-xml-2.7.jar' 
to classloader
2015-09-06 11:02:33.841 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/dist/solr-clustering-5.3.0.jar' to 
classloader
2015-09-06 11:02:33.843 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/langid/lib/jsonic-1.2.7.jar' to 
classloader
2015-09-06 11:02:33.844 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/langid/lib/langdetect-1.1-20120112.jar' 
to classloader
2015-09-06 11:02:33.847 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/dist/solr-langid-5.3.0.jar' to classloader
2015-09-06 11:02:33.850 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/velocity/lib/commons-beanutils-1.8.3.jar' 
to classloader
2015-09-06 11:02:33.851 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/velocity/lib/commons-collections-3.2.1.jar' 
to classloader
2015-09-06 11:02:33.852 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/velocity/lib/velocity-1.7.jar' 
to classloader
2015-09-06 11:02:33.853 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/contrib/velocity/lib/velocity-tools-2.0.jar' 
to classloader
2015-09-06 11:02:33.858 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/localapps/dev/solr-5.3.0/dist/solr-velocity-5.3.0.jar' to classloader
2015-09-06 11:02:34.319 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.3.0
2015-09-06 11:02:34.657 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
2015-09-06 11:02:34.683 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.s.IndexSchema Reading Solr Schema from 
/localapps/dev/EventLog/solr/conf/managed-schema
2015-09-06 11:02:34.861 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.s.IndexSchema [EventLog] Schema name=example-data-driven-schema
2015-09-06 11:02:36.176 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.s.IndexSchema unique key field: id
2015-09-06 11:02:36.873 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file 
currency.xml
2015-09-06 11:02:36.892 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file 
currency.xml
2015-09-06 11:02:37.046 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming 
default properties: Can't find resource 'configsetprops.json' in 
classpath or '/localapps/dev/EventLog/solr/conf'
2015-09-06 11:02:37.048 INFO  (coreLoadExecutor-6-thread-1) [   ] 
o.a.s.c.CoreContainer Creating SolrCore 'EventLog' using configuration 
from instancedir /localapps/dev/EventLog/solr/
2015-09-06 11:02:37.050 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore solr.NRTCachingDirectoryFactory
2015-09-06 11:02:37.083 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore [[EventLog] ] Opening new SolrCore at 
[/localapps/dev/EventLog/solr/], dataDir=[null]
2015-09-06 11:02:37.086 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.JmxMonitoredMap No JMX servers found, not exposing 
Solr information with JMX.
2015-09-06 11:02:37.095 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore [[EventLog] ] Added SolrEventListener for 
newSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}]
2015-09-06 11:02:37.096 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore [[EventLog] ] Added SolrEventListener for 
firstSearcher: [org.apache.solr.core.QuerySenderListener{queries=[]}]
2015-09-06 11:02:37.121 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory return new directory for 
/localapps/dev/EventLog
2015-09-06 11:02:37.122 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore New index directory detected: old=null 
new=/localapps/dev/EventLog/index/
2015-09-06 11:02:37.124 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory return new directory for 
/localapps/dev/EventLog/index
2015-09-06 11:02:37.166 INFO 
(OldIndexDirectoryCleanupThreadForCore-EventLog) [   x:EventLog] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
EventLog in /localapps/dev/EventLog/
2015-09-06 11:02:37.174 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.PluginBag queryResponseWriter : 'velocity' created 
with startup=lazy
2015-09-06 11:02:37.184 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
2015-09-06 11:02:37.419 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "add-unknown-fields-to-the-schema"
2015-09-06 11:02:37.594 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
2015-09-06 11:02:37.657 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
2015-09-06 11:02:37.662 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
2015-09-06 11:02:37.665 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
2015-09-06 11:02:37.666 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
2015-09-06 11:02:37.724 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore [EventLog]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@5693c7e8
2015-09-06 11:02:37.726 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.u.SolrCoreState Closing SolrCoreState
2015-09-06 11:02:37.726 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has 
reached 0 - closing IndexWriter
2015-09-06 11:02:37.726 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.SolrCore [EventLog] Closing main searcher on request.
2015-09-06 11:02:37.727 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory Closing 
NRTCachingDirectoryFactory - 2 directories currently being tracked
2015-09-06 11:02:37.728 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory looking to close 
/localapps/dev/EventLog 
[CachedDir<<refCount=0;path=/localapps/dev/EventLog;done=false>>]
2015-09-06 11:02:37.728 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory Closing directory: 
/localapps/dev/EventLog
2015-09-06 11:02:37.729 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory looking to close 
/localapps/dev/EventLog/index 
[CachedDir<<refCount=0;path=/localapps/dev/EventLog/index;done=false>>]
2015-09-06 11:02:37.729 INFO  (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CachingDirectoryFactory Closing directory: 
/localapps/dev/EventLog/index
2015-09-06 11:02:37.731 ERROR (coreLoadExecutor-6-thread-1) [ 
x:EventLog] o.a.s.c.CoreContainer Error creating core [EventLog]: Error 
Instantiating requestHandler, solr.DataImportHandler failed to 
instantiate org.apache.solr.request.SolrRequestHandler
org.apache.solr.common.SolrException: Error Instantiating 
requestHandler, solr.DataImportHandler failed to instantiate 
org.apache.solr.request.SolrRequestHandler
     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:820)
     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:659)
     at org.apache.solr.core.CoreContainer.create(CoreContainer.java:727)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:447)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:438)
     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
     at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210)
     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Error Instantiating 
requestHandler, solr.DataImportHandler failed to instantiate 
org.apache.solr.request.SolrRequestHandler
     at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:588)
     at org.apache.solr.core.PluginBag.createPlugin(PluginBag.java:122)
     at org.apache.solr.core.PluginBag.init(PluginBag.java:217)
     at 
org.apache.solr.core.RequestHandlers.initHandlersFromConfig(RequestHandlers.java:130)
     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:773)
     ... 9 more
Caused by: java.lang.ClassCastException: class 
org.apache.solr.handler.dataimport.DataImportHandler
     at java.lang.Class.asSubclass(Class.java:3208)
     at 
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:485)
     at 
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:422)
     at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:567)
     ... 13 more
2015-09-06 11:02:37.736 ERROR (coreContainerWorkExecutor-2-thread-1) [   
] o.a.s.c.CoreContainer Error waiting for SolrCore to be created
java.util.concurrent.ExecutionException: 
org.apache.solr.common.SolrException: Unable to create core [EventLog]
     at java.util.concurrent.FutureTask.report(FutureTask.java:122)
     at java.util.concurrent.FutureTask.get(FutureTask.java:188)
     at org.apache.solr.core.CoreContainer$2.run(CoreContainer.java:476)
     at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
     at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210)
     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: Unable to create core 
[EventLog]
     at org.apache.solr.core.CoreContainer.create(CoreContainer.java:741)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:447)
     at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:438)
     ... 5 more
Caused by: org.apache.solr.common.SolrException: Error Instantiating 
requestHandler, solr.DataImportHandler failed to instantiate 
org.apache.solr.request.SolrRequestHandler
     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:820)
     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:659)
     at org.apache.solr.core.CoreContainer.create(CoreContainer.java:727)
     ... 7 more
Caused by: org.apache.solr.common.SolrException: Error Instantiating 
requestHandler, solr.DataImportHandler failed to instantiate 
org.apache.solr.request.SolrRequestHandler
     at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:588)
     at org.apache.solr.core.PluginBag.createPlugin(PluginBag.java:122)
     at org.apache.solr.core.PluginBag.init(PluginBag.java:217)
     at 
org.apache.solr.core.RequestHandlers.initHandlersFromConfig(RequestHandlers.java:130)
     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:773)
     ... 9 more
Caused by: java.lang.ClassCastException: class 
org.apache.solr.handler.dataimport.DataImportHandler
     at java.lang.Class.asSubclass(Class.java:3208)
     at 
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:485)
     at 
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:422)
     at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:567)
     ... 13 more
2015-09-06 11:02:42.628 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/cores 
params={indexInfo=false&_=1441537362604&wt=json} status=0 QTime=18
2015-09-06 11:02:42.778 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/system 
params={_=1441537362722&wt=json} status=0 QTime=51
2015-09-06 11:04:04.300 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537444285&since=0&wt=json} status=0 QTime=11
2015-09-06 11:04:05.600 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/cores 
params={_=1441537445595&wt=json} status=0 QTime=0
2015-09-06 11:04:08.823 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537448818&since=0&wt=json} status=0 QTime=1
2015-09-06 11:04:18.854 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537458847&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:04:28.881 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537468874&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:04:38.899 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537478893&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:04:48.917 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537488911&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:04:58.935 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537498928&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:05:08.959 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537508952&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:05:18.979 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537518972&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:05:29.011 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537529005&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:05:39.029 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537539023&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:05:49.047 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537549040&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:05:59.075 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537559069&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:06:09.094 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537569087&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:06:19.112 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537579106&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:06:29.130 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537589124&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:06:39.148 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537599142&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:06:49.166 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537609159&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:06:59.184 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537619178&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:07:09.202 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537629195&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:07:19.220 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537639213&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:07:29.245 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537649238&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:07:39.284 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537659278&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:07:49.302 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537669295&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:07:59.319 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537679313&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:08:09.338 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537689332&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:08:19.363 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537699357&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:08:29.397 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537709390&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:08:39.415 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537719408&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:08:49.433 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537729427&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:08:59.452 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537739446&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:09:09.471 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537749464&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:09:19.495 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537759489&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:09:29.513 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537769507&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:09:39.539 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537779533&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:09:49.557 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537789550&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:09:59.576 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537799570&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:10:09.611 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537809588&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:10:19.637 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537819631&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:10:29.670 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537829663&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:10:39.699 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537839693&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:10:49.726 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537849718&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:10:59.747 INFO  (qtp1168422093-15) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537859741&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:11:09.765 INFO  (qtp1168422093-14) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537869759&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:11:19.786 INFO  (qtp1168422093-30) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537879780&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:11:29.809 INFO  (qtp1168422093-31) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537889803&since=1441537357736&wt=json} status=0 QTime=0
2015-09-06 11:11:39.826 INFO  (qtp1168422093-20) [   ] 
o.a.s.s.SolrDispatchFilter [admin] webapp=null path=/admin/info/logging 
params={_=1441537899821&since=1441537357736&wt=json} status=0 QTime=0


Re: ghostly config issues

Posted by Shawn Heisey <ap...@elyograg.org>.
On 9/5/2015 1:56 PM, Mark Fenbers wrote:
> The log data is from solr.log.  There are a couple of puzzling items.
> 
> 1. On line 2015-09-05 19:19:56.678, it shows a "lib" subdir
>    (/localapps/dev/EventLog/lib) which doesn't exist and isn't
>    specified anywhere that I can find (lots of "find | grep"
>    commands).  I did, at one point, specify this in a version of
>    solrconfig.xml that I was experimenting with, but have since removed
>    that long ago.  The fact that this still appears is strange, as if
>    it is using an old cache or something.
> 2. On line 2015-09-05 19:19:57.455, it shows a .../conf/conf/... and I
>    can't figure out where the double "conf" is coming from.
>    /localapps/dev/EventLog/solr/conf/conf/solrconfig.xml doesn't exist,
>    and solrconfig.xml resides in
>    /localapps/dev/EventLog/solr/conf/ (just one conf) where it belongs!

Your solr home is /localapps/dev/EventLog ... Solr automatically loads
any jar found in the lib directory in the solr home, so it is attempting
to use /localapps/dev/EventLog/lib for the classloader.

For the other things you noticed, I believe I know why that is happening
too.

This SHOULD be the structure of a core instanceDir, if "collection1" is
the name of that directory.  This is highly simplified and missing
things you would likely find in the directory structure:

collection1/
|-core.properties
|-conf/
|--solrconfig.xml
|--schema.xml
|--stopwords.txt
|-data/
|--index/
|---[Lucene index files go here]

The directory with the core.properties file is the instanceDir.  The
instanceDir is supposed to contain a conf directory and a data directory.

It appears that you have this of structure in your solr home (leaving a
lot of things out on this one):

solr/
|-conf/
|--core.properties
|--solrconfig.xml
|--schema.xml

This is why it is looking in a path that has "conf" twice -- it is going
to the instanceDir (where it found core.properties) and assuming that it
will find a conf directory there.  The conf directory is not supposed to
be the instanceDir.

Thanks,
Shawn