You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by William Pierce <ev...@hotmail.com> on 2013/12/22 17:51:50 UTC

Dataimport handler exception when migrating from 4.4 to 4.6. Help needed

Hello, all:

My configurations works nicely with solr 4.4. I am encountering a configuration error when I try to upgrade from 4.4 to 4.6.  All I did was the following:

a) Replace the 4.4 solr.war file with the 4.6 solr.war in the tomcat/lib folder. I am using version 6.0.36 of tomcat.
b) I replaced the solr-dataimporthandler-4.4.0.jar and solr-dataimporthandler-extras-4.4.0.jar with the corresponding 4.6 counterparts in the collection/lib folder.

I restarted tomcat.   I get the following stack trace (full log is also given below) – there are no other warnings/errors in my log.  I have gone through the 4.5 changes to see if I needed to add/modify my DIH configuration – but I am stymied.  Any help will be greatly appreciated.

ERROR - 2013-12-22 08:05:09.824; org.apache.solr.handler.dataimport.DataImportHandler; Exception while loading DataImporter
java.lang.NoSuchMethodError: org.apache.solr.core.SolrCore.getLatestSchema()Lorg/apache/solr/schema/IndexSchema;
    at org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:103)
    at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:103)
    at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:616)
    at org.apache.solr.core.SolrCore.<init>(SolrCore.java:816)
    at org.apache.solr.core.SolrCore.<init>(SolrCore.java:618)
    at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:949)
    at org.apache.solr.core.CoreContainer.create(CoreContainer.java:984)
    at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:597)
    at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:592)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)

The full solr.log (until the exception) is as follows:

INFO  - 2013-12-22 08:05:08.261; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
INFO  - 2013-12-22 08:05:08.277; org.apache.solr.core.SolrResourceLoader; Using JNDI solr.home: c:\tomcatweb\postingsmaster
INFO  - 2013-12-22 08:05:08.292; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: c:\tomcatweb\postingsmaster\solr.xml
INFO  - 2013-12-22 08:05:08.292; org.apache.solr.core.CoreContainer; New CoreContainer 20804623
INFO  - 2013-12-22 08:05:08.292; org.apache.solr.core.CoreContainer$Initializer; no solr.xml found. using default old-style solr.xml
INFO  - 2013-12-22 08:05:08.292; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: 'c:\tomcatweb\postingsmaster\'
INFO  - 2013-12-22 08:05:08.292; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: 'c:\tomcatweb\postingsmaster\'
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
INFO  - 2013-12-22 08:05:08.605; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
INFO  - 2013-12-22 08:05:08.621; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
INFO  - 2013-12-22 08:05:08.761; org.apache.solr.core.CoreContainer; Registering Log Listener
INFO  - 2013-12-22 08:05:08.792; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: c:\tomcatweb\postingsmaster\collection1
INFO  - 2013-12-22 08:05:08.792; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: 'c:\tomcatweb\postingsmaster\collection1\'
INFO  - 2013-12-22 08:05:08.792; org.apache.solr.core.SolrResourceLoader; Adding 'file:/c:/tomcatweb/postingsmaster/collection1/lib/mysql-connector-java-5.1.10-bin.jar' to classloader
INFO  - 2013-12-22 08:05:08.792; org.apache.solr.core.SolrResourceLoader; Adding 'file:/c:/tomcatweb/postingsmaster/collection1/lib/solr-dataimporthandler-4.6.0.jar' to classloader
INFO  - 2013-12-22 08:05:08.792; org.apache.solr.core.SolrResourceLoader; Adding 'file:/c:/tomcatweb/postingsmaster/collection1/lib/solr-dataimporthandler-extras-4.6.0.jar' to classloader
INFO  - 2013-12-22 08:05:08.871; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_43
INFO  - 2013-12-22 08:05:08.996; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
INFO  - 2013-12-22 08:05:09.011; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
INFO  - 2013-12-22 08:05:09.027; org.apache.solr.schema.IndexSchema; Schema name=postings
INFO  - 2013-12-22 08:05:09.324; org.apache.solr.schema.IndexSchema; default search field in schema is CombinedSearchField
INFO  - 2013-12-22 08:05:09.324; org.apache.solr.schema.IndexSchema; query parser default operator is OR
INFO  - 2013-12-22 08:05:09.324; org.apache.solr.schema.IndexSchema; unique key field: Id
INFO  - 2013-12-22 08:05:09.433; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
INFO  - 2013-12-22 08:05:09.449; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at c:\tomcatweb\postingsmaster\collection1\, dataDir=C:\tomcatweb\postingsmaster\collection1\data\
INFO  - 2013-12-22 08:05:09.449; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e6f0ef
INFO  - 2013-12-22 08:05:09.480; org.apache.solr.core.SolrCore; [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
INFO  - 2013-12-22 08:05:09.480; org.apache.solr.core.SolrCore; [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
INFO  - 2013-12-22 08:05:09.496; org.apache.solr.core.SolrCore; solr.NRTCachingDirectoryFactory
INFO  - 2013-12-22 08:05:09.511; org.apache.solr.core.CachingDirectoryFactory; return new directory for C:\tomcatweb\postingsmaster\collection1\data
INFO  - 2013-12-22 08:05:09.511; org.apache.solr.core.SolrCore; New index directory detected: old=null new=C:\tomcatweb\postingsmaster\collection1\data\index/
INFO  - 2013-12-22 08:05:09.511; org.apache.solr.core.CachingDirectoryFactory; return new directory for C:\tomcatweb\postingsmaster\collection1\data\index
INFO  - 2013-12-22 08:05:09.527; org.apache.solr.core.SolrCore; created json: solr.JSONResponseWriter
INFO  - 2013-12-22 08:05:09.527; org.apache.solr.core.SolrCore; adding lazy queryResponseWriter: solr.VelocityResponseWriter
INFO  - 2013-12-22 08:05:09.527; org.apache.solr.core.SolrCore; created velocity: solr.VelocityResponseWriter
INFO  - 2013-12-22 08:05:09.527; org.apache.solr.core.SolrCore; created xslt: solr.XSLTResponseWriter
INFO  - 2013-12-22 08:05:09.527; org.apache.solr.response.XSLTResponseWriter; xsltCacheLifetimeSeconds=5
INFO  - 2013-12-22 08:05:09.667; org.apache.solr.core.RequestHandlers; created standard: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.667; org.apache.solr.core.RequestHandlers; created dismax: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.683; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
INFO  - 2013-12-22 08:05:09.683; org.apache.solr.core.RequestHandlers; created /dataimport: org.apache.solr.handler.dataimport.DataImportHandler
INFO  - 2013-12-22 08:05:09.683; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /update/json: solr.JsonUpdateRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /update/csv: solr.CSVRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /update/extract: solr.extraction.ExtractingRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.FieldAnalysisRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /analysis/field: solr.FieldAnalysisRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /analysis/document: solr.DocumentAnalysisRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /admin/: solr.admin.AdminHandlers
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /admin/ping: solr.PingRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /debug/dump: solr.DumpRequestHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /spell: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /tvrh: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /terms: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.699; org.apache.solr.core.RequestHandlers; created /elevate: solr.SearchHandler
INFO  - 2013-12-22 08:05:09.730; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
INFO  - 2013-12-22 08:05:09.730; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
INFO  - 2013-12-22 08:05:09.730; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
INFO  - 2013-12-22 08:05:09.746; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@bf5e35 main
INFO  - 2013-12-22 08:05:09.777; org.apache.solr.update.CommitTracker; Hard AutoCommit: if uncommited for 15000ms; 
INFO  - 2013-12-22 08:05:09.777; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
INFO  - 2013-12-22 08:05:09.777; org.apache.solr.handler.component.SpellCheckComponent; Initializing spell checkers
INFO  - 2013-12-22 08:05:09.777; org.apache.solr.spelling.DirectSolrSpellChecker; init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
INFO  - 2013-12-22 08:05:09.792; org.apache.solr.handler.component.SpellCheckComponent; No queryConverter defined, using default converter
INFO  - 2013-12-22 08:05:09.792; org.apache.solr.handler.component.QueryElevationComponent; Loading QueryElevation from: c:\tomcatweb\postingsmaster\collection1\conf\elevate.xml
INFO  - 2013-12-22 08:05:09.808; org.apache.solr.handler.ReplicationHandler; Replication enabled for following config files: elevate.xml,protwords.txt,schema.xml,spellings.txt,stopwords.txt,synonyms.txt
INFO  - 2013-12-22 08:05:09.808; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
ERROR - 2013-12-22 08:05:09.824; org.apache.solr.handler.dataimport.DataImportHandler; Exception while loading DataImporter
java.lang.NoSuchMethodError: org.apache.solr.core.SolrCore.getLatestSchema()Lorg/apache/solr/schema/IndexSchema;
    at org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:103)
    at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:103)
    at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:616)
    at org.apache.solr.core.SolrCore.<init>(SolrCore.java:816)
    at org.apache.solr.core.SolrCore.<init>(SolrCore.java:618)
    at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:949)
    at org.apache.solr.core.CoreContainer.create(CoreContainer.java:984)
    at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:597)
    at org.apache.solr.core.CoreContainer$2.call(CoreContainer.java:592)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)

Re: Dataimport handler exception when migrating from 4.4 to 4.6. Help needed

Posted by William Bell <bi...@gmail.com>.

The best practice for upgrading is take the distribution and expand it.
Then take your cores and replace it.

Then you are guaranteed to get the jars and not have other WARs/JARs
hanging around.



On Sun, Dec 22, 2013 at 7:24 PM, Shawn Heisey <so...@elyograg.org> wrote:

> On 12/22/2013 9:51 AM, William Pierce wrote:
> > My configurations works nicely with solr 4.4. I am encountering a
> configuration error when I try to upgrade from 4.4 to 4.6.  All I did was
> the following:
> >
> > a) Replace the 4.4 solr.war file with the 4.6 solr.war in the tomcat/lib
> folder. I am using version 6.0.36 of tomcat.
> > b) I replaced the solr-dataimporthandler-4.4.0.jar and
> solr-dataimporthandler-extras-4.4.0.jar with the corresponding 4.6
> counterparts in the collection/lib folder.
> >
> > I restarted tomcat.   I get the following stack trace (full log is also
> given below) – there are no other warnings/errors in my log.  I have gone
> through the 4.5 changes to see if I needed to add/modify my DIH
> configuration – but I am stymied.  Any help will be greatly appreciated.
> >
> > ERROR - 2013-12-22 08:05:09.824;
> org.apache.solr.handler.dataimport.DataImportHandler; Exception while
> loading DataImporter
> > java.lang.NoSuchMethodError:
> org.apache.solr.core.SolrCore.getLatestSchema()Lorg/apache/solr/schema/IndexSchema;
>
> The method it's complaining about not being there is
> org.apache.solr.core.SolrCore.getLatestSchema() ... which is in Solr
> itself, not the dataimport handler.  I did some checking.  This method
> did not exist before 4.4.0, so my best guess is that your classloader is
> loading a SolrCore class from 4.3.1 or earlier, which probably means one
> of two things: 1) The Solr war you're extracting is not actually version
> 4.6.0, or 2) you've got jars in your system from one or more older
> versions.
>
> It's a good idea to delete the extracted war data whenever you upgrade
> Solr -- stop the container, delete the extracted data and all old jars,
> then replace the .war file and start it back up.
>
> Thanks,
> Shawn
>
>


-- 
Bill Bell
billnbell@gmail.com
cell 720-256-8076

Re: Dataimport handler exception when migrating from 4.4 to 4.6. Help needed

Posted by Shawn Heisey <so...@elyograg.org>.

On 12/22/2013 9:51 AM, William Pierce wrote:
> My configurations works nicely with solr 4.4. I am encountering a configuration error when I try to upgrade from 4.4 to 4.6.  All I did was the following:
> 
> a) Replace the 4.4 solr.war file with the 4.6 solr.war in the tomcat/lib folder. I am using version 6.0.36 of tomcat.
> b) I replaced the solr-dataimporthandler-4.4.0.jar and solr-dataimporthandler-extras-4.4.0.jar with the corresponding 4.6 counterparts in the collection/lib folder.
> 
> I restarted tomcat.   I get the following stack trace (full log is also given below) – there are no other warnings/errors in my log.  I have gone through the 4.5 changes to see if I needed to add/modify my DIH configuration – but I am stymied.  Any help will be greatly appreciated.
> 
> ERROR - 2013-12-22 08:05:09.824; org.apache.solr.handler.dataimport.DataImportHandler; Exception while loading DataImporter
> java.lang.NoSuchMethodError: org.apache.solr.core.SolrCore.getLatestSchema()Lorg/apache/solr/schema/IndexSchema;

The method it's complaining about not being there is
org.apache.solr.core.SolrCore.getLatestSchema() ... which is in Solr
itself, not the dataimport handler.  I did some checking.  This method
did not exist before 4.4.0, so my best guess is that your classloader is
loading a SolrCore class from 4.3.1 or earlier, which probably means one
of two things: 1) The Solr war you're extracting is not actually version
4.6.0, or 2) you've got jars in your system from one or more older versions.

It's a good idea to delete the extracted war data whenever you upgrade
Solr -- stop the container, delete the extracted data and all old jars,
then replace the .war file and start it back up.

Thanks,
Shawn