You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by deniz <de...@gmail.com> on 2012/11/26 07:57:39 UTC

SolrCloud - Fails to read db config file

Hi all,

I am working on solrcloud and trying to import from db... but I am getting
this error:


<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">500</int><int
name="QTime">3</int></lst><lst name="error"><str name="msg">Error opening
/configs/poppenuser//home/deniz/solr/mycore/conf/db-config.xml</str><str
name="trace">java.io.IOException: Error opening
/configs/poppenuser//home/deniz/solr/mycore/conf/db-config.xml
	at
org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
	at
org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(DataImportHandler.java:132)
	at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1830)
	at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:455)
	at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:276)
	at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
	at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
	at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
	at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
	at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
	at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
	at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
	at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
	at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
	at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
	at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
	at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
	at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
	at org.eclipse.jetty.server.Server.handle(Server.java:351)
	at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
	at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
	at
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:890)
	at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:944)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:634)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230)
	at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
	at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
	at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
	at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
	at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.IllegalArgumentException: Invalid path string
"/configs/poppenuser//home/deniz/solr/mycore/conf/db-config.xml" caused by
empty node name specified @20
	at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:99)
	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:794)
	at
org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:193)
	at
org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:190)
	at
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:190)
	at org.apache.solr.cloud.ZkController.pathExists(ZkController.java:519)
	at
org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
	... 30 more
</str><int name="code">500</int></lst>
</response>


it seems like a path problem but i am able to open
/home/deniz/solr/mycore/conf/db-config.xml without any problems... i dont
know why in the logs that path has double / but even by using the path with
two / s like  //home/deniz/solr/mycore/conf/db-config.xml i am able to open
the file.

anyone knows why am i getting this error? without solr cloud, the same
configs and settings are working smoothly though 



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by deniz <de...@gmail.com>.
Mark Miller-3 wrote
> It looks like your original path had a double / in it that was causing
> problems.

my original path in the config file doesnt have any double quotes, but when
it is on solrcloud, it adds additional slash to the path... i am not an
zookeeper expert or something but could it be because of absolute path rule
of zookeeer? basically while you are listing something on zk, you need to
you go with /configs/corename/ and then whatever node comes here... and as
in my config file it was starting with a slash too it is simply added to the
path... does this make sense? if so, is this a bug too?



Mark Miller-3 wrote
> It looks like the below is a bug. Could you please file a JIRA issue?

added :)



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022368.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by deniz <de...@gmail.com>.
Mark Miller-3 wrote
> It looks like your original path had a double / in it that was causing
> problems.

my original path in the config file doesnt have any double quotes, but when
it is on solrcloud, it adds additional slash to the path... i am not an
zookeeper expert or something but could it be because of absolute path rule
of zookeeer? basically while you are listing something on zk, you need to
you go with /configs/corename/ and then whatever node comes here... and as
in my config file it was starting with a slash too it is simply added to the
path... does this make sense? if so, is this a bug too?



Mark Miller-3 wrote
> It looks like the below is a bug. Could you please file a JIRA issue?

added :)



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022369.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by Danny <da...@gmail.com>.
Hi,

I seem to have the same issue here.

I'm running a very simple Solr server in standalone mode, using a DIH with
the following datasource in *dataconfig.xml* :


It works fine.

Then I stop the standalone server, empty the data directory, and start a
cluster with an embedded ZooKeeper, just by changing the command line to
this one (called from the */danny* directory) :


The Solr cloud starts without problems.

Then I go in the admin interface, in the *Dataimport* page of the core, to
execute a data import. But now the *Entity* dropdown list is empty, and I
get this error in the log :


So it looks like the same problem deniz had.

I don't understand what does /configs/danny_conf/ represents for ZooKeeper ?
Is it a /real/ path, or a /virtual/ one ?

I created a symbolic link that allowed the path
/configs/danny_conf//danny/solr/core1/conf/data-config.xml to be actually
readable, but I still had the error, so I guess it's not a real path that
ZooKeeper is looking for.

In the admin interface, under *Cloud > Tree*, I can see under
/configs/danny_conf/ that all the files that are listed are actually the
files that are under this real path : /danny/solr/core1/conf/ (like
data-config.xml for example).

But I still don't understand what's going on...

Also, I didn't understand Mark Miller's tip :

Mark Miller-3 wrote
> As a workaround, try explicitly setting the directory to write the
> properties file in with the "directory" param. You should be able to set
> it to anything, as it should not be used.

Thanks for any help here :)

Danny.




--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4122963.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by deniz <de...@gmail.com>.
sorry for the typos in the previous mail.. "quotes" should be "slashes" there



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022513.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by deniz <de...@gmail.com>.
Mark Miller-3 wrote
> It looks like your original path had a double / in it that was causing
> problems.

my original path in the config file doesnt have any double quotes, but when
it is on solrcloud, it adds additional slash to the path... i am not an
zookeeper expert or something but could it be because of absolute path rule
of zookeeer? basically while you are listing something on zk, you need to
you go with /configs/corename/ and then whatever node comes here... and as
in my config file it was starting with a slash too it is simply added to the
path... does this make sense? if so, is this a bug too?



Mark Miller-3 wrote
> It looks like the below is a bug. Could you please file a JIRA issue?

added :)



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022370.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by Mark Miller <ma...@gmail.com>.
It looks like your original path had a double / in it that was causing problems.

It looks like the below is a bug. Could you please file a JIRA issue?

As a workaround, try explicitly setting the directory to write the properties file in with the "directory" param. You should be able to set it to anything, as it should not be used. The ZkPropertiesWriter will work with ZooKeeper instead.

- Mark

On Nov 26, 2012, at 3:18 AM, deniz <de...@gmail.com> wrote:

> okay, after changing it to db-config from the full path above, i am able to
> see dataimport page, but still data import is failing... i see this in the
> logs 
> 
> 
> 
> 
> SEVERE: Full Import
> failed:org.apache.solr.handler.dataimport.DataImportHandlerException: Unable
> to PropertyWriter implementation:ZKPropertiesWriter
> 	at
> org.apache.solr.handler.dataimport.DataImporter.createPropertyWriter(DataImporter.java:336)
> 	at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:418)
> 	at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:487)
> 	at
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:468)
> Caused by: org.apache.solr.common.cloud.ZooKeeperException:
> ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
> trying to do is not supported in ZooKeeper mode
> 	at
> org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoader.java:100)
> 	at
> org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePropertiesWriter.java:91)
> 	at
> org.apache.solr.handler.dataimport.ZKPropertiesWriter.init(ZKPropertiesWriter.java:45)
> 	at
> org.apache.solr.handler.dataimport.DataImporter.createPropertyWriter(DataImporter.java:334)
> 	... 3 more
> 
> Exception in thread "Thread-306" java.lang.NullPointerException
> 	at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:427)
> 	at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:487)
> 	at
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:468)
> 
> 
> 
> and i cant import anything at all... any ideas?
> 
> 
> 
> -----
> Zeki ama calismiyor... Calissa yapar...
> --
> View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022307.html
> Sent from the Solr - User mailing list archive at Nabble.com.


Re: SolrCloud - Fails to read db config file

Posted by deniz <de...@gmail.com>.
okay, after changing it to db-config from the full path above, i am able to
see dataimport page, but still data import is failing... i see this in the
logs 




SEVERE: Full Import
failed:org.apache.solr.handler.dataimport.DataImportHandlerException: Unable
to PropertyWriter implementation:ZKPropertiesWriter
	at
org.apache.solr.handler.dataimport.DataImporter.createPropertyWriter(DataImporter.java:336)
	at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:418)
	at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:487)
	at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:468)
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
ZkSolrResourceLoader does not support getConfigDir() - likely, what you are
trying to do is not supported in ZooKeeper mode
	at
org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoader.java:100)
	at
org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePropertiesWriter.java:91)
	at
org.apache.solr.handler.dataimport.ZKPropertiesWriter.init(ZKPropertiesWriter.java:45)
	at
org.apache.solr.handler.dataimport.DataImporter.createPropertyWriter(DataImporter.java:334)
	... 3 more

Exception in thread "Thread-306" java.lang.NullPointerException
	at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:427)
	at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:487)
	at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:468)



and i cant import anything at all... any ideas?



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022307.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by deniz <de...@gmail.com>.
Marcin Rzewucki wrote
> Hi,
> 
> It seems like the file is missing from Zookeeper. Can you confirm ?
> 
> Regards.

nope, i can see my db-config file on the admin interface of solr as well as
zk client on command line, i dont think it is missing from zookeeper 



-----
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299p4022304.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Fails to read db config file

Posted by Marcin Rzewucki <mr...@gmail.com>.
Hi,

It seems like the file is missing from Zookeeper. Can you confirm ?

Regards.

On 26 November 2012 07:57, deniz <de...@gmail.com> wrote:

> Hi all,
>
> I am working on solrcloud and trying to import from db... but I am getting
> this error:
>
>
> <?xml version="1.0" encoding="UTF-8"?>
> <response>
> <lst name="responseHeader"><int name="status">500</int><int
> name="QTime">3</int></lst><lst name="error"><str name="msg">Error opening
> /configs/poppenuser//home/deniz/solr/mycore/conf/db-config.xml</str><str
> name="trace">java.io.IOException: Error opening
> /configs/poppenuser//home/deniz/solr/mycore/conf/db-config.xml
>         at
>
> org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:82)
>         at
>
> org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(DataImportHandler.java:132)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1830)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:455)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:276)
>         at
>
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
>         at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
>         at
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
>         at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
>         at
>
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
>         at
>
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
>         at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
>         at
>
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
>         at
>
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
>         at
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
>         at
>
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
>         at
>
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
>         at
>
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
>         at org.eclipse.jetty.server.Server.handle(Server.java:351)
>         at
>
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
>         at
>
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
>         at
>
> org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:890)
>         at
>
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:944)
>         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:634)
>         at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230)
>         at
>
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
>         at
>
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
>         at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
>         at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
>         at java.lang.Thread.run(Unknown Source)
> Caused by: java.lang.IllegalArgumentException: Invalid path string
> "/configs/poppenuser//home/deniz/solr/mycore/conf/db-config.xml" caused by
> empty node name specified @20
>         at
> org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:99)
>         at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:794)
>         at
> org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:193)
>         at
> org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:190)
>         at
>
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
>         at
> org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:190)
>         at
> org.apache.solr.cloud.ZkController.pathExists(ZkController.java:519)
>         at
>
> org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:77)
>         ... 30 more
> </str><int name="code">500</int></lst>
> </response>
>
>
> it seems like a path problem but i am able to open
> /home/deniz/solr/mycore/conf/db-config.xml without any problems... i dont
> know why in the logs that path has double / but even by using the path with
> two / s like  //home/deniz/solr/mycore/conf/db-config.xml i am able to open
> the file.
>
> anyone knows why am i getting this error? without solr cloud, the same
> configs and settings are working smoothly though
>
>
>
> -----
> Zeki ama calismiyor... Calissa yapar...
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/SolrCloud-Fails-to-read-db-config-file-tp4022299.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>