You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "Mike Drob (Jira)" <ji...@apache.org> on 2022/05/16 18:34:00 UTC

[jira] [Comment Edited] (SOLR-16143) SolrConfig ResourceProvider can miss updates from ZooKeeper

    [ https://issues.apache.org/jira/browse/SOLR-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17537716#comment-17537716 ] 

Mike Drob edited comment on SOLR-16143 at 5/16/22 6:33 PM:
-----------------------------------------------------------

> This issue is categorized as a test but I suppose it is in fact not?

Yea, it initially looked like a test failure but then after a long time debugging we figured out what the underlying cause was.

> A learning I got from the above comments is that when we cache ZK stuff...

A learning _I_ got is that we should use Curator instead of rolling our own, but that's for another day. ;)


was (Author: mdrob):
> A learning I got from the above comments is that when we cache ZK stuff...

A learning _I_ got is that we should use Curator instead of rolling our own, but that's for another day. ;)

> SolrConfig ResourceProvider can miss updates from ZooKeeper
> -----------------------------------------------------------
>
>                 Key: SOLR-16143
>                 URL: https://issues.apache.org/jira/browse/SOLR-16143
>             Project: Solr
>          Issue Type: Bug
>          Components: Tests
>    Affects Versions: 8.9
>            Reporter: Mike Drob
>            Assignee: Houston Putman
>            Priority: Major
>             Fix For: 9.0
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> {noformat}
> not ok 7 create multisharded collections when s provided
> # (in test file test/test_create_collection.bats, line 79)
> #   `run -0 solr create_collection -c COLL_NAME -s 2' failed, expected exit code 0, got 1
> # Last output:
> # WARNING: Using _default configset with data driven schema functionality. NOT RECOMMENDED for production use.
> #          To turn off: bin/solr config -c COLL_NAME -p 8983 -action set-user-property -property update.autoCreateFields -value false
> #
> # ERROR: Failed to create collection 'COLL_NAME' due to: Underlying core creation failed while creating collection: COLL_NAME
> {noformat}
> {noformat}
> 2022-04-05 01:12:48.835 ERROR (searcherExecutor-55-thread-1-processing-localhost:8983_solr COLL_NAME_shard1_replica_n2 COLL_NAME shard1 core_node4) [c:COLL_NAME s:shard1 r:core_node4 x:COLL_NAME_shard1_replica_n2] o.a.s.h.RequestHandlerBase java.lang.NullPointerException => java.lang.NullPointerE
> xception
>         at org.apache.solr.handler.component.SearchHandler.initComponents(SearchHandler.java:248)
> java.lang.NullPointerException: null
>         at org.apache.solr.handler.component.SearchHandler.initComponents(SearchHandler.java:248) ~[?:?]
>         at org.apache.solr.handler.component.SearchHandler.getComponents(SearchHandler.java:268) ~[?:?]
>         at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:336) ~[?:?]
>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:207) ~[?:?]
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:2866) ~[?:?]
>         at org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:73) ~[?:?]
>         at org.apache.solr.core.SolrCore.lambda$getSearcher$18(SolrCore.java:2621) ~[?:?]
>         at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
>         at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:259) ~[?:?]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
>         at java.lang.Thread.run(Thread.java:829) [?:?]
> {noformat}
> {noformat}
> 2022-04-05 01:12:48.852 ERROR (qtp451312813-31) [] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Error CREATEing SolrCore 'COLL_NAME_shard1_replica_n2': Unable to create core [COLL_NAME_shard1_replica_n2] Caused by: Can't find resource 'elevate.xml' in classpath or '/configs/CO
> LL_NAME', cwd=/Users/mdrob/code/solr/solr/packaging/build/solr-10.0.0-SNAPSHOT/server => org.apache.solr.common.SolrException: Error CREATEing SolrCore 'COLL_NAME_shard1_replica_n2': Unable to create core [COLL_NAME_shard1_replica_n2] Caused by: Can't find resource 'elevate.xml' in classpath or '
> /configs/COLL_NAME', cwd=/Users/mdrob/code/solr/solr/packaging/build/solr-10.0.0-SNAPSHOT/server
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1470)
> org.apache.solr.common.SolrException: Error CREATEing SolrCore 'COLL_NAME_shard1_replica_n2': Unable to create core [COLL_NAME_shard1_replica_n2] Caused by: Can't find resource 'elevate.xml' in classpath or '/configs/COLL_NAME', cwd=/Users/mdrob/code/solr/solr/packaging/build/solr-10.0.0-SNAPSHOT
> /server
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1470) ~[?:?]
>         at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:92) ~[?:?]
>         at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:389) ~[?:?]
>         at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:422) ~[?:?]
>         at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:205) ~[?:?]
>         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:207) ~[?:?]
>         at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:941) ~[?:?]
>         at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:893) ~[?:?]
>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:584) ~[?:?]
>         at org.apache.solr.servlet.SolrDispatchFilter.dispatch(SolrDispatchFilter.java:239) ~[?:?]
>         at org.apache.solr.servlet.SolrDispatchFilter.lambda$doFilter$0(SolrDispatchFilter.java:207) ~[?:?]
>         at org.apache.solr.servlet.ServletUtils.traceHttpRequestExecution2(ServletUtils.java:257) ~[?:?]
>         at org.apache.solr.servlet.ServletUtils.rateLimitRequest(ServletUtils.java:227) ~[?:?]
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202) ~[?:?]
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:184) ~[?:?]
>         at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201) ~[jetty-servlet-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) ~[jetty-security-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:177) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) ~[jetty-rewrite-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:763) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:400) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:392) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:352) ~[jetty-server-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.http2.HTTP2Connection.produce(HTTP2Connection.java:183) ~[http2-common-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.http2.HTTP2Connection.onFillable(HTTP2Connection.java:138) ~[http2-common-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.http2.HTTP2Connection$FillableCallback.succeeded(HTTP2Connection.java:361) ~[http2-common-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) ~[jetty-io-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) ~[jetty-io-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) ~[jetty-util-9.4.44.v20210927.jar:9.4.44.v20210927]
>         at java.lang.Thread.run(Thread.java:829) [?:?]
> Caused by: org.apache.solr.common.SolrException: Unable to create core [COLL_NAME_shard1_replica_n2]
>         at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1585) ~[?:?]
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1428) ~[?:?]
>         ... 59 more
> Caused by: org.apache.solr.common.SolrException: Error initializing QueryElevationComponent
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1204) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1048) ~[?:?]
>         at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1562) ~[?:?]
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1428) ~[?:?]
>         ... 59 more
> Caused by: org.apache.solr.common.SolrException: Error initializing QueryElevationComponent
>         at org.apache.solr.handler.component.QueryElevationComponent.handleInitializationException(QueryElevationComponent.java:293) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.inform(QueryElevationComponent.java:192) ~[?:?]
>         at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:728) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1155) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1048) ~[?:?]
>         at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1562) ~[?:?]
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1428) ~[?:?]
>         ... 59 more
> Caused by: org.apache.solr.common.SolrException: org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'elevate.xml' in classpath or '/configs/COLL_NAME', cwd=/Users/mdrob/code/solr/solr/packaging/build/solr-10.0.0-SNAPSHOT/server
>         at org.apache.solr.core.XmlConfigFile.lambda$new$0(XmlConfigFile.java:99) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:144) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:93) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:83) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:77) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.loadElevationProvider(QueryElevationComponent.java:382) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.getElevationProvider(QueryElevationComponent.java:346) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.loadElevationConfiguration(QueryElevationComponent.java:271) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.inform(QueryElevationComponent.java:185) ~[?:?]
>         at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:728) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1155) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1048) ~[?:?]
>         at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1562) ~[?:?]
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1428) ~[?:?]
>         ... 59 more
> Caused by: org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'elevate.xml' in classpath or '/configs/COLL_NAME', cwd=/Users/mdrob/code/solr/solr/packaging/build/solr-10.0.0-SNAPSHOT/server
>         at org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:120) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.lambda$new$0(XmlConfigFile.java:97) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:144) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:93) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:83) ~[?:?]
>         at org.apache.solr.core.XmlConfigFile.<init>(XmlConfigFile.java:77) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.loadElevationProvider(QueryElevationComponent.java:382) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.getElevationProvider(QueryElevationComponent.java:346) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.loadElevationConfiguration(QueryElevationComponent.java:271) ~[?:?]
>         at org.apache.solr.handler.component.QueryElevationComponent.inform(QueryElevationComponent.java:185) ~[?:?]
>         at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:728) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1155) ~[?:?]
>         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1048) ~[?:?]
>         at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1562) ~[?:?]
>         at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1428) ~[?:?]
>         ... 59 more
> {noformat}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org