SolrCore is loading

[dmitri maziuk <dm...@gmail.com>]

Hi all,

I've a weird problem with a fresh standalone install of 8.11.2 on a 
winders VM/Corretto JDK 11: it starts up and is getting into a loop 
where the one existing core is up for a bit, and then it's throwing a 
"503 Core is loading", then it's up again, and so on. The only error I 
see in the log (at debug level) is "can't find configsetprops.json, 
assuming default properties", that doesn't look relevant.

The user running the service has "full control" on the entire solr-8.11 
directory tree and I can't think of anything else to check.

Any ideas what could cause that?

TIA
Dima

Re: SOLVED(-ish) Re: SolrCore is loading

[Rahul Goswami <ra...@gmail.com>]

That’s kind of strange that the EOFException doesn’t occur with the change
to LocalSystem. But glad it works anyway.
For what it’s worth, we run Solr on Windows as a service under the Network
Service account which is less privileged than LocalSystem.

Rahul

On Mon, Oct 24, 2022 at 6:32 PM dmitri maziuk <dm...@gmail.com>
wrote:

> OK so this has to do with trying to run solr service as windows domain
> user. It works w/o problems (fingers crossed) when run as "LocalSystem"
> account, runs into this core reloading loop when run as a domain users,
> and giving the domain user "full control" on solr directory tree does
> not fix that.
>
> It's a good thing we're changing providers and will soon be able to
> ditch windows for at least solr. We hope.
>
> Dima
>
>

SOLVED(-ish) Re: SolrCore is loading

[dmitri maziuk <dm...@gmail.com>]

OK so this has to do with trying to run solr service as windows domain 
user. It works w/o problems (fingers crossed) when run as "LocalSystem" 
account, runs into this core reloading loop when run as a domain users, 
and giving the domain user "full control" on solr directory tree does 
not fix that.

It's a good thing we're changing providers and will soon be able to 
ditch windows for at least solr. We hope.

Dima

Re: SolrCore is loading

[dmitri maziuk <dm...@gmail.com>]

On 2022-10-24 4:21 PM, Rahul Goswami wrote:
> Hi Dima,
> Do you observe anything unusual (blocked thread or something else) in the
> thread dump when this happens? Or can you share one?
> Maybe through jstack or the /solr/admin/info/threads endpoint.

Nothing stands out.

So far the only consistent thing is, when I run a data importer script 
(that works w/o problems on solr-8.7) it errors out in the middle of the 
run with Solr either dropping connection in the middle of a POST or 
refusing one for the next POST. :(

There seems to be a
'''
2022-10-24 22:03:49.566 ERROR 
(recoveryExecutor-17-thread-1-processing-x:searchwhs) [   x:searchwhs] 
o.a.s.u.UpdateLog java.io.EOFException => java.io.EOFException
      at 
org.apache.solr.common.util.FastInputStream.readFully(FastInputStream.java:179)
java.io.EOFException: null
'''
on tlog replay but not every time.

Dima

Re: SolrCore is loading

[Rahul Goswami <ra...@gmail.com>]

Hi Dima,
Do you observe anything unusual (blocked thread or something else) in the
thread dump when this happens? Or can you share one?
Maybe through jstack or the /solr/admin/info/threads endpoint.

Rahul

On Mon, Oct 24, 2022 at 5:17 PM dmitri maziuk <dm...@gmail.com>
wrote:

> Hi all,
>
> I've a weird problem with a fresh standalone install of 8.11.2 on a
> winders VM/Corretto JDK 11: it starts up and is getting into a loop
> where the one existing core is up for a bit, and then it's throwing a
> "503 Core is loading", then it's up again, and so on. The only error I
> see in the log (at debug level) is "can't find configsetprops.json,
> assuming default properties", that doesn't look relevant.
>
> The user running the service has "full control" on the entire solr-8.11
> directory tree and I can't think of anything else to check.
>
> Any ideas what could cause that?
>
> TIA
> Dima
>