You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@solr.apache.org by Dmitri Maziuk <dm...@gmail.com> on 2025/03/14 21:52:44 UTC

added field does not replicate?

Hi all,

I've a 2-node cluster: num_replicas = 2, num_shards = 1, 3rd node is 
zk-only, running 8.11. I've been posting documents to one node and 
querying the other, and that seemed to work fine until today someone 
noticed a missing field in search results.

So I fixed the ingest script, re-ran it, and the field is there now on 
node1. It was still not there on node2 after 10 or so minutes, and only 
appeared after I hit Reload on the collection.

So, question: is that supposed to happen? Or am I missing something? (I 
did clear browser caches and ran a few other queries in the hope of 
invalidating Solr cache, though that may not have worked, before 
reloading the collection.)

TIA
Dima

Re: added field does not replicate?

Posted by Dmitri Maziuk <dm...@gmail.com>.
On 3/14/25 17:25, Dmitri Maziuk wrote:
...
> Updated document has the value on the node it was POST'ed to, but not on 
> the replica node.

Digging deeper, this node turns out to have a 500GB tlog on a 500GB 
drive, that may have something to do with it.

(We were being scraped/DDoS'ed via the website's search URL last week, 
that must have caused it.)

Dima



Re: added field does not replicate?

Posted by Dmitri Maziuk <dm...@gmail.com>.
On 3/14/25 17:14, Arrieta, Alejandro wrote:
> Hello Dmitri,
> 
> maybe not the same issue but with missing field a reload needed and Solr
> 8.11.

Similar but different: the field exists in the schema, the value was 
missing.

Updated document has the value on the node it was POST'ed to, but not on 
the replica node.

I'm still waiting for our provider to give us the keys to their 
OpenShift cluster ("government efficiency"); then I'll spin up a 
9.latest to play with.

Dima


Re: added field does not replicate?

Posted by "Arrieta, Alejandro" <aa...@perrinsoftware.com>.
Hello Dmitri,

maybe not the same issue but with missing field a reload needed and Solr
8.11.
-solr 8.11.4 in solrcloud mode with one or more shard replicas on each solr
node.
-create collection with solr config
-index something with all fields
-use solr api to add a new field
-field appears in zookeeper znodes, but does not appear if you query/index
something into the collection or in the solr admin ui schema part.
-if you did a collection reload it appeared.
workaround
-if you used zkcli.sh to upload the modified solr config managed schema
with the added field, it did not need reload and all worked with the new
field.
-this didn't happen on Solr 8.4

We may need to check this on latest Solr 9 as Solr 8 is press F for respect
(EOL).
Hope this helps.

Kind Regards,
Alejandro Arrieta

On Fri, Mar 14, 2025 at 6:52 PM Dmitri Maziuk <dm...@gmail.com>
wrote:

> Hi all,
>
> I've a 2-node cluster: num_replicas = 2, num_shards = 1, 3rd node is
> zk-only, running 8.11. I've been posting documents to one node and
> querying the other, and that seemed to work fine until today someone
> noticed a missing field in search results.
>
> So I fixed the ingest script, re-ran it, and the field is there now on
> node1. It was still not there on node2 after 10 or so minutes, and only
> appeared after I hit Reload on the collection.
>
> So, question: is that supposed to happen? Or am I missing something? (I
> did clear browser caches and ran a few other queries in the hope of
> invalidating Solr cache, though that may not have worked, before
> reloading the collection.)
>
> TIA
> Dima
>