You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Neeraj Bhatt <ne...@gmail.com> on 2016/11/09 12:44:52 UTC
error while working solr 6.2 cdcr
Hello All
I have a source cluster (3 nodes, 3 shards and 3 replica) and same for
target cluster. On posting of documents to source I am getting below error
in target solr log files when i turned log to debug level
*6538 ERROR (qtp110456297-20) [c:multi_dc_poc s:shard1 r:core_node3
x:multi_dc_poc_shard1_replica2] o.a.s.h.RequestHandlerBase
org.apache.solr.common.SolrException: Action LASTPROCESSEDVERSION sent to
non-leader replica at
org.apache.solr.handler.CdcrRequestHandler.handleLastProcessedVersionAction(CdcrRequestHandler.java:498)*
*should I reconfigure my replicas to one in target ?*
solr config of source and target is same as given in wiki
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62687462
*source *
*<requestHandler name="/cdcr"
class="solr.CdcrRequestHandler"> <lst
name="replica"> <str
name="zkHost">192.169.35.53:2181
<http://192.169.35.53:2181>,192.169.35.249:2181
<http://192.169.35.249:2181>,192.169.35.251:2181
<http://192.169.35.251:2181>
</str> <str
name="source">multi_dc_poc</str> <str
name="target">multi_dc_poc</str> </lst> <lst
name="replicator"> <str
name="threadPoolSize">9</str> <str
name="schedule">1000</str> <str
name="batchSize">128</str> </lst> <lst
name="updateLogSynchronizer"> <str
name="schedule">1000</str> </lst> </requestHandler>*
*source and target update log <updateLog
class="solr.CdcrUpdateLog"> <str
name="dir">${solr.ulog.dir:}</str> <int
name="numVersionBuckets">${solr.ulog.numVersionBuckets:65536}</int>
</updateLog>*
*target solr config*
<requestHandler name="/cdcr" class="solr.CdcrRequestHandler">
<lst name="buffer">
<str name="defaultState">disabled</str>
</lst>
</requestHandler>
<requestHandler name="/update" class="solr.UpdateRequestHandler">
<lst name="defaults">
<str name="update.chain">cdcr-processor-chain</str>
</lst>
</requestHandler>
<updateRequestProcessorChain name="cdcr-processor-chain">
<processor class="solr.CdcrUpdateProcessorFactory"/>
<processor class="solr.RunUpdateProcessorFactory"/>
</updateRequestProcessorChain>
*target status*
<response><lst name="responseHeader"><int name="status">0</int><int
name="QTime">0</int></lst><lst name="status"><str
name="process">stopped</str><str
name="buffer">disabled</str></lst></response>
*source status*
<response><lst name="responseHeader"><int name="status">0</int><int
name="QTime">0</int></lst><lst name="status"><str
name="process">started</str><str
name="buffer">enabled</str></lst></response>
Re: error while working solr 6.2 cdcr
Posted by Neeraj Bhatt <ne...@gmail.com>.
Hi Eric
With one shard and one replica I am getting " 08976 ERROR
(qtp110456297-13) [c:multi_dc_poc s:shard1 r:core_node1
x:multi_dc_poc_shard1_replica1] o.a.s.h.RequestHandlerBase
org.apache.solr.common.SolrException: Unknown action: null
at
org.apache.solr.handler.CdcrRequestHandler.handleRequestBody(CdcrRequestHandler.java:173)"
in target logs
Any suggestion ?
Thanks
On Thu, Nov 10, 2016 at 8:17 AM, Neeraj Bhatt <ne...@gmail.com>
wrote:
> Hi Eric
>
> Source have only target zookeeper ensemble (only 3 ips)
> <str name="zkHost">192.169.35.53:2181,192.169.35.249:2181,192.
> 169.35.251:2181> , because of some mail formatting ip were repeated(see
> sent item attached image). Error in log files is
> Action LASTPROCESSEDVERSION sent to non-leader replica at
> org.apache.solr.handler.CdcrRequestHandler.handleLastProcess
> edVersionAction(CdcrRequestHandler.java:498)
> I will start with empty collection with 3 nodes 3 shards one replication
> factor, It seems from log that request from souce is going to non leader
> replica.
>
> Please suggest
>
> Thanks
>
>
>
> On Wed, Nov 9, 2016 at 9:23 PM, Erick Erickson <er...@gmail.com>
> wrote:
>
>> Why do you have 6 zookeepers listed in the zkHost parameter? My guess
>> is that you've listed the ZK addresses for both the source and target
>> clusters. This should only be the ZK nodes for the target cluster and
>> only present on the source.
>>
>> The source already knows its own ZK addresses, it needs to know about
>> the target cluster in order to know what nodes it should send updates
>> to.
>>
>> Best,
>> Erick
>>
>> On Wed, Nov 9, 2016 at 4:44 AM, Neeraj Bhatt <ne...@gmail.com>
>> wrote:
>> > Hello All
>> >
>> > I have a source cluster (3 nodes, 3 shards and 3 replica) and same for
>> > target cluster. On posting of documents to source I am getting below
>> error
>> > in target solr log files when i turned log to debug level
>> >
>> >
>> >
>> >
>> > *6538 ERROR (qtp110456297-20) [c:multi_dc_poc s:shard1 r:core_node3
>> > x:multi_dc_poc_shard1_replica2] o.a.s.h.RequestHandlerBase
>> > org.apache.solr.common.SolrException: Action LASTPROCESSEDVERSION sent
>> to
>> > non-leader replica at
>> > org.apache.solr.handler.CdcrRequestHandler.handleLastProcess
>> edVersionAction(CdcrRequestHandler.java:498)*
>> >
>> > *should I reconfigure my replicas to one in target ?*
>> >
>> > solr config of source and target is same as given in wiki
>> > https://cwiki.apache.org/confluence/pages/viewpage.action?pa
>> geId=62687462
>> >
>> > *source *
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > *<requestHandler name="/cdcr"
>> > class="solr.CdcrRequestHandler"> <lst
>> > name="replica"> <str
>> > name="zkHost">192.169.35.53:2181
>> > <http://192.169.35.53:2181>,192.169.35.249:2181
>> > <http://192.169.35.249:2181>,192.169.35.251:2181
>> > <http://192.169.35.251:2181>
>> > </str> <str
>> > name="source">multi_dc_poc</str> <str
>> > name="target">multi_dc_poc</str> </lst>
>> <lst
>> > name="replicator"> <str
>> > name="threadPoolSize">9</str> <str
>> > name="schedule">1000</str> <str
>> > name="batchSize">128</str> </lst> <lst
>> > name="updateLogSynchronizer"> <str
>> > name="schedule">1000</str> </lst>
>> </requestHandler>*
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > *source and target update log <updateLog
>> > class="solr.CdcrUpdateLog"> <str
>> > name="dir">${solr.ulog.dir:}</str> <int
>> > name="numVersionBuckets">${solr.ulog.numVersionBuckets:65536}</int>
>> > </updateLog>*
>> >
>> >
>> > *target solr config*
>> >
>> > <requestHandler name="/cdcr" class="solr.CdcrRequestHandler">
>> > <lst name="buffer">
>> > <str name="defaultState">disabled</str>
>> > </lst>
>> > </requestHandler>
>> >
>> > <requestHandler name="/update" class="solr.UpdateRequestHandler">
>> > <lst name="defaults">
>> > <str name="update.chain">cdcr-processor-chain</str>
>> > </lst>
>> > </requestHandler>
>> >
>> > <updateRequestProcessorChain name="cdcr-processor-chain">
>> > <processor class="solr.CdcrUpdateProcessorFactory"/>
>> > <processor class="solr.RunUpdateProcessorFactory"/>
>> > </updateRequestProcessorChain>
>> >
>> > *target status*
>> >
>> > <response><lst name="responseHeader"><int name="status">0</int><int
>> > name="QTime">0</int></lst><lst name="status"><str
>> > name="process">stopped</str><str
>> > name="buffer">disabled</str></lst></response>
>> >
>> > *source status*
>> >
>> > <response><lst name="responseHeader"><int name="status">0</int><int
>> > name="QTime">0</int></lst><lst name="status"><str
>> > name="process">started</str><str
>> > name="buffer">enabled</str></lst></response>
>>
>
>
Re: error while working solr 6.2 cdcr
Posted by Neeraj Bhatt <ne...@gmail.com>.
Hi Eric
Source have only target zookeeper ensemble (only 3 ips)
<str name="zkHost">192.169.35.53:2181,192.169.35.249:2181,
192.169.35.251:2181> , because of some mail formatting ip were repeated(see
sent item attached image). Error in log files is
Action LASTPROCESSEDVERSION sent to non-leader replica at
org.apache.solr.handler.CdcrRequestHandler.handleLastProcess
edVersionAction(CdcrRequestHandler.java:498)
I will start with empty collection with 3 nodes 3 shards one replication
factor, It seems from log that request from souce is going to non leader
replica.
Please suggest
Thanks
On Wed, Nov 9, 2016 at 9:23 PM, Erick Erickson <er...@gmail.com>
wrote:
> Why do you have 6 zookeepers listed in the zkHost parameter? My guess
> is that you've listed the ZK addresses for both the source and target
> clusters. This should only be the ZK nodes for the target cluster and
> only present on the source.
>
> The source already knows its own ZK addresses, it needs to know about
> the target cluster in order to know what nodes it should send updates
> to.
>
> Best,
> Erick
>
> On Wed, Nov 9, 2016 at 4:44 AM, Neeraj Bhatt <ne...@gmail.com>
> wrote:
> > Hello All
> >
> > I have a source cluster (3 nodes, 3 shards and 3 replica) and same for
> > target cluster. On posting of documents to source I am getting below
> error
> > in target solr log files when i turned log to debug level
> >
> >
> >
> >
> > *6538 ERROR (qtp110456297-20) [c:multi_dc_poc s:shard1 r:core_node3
> > x:multi_dc_poc_shard1_replica2] o.a.s.h.RequestHandlerBase
> > org.apache.solr.common.SolrException: Action LASTPROCESSEDVERSION sent
> to
> > non-leader replica at
> > org.apache.solr.handler.CdcrRequestHandler.handleLastProcess
> edVersionAction(CdcrRequestHandler.java:498)*
> >
> > *should I reconfigure my replicas to one in target ?*
> >
> > solr config of source and target is same as given in wiki
> > https://cwiki.apache.org/confluence/pages/viewpage.action?pa
> geId=62687462
> >
> > *source *
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > *<requestHandler name="/cdcr"
> > class="solr.CdcrRequestHandler"> <lst
> > name="replica"> <str
> > name="zkHost">192.169.35.53:2181
> > <http://192.169.35.53:2181>,192.169.35.249:2181
> > <http://192.169.35.249:2181>,192.169.35.251:2181
> > <http://192.169.35.251:2181>
> > </str> <str
> > name="source">multi_dc_poc</str> <str
> > name="target">multi_dc_poc</str> </lst>
> <lst
> > name="replicator"> <str
> > name="threadPoolSize">9</str> <str
> > name="schedule">1000</str> <str
> > name="batchSize">128</str> </lst> <lst
> > name="updateLogSynchronizer"> <str
> > name="schedule">1000</str> </lst>
> </requestHandler>*
> >
> >
> >
> >
> >
> >
> >
> > *source and target update log <updateLog
> > class="solr.CdcrUpdateLog"> <str
> > name="dir">${solr.ulog.dir:}</str> <int
> > name="numVersionBuckets">${solr.ulog.numVersionBuckets:65536}</int>
> > </updateLog>*
> >
> >
> > *target solr config*
> >
> > <requestHandler name="/cdcr" class="solr.CdcrRequestHandler">
> > <lst name="buffer">
> > <str name="defaultState">disabled</str>
> > </lst>
> > </requestHandler>
> >
> > <requestHandler name="/update" class="solr.UpdateRequestHandler">
> > <lst name="defaults">
> > <str name="update.chain">cdcr-processor-chain</str>
> > </lst>
> > </requestHandler>
> >
> > <updateRequestProcessorChain name="cdcr-processor-chain">
> > <processor class="solr.CdcrUpdateProcessorFactory"/>
> > <processor class="solr.RunUpdateProcessorFactory"/>
> > </updateRequestProcessorChain>
> >
> > *target status*
> >
> > <response><lst name="responseHeader"><int name="status">0</int><int
> > name="QTime">0</int></lst><lst name="status"><str
> > name="process">stopped</str><str
> > name="buffer">disabled</str></lst></response>
> >
> > *source status*
> >
> > <response><lst name="responseHeader"><int name="status">0</int><int
> > name="QTime">0</int></lst><lst name="status"><str
> > name="process">started</str><str
> > name="buffer">enabled</str></lst></response>
>
Re: error while working solr 6.2 cdcr
Posted by Erick Erickson <er...@gmail.com>.
Why do you have 6 zookeepers listed in the zkHost parameter? My guess
is that you've listed the ZK addresses for both the source and target
clusters. This should only be the ZK nodes for the target cluster and
only present on the source.
The source already knows its own ZK addresses, it needs to know about
the target cluster in order to know what nodes it should send updates
to.
Best,
Erick
On Wed, Nov 9, 2016 at 4:44 AM, Neeraj Bhatt <ne...@gmail.com> wrote:
> Hello All
>
> I have a source cluster (3 nodes, 3 shards and 3 replica) and same for
> target cluster. On posting of documents to source I am getting below error
> in target solr log files when i turned log to debug level
>
>
>
>
> *6538 ERROR (qtp110456297-20) [c:multi_dc_poc s:shard1 r:core_node3
> x:multi_dc_poc_shard1_replica2] o.a.s.h.RequestHandlerBase
> org.apache.solr.common.SolrException: Action LASTPROCESSEDVERSION sent to
> non-leader replica at
> org.apache.solr.handler.CdcrRequestHandler.handleLastProcessedVersionAction(CdcrRequestHandler.java:498)*
>
> *should I reconfigure my replicas to one in target ?*
>
> solr config of source and target is same as given in wiki
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62687462
>
> *source *
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *<requestHandler name="/cdcr"
> class="solr.CdcrRequestHandler"> <lst
> name="replica"> <str
> name="zkHost">192.169.35.53:2181
> <http://192.169.35.53:2181>,192.169.35.249:2181
> <http://192.169.35.249:2181>,192.169.35.251:2181
> <http://192.169.35.251:2181>
> </str> <str
> name="source">multi_dc_poc</str> <str
> name="target">multi_dc_poc</str> </lst> <lst
> name="replicator"> <str
> name="threadPoolSize">9</str> <str
> name="schedule">1000</str> <str
> name="batchSize">128</str> </lst> <lst
> name="updateLogSynchronizer"> <str
> name="schedule">1000</str> </lst> </requestHandler>*
>
>
>
>
>
>
>
> *source and target update log <updateLog
> class="solr.CdcrUpdateLog"> <str
> name="dir">${solr.ulog.dir:}</str> <int
> name="numVersionBuckets">${solr.ulog.numVersionBuckets:65536}</int>
> </updateLog>*
>
>
> *target solr config*
>
> <requestHandler name="/cdcr" class="solr.CdcrRequestHandler">
> <lst name="buffer">
> <str name="defaultState">disabled</str>
> </lst>
> </requestHandler>
>
> <requestHandler name="/update" class="solr.UpdateRequestHandler">
> <lst name="defaults">
> <str name="update.chain">cdcr-processor-chain</str>
> </lst>
> </requestHandler>
>
> <updateRequestProcessorChain name="cdcr-processor-chain">
> <processor class="solr.CdcrUpdateProcessorFactory"/>
> <processor class="solr.RunUpdateProcessorFactory"/>
> </updateRequestProcessorChain>
>
> *target status*
>
> <response><lst name="responseHeader"><int name="status">0</int><int
> name="QTime">0</int></lst><lst name="status"><str
> name="process">stopped</str><str
> name="buffer">disabled</str></lst></response>
>
> *source status*
>
> <response><lst name="responseHeader"><int name="status">0</int><int
> name="QTime">0</int></lst><lst name="status"><str
> name="process">started</str><str
> name="buffer">enabled</str></lst></response>