You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by Susmit Shukla <sh...@gmail.com> on 2016/06/07 21:08:09 UTC

start parameter for CloudSolrStream

*sending with correct subject*

Does solr streaming aggregation support pagination?
Some documents seem to be skipped if I set "start" parameter for
CloudSolrStream for a sharded collection.

Thanks,
Susmit

Re: start parameter for CloudSolrStream

Posted by Erick Erickson <er...@gmail.com>.

bq: Also are multiple fq clauses supported for CloudSolrStream params

Generally not before 6.1 (which will be out soon), see: SOLR-8467

Best,
Erick

On Wed, Jun 8, 2016 at 1:58 PM, Susmit Shukla <sh...@gmail.com> wrote:
> Thanks Joel,
>
> Yes, with /select handler start parameter is being applied to query running
> on individual shard and doesn't return expected aggregate results. Probably
> need to roll out some custom join on collections running on different solr
> clouds.
> Also are multiple fq clauses supported for CloudSolrStream params?
>
> Thanks,
> Susmit
>
> On Wed, Jun 8, 2016 at 8:58 AM, Joel Bernstein <jo...@gmail.com> wrote:
>
>> CloudSolrStream doesn't really understand the concept of paging. It just
>> sees a stream of Tuples coming from a collection and merges them.
>>
>> If you're using the default /select handler it will be passed the start
>> param and start from that point. But if use the /export handler the start
>> parameter will be ignored.
>>
>> In general though paging is not a supported feature yet of the Streaming
>> API. There are plans to support this in the future to add support for the
>> OFFSET SQL clause.
>>
>> Joel Bernstein
>> http://joelsolr.blogspot.com/
>>
>> On Tue, Jun 7, 2016 at 5:08 PM, Susmit Shukla <sh...@gmail.com>
>> wrote:
>>
>> > *sending with correct subject*
>> >
>> > Does solr streaming aggregation support pagination?
>> > Some documents seem to be skipped if I set "start" parameter for
>> > CloudSolrStream for a sharded collection.
>> >
>> > Thanks,
>> > Susmit
>> >
>>

Re: start parameter for CloudSolrStream

Posted by Susmit Shukla <sh...@gmail.com>.

Thanks Joel,

Yes, with /select handler start parameter is being applied to query running
on individual shard and doesn't return expected aggregate results. Probably
need to roll out some custom join on collections running on different solr
clouds.
Also are multiple fq clauses supported for CloudSolrStream params?

Thanks,
Susmit

On Wed, Jun 8, 2016 at 8:58 AM, Joel Bernstein <jo...@gmail.com> wrote:

> CloudSolrStream doesn't really understand the concept of paging. It just
> sees a stream of Tuples coming from a collection and merges them.
>
> If you're using the default /select handler it will be passed the start
> param and start from that point. But if use the /export handler the start
> parameter will be ignored.
>
> In general though paging is not a supported feature yet of the Streaming
> API. There are plans to support this in the future to add support for the
> OFFSET SQL clause.
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
> On Tue, Jun 7, 2016 at 5:08 PM, Susmit Shukla <sh...@gmail.com>
> wrote:
>
> > *sending with correct subject*
> >
> > Does solr streaming aggregation support pagination?
> > Some documents seem to be skipped if I set "start" parameter for
> > CloudSolrStream for a sharded collection.
> >
> > Thanks,
> > Susmit
> >
>

Re: start parameter for CloudSolrStream

Posted by Joel Bernstein <jo...@gmail.com>.

CloudSolrStream doesn't really understand the concept of paging. It just
sees a stream of Tuples coming from a collection and merges them.

If you're using the default /select handler it will be passed the start
param and start from that point. But if use the /export handler the start
parameter will be ignored.

In general though paging is not a supported feature yet of the Streaming
API. There are plans to support this in the future to add support for the
OFFSET SQL clause.

Joel Bernstein
http://joelsolr.blogspot.com/

On Tue, Jun 7, 2016 at 5:08 PM, Susmit Shukla <sh...@gmail.com>
wrote:

> *sending with correct subject*
>
> Does solr streaming aggregation support pagination?
> Some documents seem to be skipped if I set "start" parameter for
> CloudSolrStream for a sharded collection.
>
> Thanks,
> Susmit
>