Extract multiple streams into the same document

[Yury Kats <yu...@yahoo.com>]

I'm sending streams of data to Solr, using ExtractingRequestHandler to be parsed/extracted by Tika and then indexed.

While multiple streams can be passed with a single request to Solr, each stream ends up being indexed into a separate document.
Or, if I pass the unique id parameter with the request (as "literal.id" parameter), the very last stream ends up overwriting all
other streams withing the same request, since each one is being indexed into a new document with the same id.

I'm looking for a way to have multiple streams indexed into the same document. I have a content field defined for extraction
(using fmap.content parameter) and the field is defined as multiValued in the schema. I would like all streams from the request to be
indexed as different values of that multiValued content field in the same document.

Any hints or ideas are appreciated.

Thanks,
Yury

Re: Extract multiple streams into the same document

[Yury Kats <yu...@yahoo.com>]

Answering my own question, for archive's sake,
I worked this out by creating my own UpdateRequestProcessor.

On 10/4/2012 2:35 PM, Yury Kats wrote:
> I'm sending streams of data to Solr, using ExtractingRequestHandler to be parsed/extracted by Tika and then indexed.
> 
> While multiple streams can be passed with a single request to Solr, each stream ends up being indexed into a separate document.
> Or, if I pass the unique id parameter with the request (as "literal.id" parameter), the very last stream ends up overwriting all
> other streams withing the same request, since each one is being indexed into a new document with the same id.
> 
> I'm looking for a way to have multiple streams indexed into the same document. I have a content field defined for extraction
> (using fmap.content parameter) and the field is defined as multiValued in the schema. I would like all streams from the request to be
> indexed as different values of that multiValued content field in the same document.
> 
> Any hints or ideas are appreciated.
> 
> Thanks,
> Yury
>