You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jon Baer <jo...@gmail.com> on 2009/01/06 18:47:12 UTC

DataImportHandler (reading XML w/ paging)

Hi,

Anyone have a quick, clever way of dealing w/ paged XML for
DataImportHandler?  I have metadata like this:

<paging>
		<pageNumber>1</pageNumber>
		<totalPages>3</totalPages>
		<count>15</count>
	</paging>

I unfortunately can not get all the data in one shot so I need to
maybe a number of requests obtained from the paging meta, but can't
figure out if this is dynamically possible w/ the current DIH setup.
Any tips?

Thanks.

- Jon

Re: DataImportHandler (reading XML w/ paging)

Posted by Noble Paul നോബിള്‍ नोब्ळ् <no...@gmail.com>.
Paging is possible w/ XPathEntityProcessor
look at the $hasMore and $nextUrl in the documentation
if you can explain better and I may be able to give a better solution
eg: where is the metadata coming from and what is the datasource

On Tue, Jan 6, 2009 at 11:17 PM, Jon Baer <jo...@gmail.com> wrote:
> Hi,
>
> Anyone have a quick, clever way of dealing w/ paged XML for
> DataImportHandler?  I have metadata like this:
>
> <paging>
>                <pageNumber>1</pageNumber>
>                <totalPages>3</totalPages>
>                <count>15</count>
>        </paging>
>
> I unfortunately can not get all the data in one shot so I need to
> maybe a number of requests obtained from the paging meta, but can't
> figure out if this is dynamically possible w/ the current DIH setup.
> Any tips?
>
> Thanks.
>
> - Jon
>



-- 
--Noble Paul