You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jon Baer <jo...@gmail.com> on 2009/01/06 18:47:12 UTC
DataImportHandler (reading XML w/ paging)
Hi,
Anyone have a quick, clever way of dealing w/ paged XML for
DataImportHandler? I have metadata like this:
<paging>
<pageNumber>1</pageNumber>
<totalPages>3</totalPages>
<count>15</count>
</paging>
I unfortunately can not get all the data in one shot so I need to
maybe a number of requests obtained from the paging meta, but can't
figure out if this is dynamically possible w/ the current DIH setup.
Any tips?
Thanks.
- Jon
Re: DataImportHandler (reading XML w/ paging)
Posted by Noble Paul നോബിള് नोब्ळ् <no...@gmail.com>.
Paging is possible w/ XPathEntityProcessor
look at the $hasMore and $nextUrl in the documentation
if you can explain better and I may be able to give a better solution
eg: where is the metadata coming from and what is the datasource
On Tue, Jan 6, 2009 at 11:17 PM, Jon Baer <jo...@gmail.com> wrote:
> Hi,
>
> Anyone have a quick, clever way of dealing w/ paged XML for
> DataImportHandler? I have metadata like this:
>
> <paging>
> <pageNumber>1</pageNumber>
> <totalPages>3</totalPages>
> <count>15</count>
> </paging>
>
> I unfortunately can not get all the data in one shot so I need to
> maybe a number of requests obtained from the paging meta, but can't
> figure out if this is dynamically possible w/ the current DIH setup.
> Any tips?
>
> Thanks.
>
> - Jon
>
--
--Noble Paul