[jira] Commented: (SOLR-994) EnumeratedEntityTransformer

["Noble Paul (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668348#action_12668348 ] 

Noble Paul commented on SOLR-994:
---------------------------------

I guess this is already possible w/ any change.

{code}
<entity name="myEntity" processor="XPathEntityProcessor" transformer="MyTrans" url="http://host:port/path/to/resource?maximum_number_returned=50&return_start_index=${myEntity.somename}" chunkSize=50></entity>

{code}

The MyTransformer can put in a variable called 'somename' into the row and one extra variable called '$hasMore' with a value "true" . XPathEntityprocessor automatically takes up this value 'somename' and make a request after all your current set of rows are done with. 

one extra addition which I can think of is put an implicit variable 'rowsFetchedCount ' into the variableresolver so that it can be directly used .

> EnumeratedEntityTransformer
> ---------------------------
>
>                 Key: SOLR-994
>                 URL: https://issues.apache.org/jira/browse/SOLR-994
>             Project: Solr
>          Issue Type: New Feature
>          Components: contrib - DataImportHandler
>    Affects Versions: 1.4
>            Reporter: Jared Flatow
>            Priority: Minor
>             Fix For: 1.4
>
>         Attachments: SOLR-994.patch
>
>
> An EnumeratedEntityTransformer gives the Nth entity an accessible ${<entity>.n} == N. In addition, the entity may specify a chunkSize attribute, which will cause the chunkSize'th entity to gain the attribute $hasMore=true. A template for a nextUrl may also be specified on the entity, that is different from the url template.
> Consider an API:
> http://host:port/path/to/resource?maximum_number_returned=50&return_start_index=0
> an entity could specify:
> <entity name="myEntity" processor="XPathEntityProcessor" transformer="EnumeratedEntityTransformer" url="http://host:port/path/to/resource?maximum_number_returned=50&return_start_index=${myEntity.n}" chunkSize=50>...</entity>
> This allows for fetching entities in chunks until there are < chunkSize returned.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.