You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Alexandre Rafalovitch (JIRA)" <ji...@apache.org> on 2016/04/16 14:13:25 UTC

[jira] [Commented] (SOLR-7383) DIH rss example is broken again

    [ https://issues.apache.org/jira/browse/SOLR-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244177#comment-15244177 ] 

Alexandre Rafalovitch commented on SOLR-7383:
---------------------------------------------

Looks like this fix never went in. I just tested it with 6.0 and the proposal works apart from the commonField items (/RDF/channel) ones. Which I cannot get to work whatever I do. 

Interestingly, the [Reference Guide|https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler#UploadingStructuredDataStoreDatawiththeDataImportHandler-TheXPathEntityProcessor] has a different version of the same file that does not match either current or proposed text. But it does have *forEach="/RDF/item|/RDF/channel"* which should have made commonField work (but does not seem to).

Finally, the managed-schema file has some of the fields defined as stored=false. Which makes zero sense in terms of demonstrating that the RSS reader works and should probably be fixed as well as part of any cleanup.

> DIH rss example is broken again
> -------------------------------
>
>                 Key: SOLR-7383
>                 URL: https://issues.apache.org/jira/browse/SOLR-7383
>             Project: Solr
>          Issue Type: Bug
>          Components: contrib - DataImportHandler
>    Affects Versions: 5.0, master
>            Reporter: Upayavira
>            Priority: Minor
>
> The DIH example (solr/example/example-DIH/solr/rss/conf/rss-data-config.xml) is broken again. See associated issues.
> Below is a config that should work.
> This is caused by Slashdot seemingly oscillating between RDF/RSS and pure RSS. Perhaps we should depend upon something more static, rather than an external service that is free to change as it desires.
> <dataConfig>
>     <dataSource type="URLDataSource" />
>     <document>
>         <entity name="slashdot"
>                 pk="link"
>                 url="http://rss.slashdot.org/Slashdot/slashdot"
>                 processor="XPathEntityProcessor"
>                 forEach="/RDF/item"
>                 transformer="DateFormatTransformer">
> 				
>             <field column="source" xpath="/RDF/channel/title" commonField="true" />
>             <field column="source-link" xpath="/RDF/channel/link" commonField="true" />
>             <field column="subject" xpath="/RDF/channel/subject" commonField="true" />
> 			
>             <field column="title" xpath="/RDF/item/title" />
>             <field column="link" xpath="/RDF/item/link" />
>             <field column="description" xpath="/RDF/item/description" />
>             <field column="creator" xpath="/RDF/item/creator" />
>             <field column="item-subject" xpath="/RDF/item/subject" />
>             <field column="date" xpath="/RDF/item/date" dateTimeFormat="yyyy-MM-dd'T'HH:mm:ss" />
>             <field column="slash-department" xpath="/RDF/item/department" />
>             <field column="slash-section" xpath="/RDF/item/section" />
>             <field column="slash-comments" xpath="/RDF/item/comments" />
>         </entity>
>     </document>
> </dataConfig>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org