You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Spadez <ja...@hotmail.com> on 2012/04/20 11:35:22 UTC

Importing formats - Which works best with Solr?

Hi,

I am designing a custom scrapping solution. I need to store my data, do some
post processing on it and then import it into SOLR. 

If I want to import data into SOLR in the quickest, easiest way possible,
what format should I be saving my scrapped data in? I get the impression
that .XML would be the best choice but I don’t really have much grounding
for that.

Any input would be appreciated.

James


--
View this message in context: http://lucene.472066.n3.nabble.com/Importing-formats-Which-works-best-with-Solr-tp3925557p3925557.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Importing formats - Which works best with Solr?

Posted by Erick Erickson <er...@gmail.com>.
CSV files can also be imported, which may be more
compact.

Best
Erick

On Fri, Apr 20, 2012 at 6:01 AM, Dmitry Kan <dm...@gmail.com> wrote:
> James,
>
> You could create xml files of format:
>
> <add>
> <doc><field name="id">1</field><field
> name="Name"><![CDATA[James]]></field><field
> name="Surname"><![CDATA[Willson]]></field></doc>
> <!-- more <doc>'s here -->
> </add>
>
> and then post them to SOLR using, for example, the post.sh utility from
> SOLR's binary distribution.
>
> HTH,
> Dmitry
>
> On Fri, Apr 20, 2012 at 12:35 PM, Spadez <ja...@hotmail.com> wrote:
>
>> Hi,
>>
>> I am designing a custom scrapping solution. I need to store my data, do
>> some
>> post processing on it and then import it into SOLR.
>>
>> If I want to import data into SOLR in the quickest, easiest way possible,
>> what format should I be saving my scrapped data in? I get the impression
>> that .XML would be the best choice but I don’t really have much grounding
>> for that.
>>
>> Any input would be appreciated.
>>
>> James
>>
>>
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/Importing-formats-Which-works-best-with-Solr-tp3925557p3925557.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>
>
>
> --
> Regards,
>
> Dmitry Kan

Re: Importing formats - Which works best with Solr?

Posted by Dmitry Kan <dm...@gmail.com>.
James,

You could create xml files of format:

<add>
<doc><field name="id">1</field><field
name="Name"><![CDATA[James]]></field><field
name="Surname"><![CDATA[Willson]]></field></doc>
<!-- more <doc>'s here -->
</add>

and then post them to SOLR using, for example, the post.sh utility from
SOLR's binary distribution.

HTH,
Dmitry

On Fri, Apr 20, 2012 at 12:35 PM, Spadez <ja...@hotmail.com> wrote:

> Hi,
>
> I am designing a custom scrapping solution. I need to store my data, do
> some
> post processing on it and then import it into SOLR.
>
> If I want to import data into SOLR in the quickest, easiest way possible,
> what format should I be saving my scrapped data in? I get the impression
> that .XML would be the best choice but I don’t really have much grounding
> for that.
>
> Any input would be appreciated.
>
> James
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Importing-formats-Which-works-best-with-Solr-tp3925557p3925557.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>



-- 
Regards,

Dmitry Kan