Solr Doubts

[Jiyas Basha H <ji...@mobiusservices.in>]

Hai Team, 

I am new to Solr. 
I am trying to index 7GB CSV file. 

My questions: 
1.How to index without using uniquekey ? 

I tried with <uniquekey required = "false" >id</uniquekey> 

I got --> Document is missing mandatory uniqueKey field: id 

I am using query to update csv : localhost:9050/solr-4.5.1/collection1/update/csv?stream.file=D:\Solr\comma15_Id.csv&commit=true&header=false&fieldnames=ORD,ORC,SBN,BNA,POB,NUM,DST,STM,DDL,DLO,PTN,PCD,CTA,CTP,CTT 

2. how to increase jvm heap space in solr ? 
since my file is too large i am getting java heap space error 

I am not interested to split my large file into batches.however i need to complete indexing with 7GB CSV file. 

please assist me to index my csv file 





with regards 
Jiyas 

Problems are only opportunities with thorns on them. 

Re: Solr Doubts

[Erick Erickson <er...@gmail.com>]

bq: <uniquekey required = "false" >id</uniquekey>

This isn't correct, there's no "required" param for
<uniqueKey>. Just remove the entire <uniqueKey> node
AND make the field definition required="false". I.e. you
should have something like:
<field name="id" type="string" indexed="true" stored="true" required="true"
multiValued="false" />
set required="false" there.

To increase memory, you just specify -Xmx when you start,
something like:
java -Xmx2G -Xms2G -jar start.jar

But interested or not in splitting the csv file, working with 7G
input files is going to be painful no matter what. You may
find yourself having to split it up for expediency's sake.

Best,
Erick


On Wed, Dec 4, 2013 at 7:46 AM, Jiyas Basha H <jiyasbashah@mobiusservices.in
> wrote:

> Hai Team,
>
> I am new to Solr.
> I am trying to index 7GB CSV file.
>
> My questions:
> 1.How to index without using uniquekey ?
>
> I tried with <uniquekey required = "false" >id</uniquekey>
>
> I got --> Document is missing mandatory uniqueKey field: id
>
> I am using query to update csv :
> localhost:9050/solr-4.5.1/collection1/update/csv?stream.file=D:\Solr\comma15_Id.csv&commit=true&header=false&fieldnames=ORD,ORC,SBN,BNA,POB,NUM,DST,STM,DDL,DLO,PTN,PCD,CTA,CTP,CTT
>
> 2. how to increase jvm heap space in solr ?
> since my file is too large i am getting java heap space error
>
> I am not interested to split my large file into batches.however i need to
> complete indexing with 7GB CSV file.
>
> please assist me to index my csv file
>
>
>
>
>
> with regards
> Jiyas
>
> Problems are only opportunities with thorns on them.
>