You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Bruno Mannina <bm...@free.fr> on 2015/05/29 14:11:37 UTC

How to index 20 000 files with a command line ?

Dear Solr Users,

Habitualy i use this command line to index my files:
 >bin/post -c hbl /data/hbl-201522/*.xml

but today I have a big update, so there are 20 000 xml files (each files 
1ko<x<150ko)

I get this error:
Error: bin/post argument too long

How could I index the whole directory ?

Thanks a lot for your help,

Solr 5.0 - Ubuntu

Bruno

---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com

Re: How to index 20 000 files with a command line ?

Posted by Bruno Mannina <bm...@free.fr>.
oh yes like this:

  find  /data/hbl-201522/-name  "*.xml"  -exec  bin/post -c hbl  {}  \;

?

Le 29/05/2015 14:15, Sergey Shvets a écrit :
> Hello Bruno,
>
> You can use find command with exec attribute.
>
> regards
>   Sergey
>
> Friday, May 29, 2015, 3:11:37 PM, you wrote:
>
> Dear Solr Users,
>
> Habitualy i use this command line to index my files:
>   >bin/post -c hbl /data/hbl-201522/*.xml
>
> but today I have a big update, so there are 20 000 xml files (each files
> 1ko<x<150ko)
>
> I get this error:
> Error: bin/post argument too long
>
> How could I index the whole directory ?
>
> Thanks a lot for your help,
>
> Solr 5.0 - Ubuntu
>
> Bruno
>
> ---
> Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
> http://www.avast.com
>
>
>
>



---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com

Re: How to index 20 000 files with a command line ?

Posted by Sergey Shvets <se...@bintime.com>.
Hello Bruno,

You can use find command with exec attribute.

regards
 Sergey

Friday, May 29, 2015, 3:11:37 PM, you wrote:

Dear Solr Users,

Habitualy i use this command line to index my files:
 >bin/post -c hbl /data/hbl-201522/*.xml

but today I have a big update, so there are 20 000 xml files (each files 
1ko<x<150ko)

I get this error:
Error: bin/post argument too long

How could I index the whole directory ?

Thanks a lot for your help,

Solr 5.0 - Ubuntu

Bruno

---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com




-- 
Best regards,
 Sergey                            mailto:sergey@bintime.com