You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Alexandre Rafalovitch (JIRA)" <ji...@apache.org> on 2016/10/05 05:29:20 UTC
[jira] [Commented] (SOLR-1544) Python script to post multiple files
to solr using a queue and worker threads
[ https://issues.apache.org/jira/browse/SOLR-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15547729#comment-15547729 ]
Alexandre Rafalovitch commented on SOLR-1544:
---------------------------------------------
Solr now has bin/post that is a lot more robust. If that's not enough, the next step up is probably custom SolrJ implementation.
I believe this issue can be closed as - no longer - relevant.
> Python script to post multiple files to solr using a queue and worker threads
> -----------------------------------------------------------------------------
>
> Key: SOLR-1544
> URL: https://issues.apache.org/jira/browse/SOLR-1544
> Project: Solr
> Issue Type: Improvement
> Components: update
> Affects Versions: 1.5
> Environment: Python 2.6 and above
> Reporter: Dennis Kubes
> Priority: Minor
> Fix For: 4.9, 6.0
>
> Attachments: postqueue.py
>
>
> The is a simple python script that uses a blocking queue and multiple worker threads to post updates (files) to solr. Works when calling post.sh won't because of too many files or when
> you want to throttle the speed at which you are updating solr. Tested with runs as high as 30K files.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org