You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Song Hyonwoo (JIRA)" <ji...@apache.org> on 2015/09/10 08:44:45 UTC

[jira] [Commented] (SOLR-7925) Implement indexing from gzip format file

    [ https://issues.apache.org/jira/browse/SOLR-7925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738274#comment-14738274 ] 

Song Hyonwoo commented on SOLR-7925:
------------------------------------

This patch will help to save network bandwidth when you update file to remote solr server.
If you need to update big file frequently to remote solr, you can update the file as gzipped format with this patch. 
If your system's network traffic is quite busy this patch is useful to save network bandwidth.

You can test it like this.
$ cd solr/core
$ ant test -Dtestcase=GZipCompressedUpdateRequestHandlerTest

Thanks.


> Implement indexing from gzip format file
> ----------------------------------------
>
>                 Key: SOLR-7925
>                 URL: https://issues.apache.org/jira/browse/SOLR-7925
>             Project: Solr
>          Issue Type: Improvement
>          Components: update
>    Affects Versions: 5.2.1
>            Reporter: Song Hyonwoo
>            Priority: Minor
>              Labels: patch
>         Attachments: SOLR-7925.patch
>
>
> This will support the update of gzipped format file of Json, Xml and CSV.
> The request path will use "update/compress/gzip" instead of "update" with "update.contentType" parameter  and  "Content-Type: application/gzip" as Header field.
> The following is sample request using curl command. (use not --data but --data-binary)
> curl "http://localhost:8080/solr/collection1/update/compress/gzip?update.contentType=application/json&commit=true" -H 'Content-Type: application/gzip' --data-binary @data.json.gz
> To activate this function need to add following request handler information to solrconfig.xml
>   <requestHandler name="/update/compress/gzip" class="org.apache.solr.handler.CompressedUpdateRequestHandler">
>     <lst name="defaults">
>       <str name="stream.contentType">application/gzip</str>
>     </lst>
>   </requestHandler>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org