[jira] Issue Comment Edited: (SOLR-524) snappuller has limitation w/r/t/ handling multiple web apps

["Bill Au (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SOLR-524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584150#action_12584150 ] 

billa edited comment on SOLR-524 at 4/1/08 7:27 AM:
------------------------------------------------------

In the command line in question:

rsync -Wa${verbose}${compress} --delete ${sizeonly} \
${stats} rsync://${master_host}:${rsyncd_port}/solr/${name}/ ${data_dir}/${name}-wip

The string "solr" IS NOT the webapp name.  II is the name used by rsyncd to map to a file system path.

Here is the content of rsyncd.conf, which is generated by rsyncd-start dynamically:

uid = $(whoami)
gid = $(whoami)
use chroot = no
list = no
pid file = ${solr_root}/logs/rsyncd.pid
log file = ${solr_root}/logs/rsyncd.log
[solr]
    path = ${data_dir}
    comment = Solr



      was (Author: billa):
    In the command line in question:

rsync -Wa${verbose}${compress} --delete ${sizeonly} \
${stats} rsync://${master_host}:${rsyncd_port}/solr/${name}/ ${data_dir}/${name}-wip

The string "solr" IS NOT the webapp name.  II is the name used by rsyncd to map to a file system path.

Here is the content of rsyncd.conf, which is generated by rsyncd-start dynamically:
#### rsyncd.conf file ####

uid = $(whoami)
gid = $(whoami)
use chroot = no
list = no
pid file = ${solr_root}/logs/rsyncd.pid
log file = ${solr_root}/logs/rsyncd.log
[solr]
    path = ${data_dir}
    comment = Solr


  
> snappuller has limitation w/r/t/ handling multiple web apps
> -----------------------------------------------------------
>
>                 Key: SOLR-524
>                 URL: https://issues.apache.org/jira/browse/SOLR-524
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication
>    Affects Versions: 1.2
>         Environment: Linux (CentOS release 5 (Final))
> Java JDK 6
>            Reporter: Ezra Epstein
>            Priority: Minor
>   Original Estimate: 0.5h
>  Remaining Estimate: 0.5h
>
> The snappuller has a limitation which makes it hard to use for replicating the indices for multiple webapps.  In particular, by changing:
> # rsync over files that have changed
> rsync -Wa${verbose}${compress} --delete ${sizeonly} \
> ${stats} rsync://${master_host}:${rsyncd_port}/solr/${name}/ ${data_dir}/${name}-wip
> to: 
> # rsync over files that have changed
> rsync -Wa${verbose}${compress} --delete ${sizeonly} \
> ${stats} rsync://${master_host}:${rsyncd_port}/${rsync_module_path}/${name}/ ${data_dir}/${name}-wip
> and adding an rsync_module_path variable to scripts.conf, plus giving it a default value of "solr" before the 'unset' commands at the top of the snappuller script, I've worked around the issue.  Still, it seems better to not hard-code the module name ([solr]) and also to allow some flexibility in the location of the data files under that module.  This is req'd for multiple webapps since they won't share a data folder.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.