You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Brandon Evans (JIRA)" <ji...@apache.org> on 2010/09/03 19:31:32 UTC

[jira] Created: (SOLR-2099) Add ability to throttle rsync based replication using rsync option --bwlimit

Add ability to throttle rsync based replication using rsync option --bwlimit
----------------------------------------------------------------------------

                 Key: SOLR-2099
                 URL: https://issues.apache.org/jira/browse/SOLR-2099
             Project: Solr
          Issue Type: Improvement
          Components: replication (scripts)
    Affects Versions: 1.4.1
         Environment: RHEL 5.x
            Reporter: Brandon Evans
            Priority: Trivial


This patch allows for the use of the new option 'rsyncd_bwlimit' in scripts.conf.

rsyncd_bwlimit adds  --bwlimit=XX to the rsyncd command line.  If the option is not specified bwlimit is set to 0 by default.

"       --bwlimit=KBPS
              This  option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with large files (several
              megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it  will  wait  before
              sending the next data block. The result is an average transfer rate equaling the specified limit. A value of zero specifies no limit."



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Updated: (SOLR-2099) Add ability to throttle rsync based replication using rsync option --bwlimit

Posted by "Koji Sekiguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Sekiguchi updated SOLR-2099:
---------------------------------

    Fix Version/s: 3.1
                   4.0

> Add ability to throttle rsync based replication using rsync option --bwlimit
> ----------------------------------------------------------------------------
>
>                 Key: SOLR-2099
>                 URL: https://issues.apache.org/jira/browse/SOLR-2099
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>    Affects Versions: 1.4.1
>         Environment: RHEL 5.x
>            Reporter: Brandon Evans
>            Assignee: Koji Sekiguchi
>            Priority: Trivial
>             Fix For: 3.1, 4.0
>
>         Attachments: solr-1.4.0-rsyncd_bwlimit.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> This patch allows for the use of the new option 'rsyncd_bwlimit' in scripts.conf.
> rsyncd_bwlimit adds  --bwlimit=XX to the rsyncd command line.  If the option is not specified bwlimit is set to 0 by default.
> "       --bwlimit=KBPS
>               This  option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with large files (several
>               megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it  will  wait  before
>               sending the next data block. The result is an average transfer rate equaling the specified limit. A value of zero specifies no limit."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Commented: (SOLR-2099) Add ability to throttle rsync based replication using rsync option --bwlimit

Posted by "Koji Sekiguchi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12906128#action_12906128 ] 

Koji Sekiguchi commented on SOLR-2099:
--------------------------------------

Thanks, Brandon! I'll commit in a few days if no one objects.

> Add ability to throttle rsync based replication using rsync option --bwlimit
> ----------------------------------------------------------------------------
>
>                 Key: SOLR-2099
>                 URL: https://issues.apache.org/jira/browse/SOLR-2099
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>    Affects Versions: 1.4.1
>         Environment: RHEL 5.x
>            Reporter: Brandon Evans
>            Assignee: Koji Sekiguchi
>            Priority: Trivial
>             Fix For: 3.1, 4.0
>
>         Attachments: solr-1.4.0-rsyncd_bwlimit.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> This patch allows for the use of the new option 'rsyncd_bwlimit' in scripts.conf.
> rsyncd_bwlimit adds  --bwlimit=XX to the rsyncd command line.  If the option is not specified bwlimit is set to 0 by default.
> "       --bwlimit=KBPS
>               This  option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with large files (several
>               megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it  will  wait  before
>               sending the next data block. The result is an average transfer rate equaling the specified limit. A value of zero specifies no limit."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Resolved: (SOLR-2099) Add ability to throttle rsync based replication using rsync option --bwlimit

Posted by "Koji Sekiguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Sekiguchi resolved SOLR-2099.
----------------------------------

    Resolution: Fixed

trunk: Committed revision 992913.
branch_3x: Committed revision 992915.

> Add ability to throttle rsync based replication using rsync option --bwlimit
> ----------------------------------------------------------------------------
>
>                 Key: SOLR-2099
>                 URL: https://issues.apache.org/jira/browse/SOLR-2099
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>    Affects Versions: 1.4.1
>         Environment: RHEL 5.x
>            Reporter: Brandon Evans
>            Assignee: Koji Sekiguchi
>            Priority: Trivial
>             Fix For: 3.1, 4.0
>
>         Attachments: solr-1.4.0-rsyncd_bwlimit.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> This patch allows for the use of the new option 'rsyncd_bwlimit' in scripts.conf.
> rsyncd_bwlimit adds  --bwlimit=XX to the rsyncd command line.  If the option is not specified bwlimit is set to 0 by default.
> "       --bwlimit=KBPS
>               This  option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with large files (several
>               megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it  will  wait  before
>               sending the next data block. The result is an average transfer rate equaling the specified limit. A value of zero specifies no limit."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Assigned: (SOLR-2099) Add ability to throttle rsync based replication using rsync option --bwlimit

Posted by "Koji Sekiguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Sekiguchi reassigned SOLR-2099:
------------------------------------

    Assignee: Koji Sekiguchi

> Add ability to throttle rsync based replication using rsync option --bwlimit
> ----------------------------------------------------------------------------
>
>                 Key: SOLR-2099
>                 URL: https://issues.apache.org/jira/browse/SOLR-2099
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>    Affects Versions: 1.4.1
>         Environment: RHEL 5.x
>            Reporter: Brandon Evans
>            Assignee: Koji Sekiguchi
>            Priority: Trivial
>         Attachments: solr-1.4.0-rsyncd_bwlimit.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> This patch allows for the use of the new option 'rsyncd_bwlimit' in scripts.conf.
> rsyncd_bwlimit adds  --bwlimit=XX to the rsyncd command line.  If the option is not specified bwlimit is set to 0 by default.
> "       --bwlimit=KBPS
>               This  option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with large files (several
>               megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it  will  wait  before
>               sending the next data block. The result is an average transfer rate equaling the specified limit. A value of zero specifies no limit."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Updated: (SOLR-2099) Add ability to throttle rsync based replication using rsync option --bwlimit

Posted by "Brandon Evans (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Brandon Evans updated SOLR-2099:
--------------------------------

    Attachment: solr-1.4.0-rsyncd_bwlimit.patch

This patch applies fine against solr 1.4 & 1.4.1

By default it adds --bwlimit=0 to the rsyncd command line.

> Add ability to throttle rsync based replication using rsync option --bwlimit
> ----------------------------------------------------------------------------
>
>                 Key: SOLR-2099
>                 URL: https://issues.apache.org/jira/browse/SOLR-2099
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>    Affects Versions: 1.4.1
>         Environment: RHEL 5.x
>            Reporter: Brandon Evans
>            Priority: Trivial
>         Attachments: solr-1.4.0-rsyncd_bwlimit.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> This patch allows for the use of the new option 'rsyncd_bwlimit' in scripts.conf.
> rsyncd_bwlimit adds  --bwlimit=XX to the rsyncd command line.  If the option is not specified bwlimit is set to 0 by default.
> "       --bwlimit=KBPS
>               This  option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with large files (several
>               megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it  will  wait  before
>               sending the next data block. The result is an average transfer rate equaling the specified limit. A value of zero specifies no limit."

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org