You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by "Dan Rosher (JIRA)" <ji...@apache.org> on 2009/01/27 17:36:59 UTC

[jira] Created: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Add pid file to snapinstaller to skip script overruns, and recover from faliure
-------------------------------------------------------------------------------

                 Key: SOLR-990
                 URL: https://issues.apache.org/jira/browse/SOLR-990
             Project: Solr
          Issue Type: Improvement
          Components: replication (scripts)
            Reporter: Dan Rosher
            Priority: Minor


The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 

Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:

http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 

This means that one can do the following

*/1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller

Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.

currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Posted by "Dan Rosher (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Rosher updated SOLR-990:
----------------------------

    Attachment: SOLR-990.patch

The last patch had an unintended edit

> Add pid file to snapinstaller to skip script overruns, and recover from faliure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Priority: Minor
>         Attachments: SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Posted by "Bill Au (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667726#action_12667726 ] 

Bill Au commented on SOLR-990:
------------------------------

The pid file should be move under the logs directory.  I don't think it is a good idea to keep the pid file under /tmp.  

> Add pid file to snapinstaller to skip script overruns, and recover from faliure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Priority: Minor
>         Attachments: SOLR-990.patch, SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Posted by "Dan Rosher (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Rosher updated SOLR-990:
----------------------------

    Attachment: SOLR-990.patch

> Add pid file to snapinstaller to skip script overruns, and recover from faliure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Priority: Minor
>         Attachments: SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from failure

Posted by "Otis Gospodnetic (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Otis Gospodnetic updated SOLR-990:
----------------------------------

    Fix Version/s: 1.4
         Assignee: Otis Gospodnetic
          Summary: Add pid file to snapinstaller to skip script overruns, and recover from failure  (was: Add pid file to snapinstaller to skip script overruns, and recover from faliure)

> Add pid file to snapinstaller to skip script overruns, and recover from failure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Assignee: Otis Gospodnetic
>            Priority: Minor
>             Fix For: 1.4
>
>         Attachments: SOLR-990.patch, SOLR-990.patch, SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from failure

Posted by "Otis Gospodnetic (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Otis Gospodnetic resolved SOLR-990.
-----------------------------------

    Resolution: Fixed

Thank you, Dan!

Sending        src/scripts/snapinstaller
Transmitting file data .
Committed revision 781069.


> Add pid file to snapinstaller to skip script overruns, and recover from failure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Assignee: Otis Gospodnetic
>            Priority: Minor
>             Fix For: 1.4
>
>         Attachments: SOLR-990.patch, SOLR-990.patch, SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Posted by "Dan Rosher (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12667976#action_12667976 ] 

Dan Rosher commented on SOLR-990:
---------------------------------

PID now in logs dir

> Add pid file to snapinstaller to skip script overruns, and recover from faliure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Priority: Minor
>         Attachments: SOLR-990.patch, SOLR-990.patch, SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Posted by "Dan Rosher (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Rosher updated SOLR-990:
----------------------------

    Attachment: SOLR-990.patch

> Add pid file to snapinstaller to skip script overruns, and recover from faliure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Priority: Minor
>         Attachments: SOLR-990.patch, SOLR-990.patch, SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (SOLR-990) Add pid file to snapinstaller to skip script overruns, and recover from faliure

Posted by "Dan Rosher (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Rosher updated SOLR-990:
----------------------------

    Attachment: SOLR-990.patch

> Add pid file to snapinstaller to skip script overruns, and recover from faliure
> -------------------------------------------------------------------------------
>
>                 Key: SOLR-990
>                 URL: https://issues.apache.org/jira/browse/SOLR-990
>             Project: Solr
>          Issue Type: Improvement
>          Components: replication (scripts)
>            Reporter: Dan Rosher
>            Priority: Minor
>         Attachments: SOLR-990.patch, SOLR-990.patch, SOLR-990.patch
>
>
> The pid file will allow snapinstaller to be run as fast as possible without overruns. Also it will recover from a last failed run should an older snapinstaller process no longer be running. 
> Avoiding overruns means that snapinstaller can be run as fast as possible, but without suffering from the performance issue described here:
> http://wiki.apache.org/solr/SolrPerformanceFactors#head-fc7f22035c493431d58c5404ab22aef0ee1b9909 
> This means that one can do the following
> */1 * * * *     ..../bin/snappuller   && ..../bin/snapinstaller
> Even with a 'properly tuned' setup, there can be times where snapinstaller can suffer from overruns due to a lack of resources, or an unoptimized index using more resources etc.
> currently the pid will live in /tmp ... perhaps it should be in the logs dir?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.