You are viewing a plain text version of this content. The canonical link for it is here.
Posted to sysadmins@spamassassin.apache.org by Dave Jones <da...@apache.org> on 2017/12/31 18:43:19 UTC

Mirror rsync source restore

Kevin,

As I was setting up the new sa-update.spamassassin.org on the new 
Sonic.net server, I noticed the rsync'd files were incomplete. This time 
I know I didn't delete anything from the source on sa-vm1.apache.org. 
:)  I have checked all cron entries/scripts for anything that might be 
cleaning these source rsync rulesets up and can't find anything on 
sa-vm1.apache.org.

I know you mentioned in the past that this causes problems with some 
older clients that are locked in at old rulesets so I wanted to let you 
know so you can restore from the Crashplan backup.

Dave


Re: Mirror rsync source restore

Posted by "Kevin A. McGrail" <ke...@mcgrail.com>.
Ty. 
Regards,
KAM

On December 31, 2017 3:14:26 PM EST, Dave Jones <da...@apache.org> wrote:
>I restored all of the files back into the source rsync updates dir.
>
>That RM line on history line 1916 would not delete all of those files 
>and it's most likely in the automc/tmp directory anyway.
>
>I haven't logged into the server recently until yesterday to start work
>
>on setting up the new Sonic.net server:
>
>root@sa-vm1:/var/www/automc.spamassassin.org/updates# last
>kmcgrail pts/1        100.36.147.30    Sun Dec 31 19:44   still logged
>in
>davej    pts/0        76.187.196.227   Sun Dec 31 18:21   still logged
>in
>davej    pts/0        76.187.196.227   Sat Dec 30 22:19 - 00:38 (02:19)
>kmcgrail pts/0        100.36.147.30    Sat Dec 30 18:59 - 19:00 (00:01)
>kmcgrail pts/0        192.12.13.14     Tue Dec 19 19:02 - 20:10 (01:07)
>
>I will setup a script to watch closely when the files are removed next 
>time so I can get an email soon after this happens again to give me an 
>idea where to start looking.
>
>Dave
>
>
>On 12/31/2017 01:57 PM, Kevin A. McGrail wrote:
>> To try and identify an RCA, there is a history item:
>>
>> 1909  ll
>>  1910  ll -tr
>>  1911  vi last_nitemc_extract_nightly.log
>>  1912  vi checkMasscheckContribs.log
>>  1913  rm generate-new-scores.sh lock-scores ruleqa.cgi.patch
>>  1914  rm do-stable-update-with-scores
>>  1915  ll
>>  1916  rm 181*
>>  1917  sa
>>  1918  cd automc/tmp/generate-new-scores/
>>  1919  ll
>>  1920  vi scores
>>
>> I put a restore at 
>> /root/2017-12-31-restore-updates/794456983013047527-web-restore_1.zip
>>
>> Can you take a look at the files and restore? As with before, I did 
>> all the files including anything deleted and the old archives dir.
>>
>> On 12/31/2017 1:43 PM, Dave Jones wrote:
>>> Kevin,
>>>
>>> As I was setting up the new sa-update.spamassassin.org on the new 
>>> Sonic.net server, I noticed the rsync'd files were incomplete. This 
>>> time I know I didn't delete anything from the source on 
>>> sa-vm1.apache.org. :)  I have checked all cron entries/scripts for 
>>> anything that might be cleaning these source rsync rulesets up and 
>>> can't find anything on sa-vm1.apache.org.
>>>
>>> I know you mentioned in the past that this causes problems with some
>
>>> older clients that are locked in at old rulesets so I wanted to let 
>>> you know so you can restore from the Crashplan backup.
>>>
>>> Dave
>>
>>

Re: Mirror rsync source restore

Posted by Dave Jones <da...@apache.org>.
I restored all of the files back into the source rsync updates dir.

That RM line on history line 1916 would not delete all of those files 
and it's most likely in the automc/tmp directory anyway.

I haven't logged into the server recently until yesterday to start work 
on setting up the new Sonic.net server:

root@sa-vm1:/var/www/automc.spamassassin.org/updates# last
kmcgrail pts/1        100.36.147.30    Sun Dec 31 19:44   still logged in
davej    pts/0        76.187.196.227   Sun Dec 31 18:21   still logged in
davej    pts/0        76.187.196.227   Sat Dec 30 22:19 - 00:38 (02:19)
kmcgrail pts/0        100.36.147.30    Sat Dec 30 18:59 - 19:00 (00:01)
kmcgrail pts/0        192.12.13.14     Tue Dec 19 19:02 - 20:10 (01:07)

I will setup a script to watch closely when the files are removed next 
time so I can get an email soon after this happens again to give me an 
idea where to start looking.

Dave


On 12/31/2017 01:57 PM, Kevin A. McGrail wrote:
> To try and identify an RCA, there is a history item:
>
> 1909  ll
>  1910  ll -tr
>  1911  vi last_nitemc_extract_nightly.log
>  1912  vi checkMasscheckContribs.log
>  1913  rm generate-new-scores.sh lock-scores ruleqa.cgi.patch
>  1914  rm do-stable-update-with-scores
>  1915  ll
>  1916  rm 181*
>  1917  sa
>  1918  cd automc/tmp/generate-new-scores/
>  1919  ll
>  1920  vi scores
>
> I put a restore at 
> /root/2017-12-31-restore-updates/794456983013047527-web-restore_1.zip
>
> Can you take a look at the files and restore? As with before, I did 
> all the files including anything deleted and the old archives dir.
>
> On 12/31/2017 1:43 PM, Dave Jones wrote:
>> Kevin,
>>
>> As I was setting up the new sa-update.spamassassin.org on the new 
>> Sonic.net server, I noticed the rsync'd files were incomplete. This 
>> time I know I didn't delete anything from the source on 
>> sa-vm1.apache.org. :)  I have checked all cron entries/scripts for 
>> anything that might be cleaning these source rsync rulesets up and 
>> can't find anything on sa-vm1.apache.org.
>>
>> I know you mentioned in the past that this causes problems with some 
>> older clients that are locked in at old rulesets so I wanted to let 
>> you know so you can restore from the Crashplan backup.
>>
>> Dave
>
>


Re: Mirror rsync source restore

Posted by "Kevin A. McGrail" <ke...@mcgrail.com>.
To try and identify an RCA, there is a history item:

1909  ll
  1910  ll -tr
  1911  vi last_nitemc_extract_nightly.log
  1912  vi checkMasscheckContribs.log
  1913  rm generate-new-scores.sh lock-scores ruleqa.cgi.patch
  1914  rm do-stable-update-with-scores
  1915  ll
  1916  rm 181*
  1917  sa
  1918  cd automc/tmp/generate-new-scores/
  1919  ll
  1920  vi scores

I put a restore at 
/root/2017-12-31-restore-updates/794456983013047527-web-restore_1.zip

Can you take a look at the files and restore? As with before, I did all 
the files including anything deleted and the old archives dir.

On 12/31/2017 1:43 PM, Dave Jones wrote:
> Kevin,
>
> As I was setting up the new sa-update.spamassassin.org on the new 
> Sonic.net server, I noticed the rsync'd files were incomplete. This 
> time I know I didn't delete anything from the source on 
> sa-vm1.apache.org. :)  I have checked all cron entries/scripts for 
> anything that might be cleaning these source rsync rulesets up and 
> can't find anything on sa-vm1.apache.org.
>
> I know you mentioned in the past that this causes problems with some 
> older clients that are locked in at old rulesets so I wanted to let 
> you know so you can restore from the Crashplan backup.
>
> Dave



Re: Mirror rsync source restore

Posted by "Kevin A. McGrail" <ke...@mcgrail.com>.
Thanks and wtf... Will get in it.
Regards,
KAM

On December 31, 2017 1:43:19 PM EST, Dave Jones <da...@apache.org> wrote:
>Kevin,
>
>As I was setting up the new sa-update.spamassassin.org on the new 
>Sonic.net server, I noticed the rsync'd files were incomplete. This
>time 
>I know I didn't delete anything from the source on sa-vm1.apache.org. 
>:)  I have checked all cron entries/scripts for anything that might be 
>cleaning these source rsync rulesets up and can't find anything on 
>sa-vm1.apache.org.
>
>I know you mentioned in the past that this causes problems with some 
>older clients that are locked in at old rulesets so I wanted to let you
>
>know so you can restore from the Crashplan backup.
>
>Dave