(Fixed) Re: Cron /usr/local/spamassassin/automc/svn/trunk/build/mkupdates/do-stable-update-with-scores force 2>&1 | tee /usr/local/spamassassin/automc/tmp/do-stable-update-with-scores.log

[Henrik K <he...@hege.li>]

/usr/local/spamassassin/automc/bin/runRuleQArefresh.sh was to blame.  It was
using poor mkdir based locking method, which did not recover gracefully from
server boot.  As this script did not run, corpus files were not getting
renamed (via corpus-cleanup).  Rewritten now to use better locking method.



On Sun, May 07, 2023 at 02:25:34AM +0000, Cron Daemon wrote:
> + echo ''\''Running do-nightly-rescore-example.sh ...'
> 'Running do-nightly-rescore-example.sh ...
> + echo ''
> 
> + /usr/local/spamassassin/automc/svn/trunk/masses/rule-update-score-gen/do-nightly-rescore-example.sh force
> Beginning of Week.  Running with 0 first.
> /usr/local/spamassassin/automc/tmp/generate-new-scores
> Sun 07 May 2023 02:25:02 AM UTC
> [ rsyncing logs ]
> [ rsyncing logs locally ]
> sending incremental file list
> ham-darxus.r1901658.log
> ham-ena-week0.r1901658.log
> ham-ena-week0.r1909428.log
> ham-ena-week1.r1901658.log
> ham-ena-week1.r1909428.log
> ham-ena-week2.r1901658.log
> ham-ena-week2.r1909428.log
> ham-ena-week3.r1901658.log
> ham-ena-week3.r1909428.log
> ham-ena-week4.r1901658.log
> ham-ena-week4.r1909428.log
> ham-giovanni-ham.r1909428.log
> ham-giovanni-spam.r1909428.log
> ham-giovanni-spammy.r1909428.log
> ham-grenier.r1901658.log
> ham-grenier.r1909428.log
> ham-hege.r1901658.log
> ham-hege.r1909428.log
> ham-jhardin.r1901658.log
> ham-jhardin.r1909428.log
> ham-llanga.r1909428.log
> ham-mmiroslaw-mails-ham.r1909428.log
> ham-mmiroslaw-mails-spam.r1909428.log
> ham-net-darxus.r1901610.log
> ham-net-ena-week0.r1901610.log
> ham-net-ena-week0.r1909347.log
> ham-net-ena-week1.r1901610.log
> ham-net-ena-week1.r1909347.log
> ham-net-ena-week2.r1901610.log
> ham-net-ena-week2.r1909347.log
> ham-net-ena-week3.r1901610.log
> ham-net-ena-week3.r1909347.log
> ham-net-ena-week4.r1901610.log
> ham-net-ena-week4.r1909347.log
> ham-net-giovanni-ham.r1901610.log
> ham-net-giovanni-ham.r1909347.log
> ham-net-giovanni-spam.r1901610.log
> ham-net-giovanni-spam.r1909347.log
> ham-net-giovanni-spammy.r1901610.log
> ham-net-giovanni-spammy.r1909347.log
> ham-net-grenier.r1901610.log
> ham-net-grenier.r1909347.log
> ham-net-hege.r1901610.log
> ham-net-hege.r1909347.log
> ham-net-jhardin.r1901610.log
> ham-net-jhardin.r1909347.log
> ham-net-llanga.r1901610.log
> ham-net-llanga.r1909347.log
> ham-net-mmiroslaw-mails-ham.r1901610.log
> ham-net-mmiroslaw-mails-ham.r1909347.log
> ham-net-mmiroslaw-mails-spam.r1901610.log
> ham-net-mmiroslaw-mails-spam.r1909347.log
> ham-net-spamsponge.r1909347.log
> ham-net-thendrikx.r1901610.log
> ham-net-thendrikx.r1909347.log
> ham-net-tsz-spam-corpus.r1901610.log
> ham-net-tsz-spam-corpus.r1909347.log
> ham-spamsponge.r1901658.log
> ham-spamsponge.r1909428.log
> ham-thendrikx.r1901658.log
> ham-thendrikx.r1909428.log
> ham-tsz-spam-corpus.r1901658.log
> ham-tsz-spam-corpus.r1909428.log
> spam-darxus.r1901658.log
> spam-ena-week0.r1901658.log
> spam-ena-week0.r1909428.log
> spam-ena-week1.r1901658.log
> spam-ena-week1.r1909428.log
> spam-ena-week2.r1901658.log
> spam-ena-week2.r1909428.log
> spam-ena-week3.r1901658.log
> spam-ena-week3.r1909428.log
> spam-ena-week4.r1901658.log
> spam-ena-week4.r1909428.log
> spam-giovanni-ham.r1909428.log
> spam-giovanni-spam.r1909428.log
> spam-giovanni-spammy.r1909428.log
> spam-grenier.r1901658.log
> spam-grenier.r1909428.log
> spam-hege.r1901658.log
> spam-hege.r1909428.log
> spam-jhardin.r1901658.log
> spam-jhardin.r1909428.log
> spam-llanga.r1909428.log
> spam-mmiroslaw-mails-ham.r1909428.log
> spam-mmiroslaw-mails-spam.r1909428.log
> spam-net-darxus.r1901610.log
> spam-net-ena-week0.r1901610.log
> spam-net-ena-week0.r1909347.log
> spam-net-ena-week1.r1901610.log
> spam-net-ena-week1.r1909347.log
> spam-net-ena-week2.r1901610.log
> spam-net-ena-week2.r1909347.log
> spam-net-ena-week3.r1901610.log
> spam-net-ena-week3.r1909347.log
> spam-net-ena-week4.r1901610.log
> spam-net-ena-week4.r1909347.log
> spam-net-giovanni-ham.r1901610.log
> spam-net-giovanni-ham.r1909347.log
> spam-net-giovanni-spam.r1901610.log
> spam-net-giovanni-spam.r1909347.log
> spam-net-giovanni-spammy.r1901610.log
> spam-net-giovanni-spammy.r1909347.log
> spam-net-grenier.r1901610.log
> spam-net-grenier.r1909347.log
> spam-net-hege.r1901610.log
> spam-net-hege.r1909347.log
> spam-net-jhardin.r1901610.log
> spam-net-jhardin.r1909347.log
> spam-net-llanga.r1901610.log
> spam-net-llanga.r1909347.log
> spam-net-mmiroslaw-mails-ham.r1901610.log
> spam-net-mmiroslaw-mails-ham.r1909347.log
> spam-net-mmiroslaw-mails-spam.r1901610.log
> spam-net-mmiroslaw-mails-spam.r1909347.log
> spam-net-spamsponge.r1909347.log
> spam-net-thendrikx.r1901610.log
> spam-net-thendrikx.r1909347.log
> spam-net-tsz-spam-corpus.r1901610.log
> spam-net-tsz-spam-corpus.r1909347.log
> spam-spamsponge.r1901658.log
> spam-spamsponge.r1909428.log
> spam-thendrikx.r1901658.log
> spam-thendrikx.r1909428.log
> spam-tsz-spam-corpus.r1901658.log
> spam-tsz-spam-corpus.r1909428.log
> 
> sent 5,183,211,593 bytes  received 2,410 bytes  159,483,507.78 bytes/sec
> total size is 5,181,937,505  speedup is 1.00
> Sun 07 May 2023 02:25:34 AM UTC
> [ selecting log files to use for scoreset 0 ]
> head: cannot open 'corpus/usable-corpus-set0/*.log' for reading: No such file or directory
> No logs for scoreset
> + RV=1
> + '[' 1 -ne 0 ']'
> + echo 'Exit Status 1 is not zero for do-nightly-rescore-example'
> Exit Status 1 is not zero for do-nightly-rescore-example
> + echo 'From: noreply@spamassassin.apache.org (automc Cron)'
> + echo 'Subject: [auto] do-nightly-rescore-example return code 1'
> + echo ''
> + echo 'Exit Status 1 is not zero for do-nightly-rescore-example.sh'
> + echo ''
> + echo '=== tail of ~automc/tmp/do-stable-update-with-scores.log ==='
> + tail -20 /usr/local/spamassassin/automc/tmp/do-stable-update-with-scores.log
> + /usr/sbin/sendmail -oi ruleqa@spamassassin.apache.org