You are viewing a plain text version of this content. The canonical link for it is here.
Posted to ruleqa@spamassassin.apache.org by "marcin@mejor.pl" <ma...@mejor.pl> on 2017/06/02 07:47:04 UTC

Re: problem with setting up masscheck (was: Ruleqa masscheck so close.)

W dniu 01.06.2017 o 16:48, David Jones pisze:

Hi David, hi all!

> From: marcin@mejor.pl <ma...@mejor.pl>
>     
>> W dniu 01.06.2017 o 14:57, David Jones pisze:
>>>> From: Kevin A. McGrail <ke...@mcgrail.com>
>>>      
>>>
>>> https://wiki.apache.org/spamassassin/NightlyMassCheck
> 
> 
>> I have some troubles with setting up masscheck. Here is what I set in .automasscheck.cf :
>> LOGPREFIX="YOUR-USERNAME"
>> RSYNC_USERNAME="YOUR-USERNAME"
>> RSYNC_PASSWORD="YOUR-PASSWORD"
> 
> Replace ""YOUR-USERNAME" with your own rsync username of "mmiroslaw" in both places.
> Same for "YOUR-PASSWORD" with your own personal rsync password.  If you don't
> remember your rsync password, I can send it to you off list.

I've got my password but I didn't put it into configuration because I wanted to test if everything works correctly.

 
>> WORKDIR=~/sa-masscheck/tmp
>> JOBS=1
>> TRUSTED_NETWORKS=
>> INTERNAL_NETWORKS=
>> run_all_masschecks() {
>>  run_masscheck  ham:dir:/dane/spam/HAM_DOUSUNIECIA/ \
>>                 spam:dir:/dane/spam/20170601/
>> }
> 
>> And this is what I got from script bash -x automasscheck-minimal.sh:
>> [...]
>> open of ham-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log failed: No such file or directory at ./mass-check line 617.
>> + LOGLIST=' ham-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log'
>> + set +x
> 
>> name of log file is wrong.
> 
> Did you use the updated automasscheck-minimal.sh recently updated in the past few days
> or is this an older existing version that worked in the past?


I'm on r1797310, today i'm getting:

+ run_masscheck ham:dir:/dane/spam/HAM_DOUSUNIECIA/ spam:dir:/dane/spam/20170601/
+ CORPUSNAME=ham:dir:/dane/spam/HAM_DOUSUNIECIA/
+ shift
+ [[ ham:dir:/dane/spam/HAM_DOUSUNIECIA/ == \s\i\n\g\l\e\-\c\o\r\p\u\s ]]
+ LOGSUFFIX=-ham:dir:/dane/spam/HAM_DOUSUNIECIA/
+ LOGNAME=mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log
+ rm -f ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log
+ set -x
+ ./mass-check --hamlog=ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log --spamlog=spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log -j 1 --progress spam:dir:/dane/spam/20170601/
status: starting scan stage                              now: 2017-06-02 09:41:49
status: completed scan stage, 23 messages                now: 2017-06-02 09:41:49
status: starting run stage                               now: 2017-06-02 09:41:49
open of ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log failed: No such file or directory at ./mass-check line 617.
+ LOGLIST=' ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log'
+ set +x
rsync -qPcvz  ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log mmiroslaw@rsync.spamassassin.org::corpus/
The source and destination cannot both be remote.
rsync error: syntax or usage error (code 1) at main.c(1274) [Receiver=3.1.2]
^C

Why name of logs file are building with slashes? Slashes are not allowed as filename.

Marcin

Re: problem with setting up masscheck

Posted by Marcin Mirosław <ma...@mejor.pl>.
W dniu 2017-06-02 o 23:23, Dave Jones pisze:
> On 06/02/2017 02:47 AM, marcin@mejor.pl wrote:
>> W dniu 01.06.2017 o 16:48, David Jones pisze:
>>
>> Hi David, hi all!
>>
>>> From: marcin@mejor.pl <ma...@mejor.pl>
>>>> W dniu 01.06.2017 o 14:57, David Jones pisze:
>>>>>> From: Kevin A. McGrail <ke...@mcgrail.com>
>>>>>
>>>>> https://wiki.apache.org/spamassassin/NightlyMassCheck
>>>
>>>
>>>> I have some troubles with setting up masscheck. Here is what I set 
>>>> in .automasscheck.cf :
>>>> LOGPREFIX="YOUR-USERNAME"
>>>> RSYNC_USERNAME="YOUR-USERNAME"
>>>> RSYNC_PASSWORD="YOUR-PASSWORD"
>>>
>>> Replace ""YOUR-USERNAME" with your own rsync username of "mmiroslaw" 
>>> in both places.
>>> Same for "YOUR-PASSWORD" with your own personal rsync password.  If 
>>> you don't
>>> remember your rsync password, I can send it to you off list.
>>
>> I've got my password but I didn't put it into configuration because I 
>> wanted to test if everything works correctly.
>>
>>>> WORKDIR=~/sa-masscheck/tmp
>>>> JOBS=1
>>>> TRUSTED_NETWORKS=
>>>> INTERNAL_NETWORKS=
>>>> run_all_masschecks() {
>>>>   run_masscheck  ham:dir:/dane/spam/HAM_DOUSUNIECIA/ \
>>>>                  spam:dir:/dane/spam/20170601/
>>>> }
>>>
>>>> And this is what I got from script bash -x automasscheck-minimal.sh:
>>>> [...]
>>>> open of ham-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>>>> failed: No such file or directory at ./mass-check line 617.
>>>> + LOGLIST=' 
>>>> ham-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>>>> spam-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log'
>>>> + set +x
>>>
>>>> name of log file is wrong.
>>>
>>> Did you use the updated automasscheck-minimal.sh recently updated in 
>>> the past few days
>>> or is this an older existing version that worked in the past?
>>
>>
>> I'm on r1797310, today i'm getting:
>>
>> + run_masscheck ham:dir:/dane/spam/HAM_DOUSUNIECIA/ 
>> spam:dir:/dane/spam/20170601/
>> + CORPUSNAME=ham:dir:/dane/spam/HAM_DOUSUNIECIA/
>> + shift
>> + [[ ham:dir:/dane/spam/HAM_DOUSUNIECIA/ == \s\i\n\g\l\e\-\c\o\r\p\u\s ]]
>> + LOGSUFFIX=-ham:dir:/dane/spam/HAM_DOUSUNIECIA/
>> + LOGNAME=mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log
>> + rm -f ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>> spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log
>> + set -x
>> + ./mass-check 
>> --hamlog=ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>> --spamlog=spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log -j 1 
>> --progress spam:dir:/dane/spam/20170601/
>> status: starting scan stage                              now: 
>> 2017-06-02 09:41:49
>> status: completed scan stage, 23 messages                now: 
>> 2017-06-02 09:41:49
>> status: starting run stage                               now: 
>> 2017-06-02 09:41:49
>> open of ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log failed: 
>> No such file or directory at ./mass-check line 617.
>> + LOGLIST=' ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>> spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log'
>> + set +x
>> rsync -qPcvz  ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>> spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log 
>> mmiroslaw@rsync.spamassassin.org::corpus/
>> The source and destination cannot both be remote.
>> rsync error: syntax or usage error (code 1) at main.c(1274) 
>> [Receiver=3.1.2]
>> ^C
>>
>> Why name of logs file are building with slashes? Slashes are not 
>> allowed as filename.
>>
>> Marcin
>>
> 
> In the .automasscheck.cf around line 53 there should be something like 
> this:
> 
> run_all_masschecks() {
>    ### sample: single corpus ###
>    run_masscheck single-corpus \
> 
> Did you remove the 'single-corpus' from the run_masscheck argument? From 
> what I can tell in your bash -x output (thanks for that by the way), it 
> looks like the first argument to the run_masscheck function is 
> 'ham:dir:/dane/spam/HAM_DOUSUNIECIA/' and it probably should be 
> 'single-corpus'.
> 
> Mine looks like this:
> 
> run_all_masschecks() {
>    ### sample: single corpus ###
>    run_masscheck single-corpus \
>          ham:dir:$MAILDIR/.Ham/ \
>          spam:dir:$MAILDIR/.Spam/
> 
> I have a wrapper script that sets the $MAILDIR then calls the 
> automasscheck-minimal.sh script to do a couple of things before and 
> afterwards for reporting and emailing the output.


Bingo!
I clean up conf file and I removed too much. I don't know why I removed 
single-corpus. Now it works! I'll prepare all configuration and will 
send results of masscheck after a weekend.
Thank you!
Marcin


Re: problem with setting up masscheck

Posted by Dave Jones <da...@apache.org>.
On 06/02/2017 02:47 AM, marcin@mejor.pl wrote:
> W dniu 01.06.2017 o 16:48, David Jones pisze:
> 
> Hi David, hi all!
> 
>> From: marcin@mejor.pl <ma...@mejor.pl>
>>      
>>> W dniu 01.06.2017 o 14:57, David Jones pisze:
>>>>> From: Kevin A. McGrail <ke...@mcgrail.com>
>>>>       
>>>>
>>>> https://wiki.apache.org/spamassassin/NightlyMassCheck
>>
>>
>>> I have some troubles with setting up masscheck. Here is what I set in .automasscheck.cf :
>>> LOGPREFIX="YOUR-USERNAME"
>>> RSYNC_USERNAME="YOUR-USERNAME"
>>> RSYNC_PASSWORD="YOUR-PASSWORD"
>>
>> Replace ""YOUR-USERNAME" with your own rsync username of "mmiroslaw" in both places.
>> Same for "YOUR-PASSWORD" with your own personal rsync password.  If you don't
>> remember your rsync password, I can send it to you off list.
> 
> I've got my password but I didn't put it into configuration because I wanted to test if everything works correctly.
> 
>   
>>> WORKDIR=~/sa-masscheck/tmp
>>> JOBS=1
>>> TRUSTED_NETWORKS=
>>> INTERNAL_NETWORKS=
>>> run_all_masschecks() {
>>>   run_masscheck  ham:dir:/dane/spam/HAM_DOUSUNIECIA/ \
>>>                  spam:dir:/dane/spam/20170601/
>>> }
>>
>>> And this is what I got from script bash -x automasscheck-minimal.sh:
>>> [...]
>>> open of ham-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log failed: No such file or directory at ./mass-check line 617.
>>> + LOGLIST=' ham-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-YOUR-USERNAME-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log'
>>> + set +x
>>
>>> name of log file is wrong.
>>
>> Did you use the updated automasscheck-minimal.sh recently updated in the past few days
>> or is this an older existing version that worked in the past?
> 
> 
> I'm on r1797310, today i'm getting:
> 
> + run_masscheck ham:dir:/dane/spam/HAM_DOUSUNIECIA/ spam:dir:/dane/spam/20170601/
> + CORPUSNAME=ham:dir:/dane/spam/HAM_DOUSUNIECIA/
> + shift
> + [[ ham:dir:/dane/spam/HAM_DOUSUNIECIA/ == \s\i\n\g\l\e\-\c\o\r\p\u\s ]]
> + LOGSUFFIX=-ham:dir:/dane/spam/HAM_DOUSUNIECIA/
> + LOGNAME=mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log
> + rm -f ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log
> + set -x
> + ./mass-check --hamlog=ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log --spamlog=spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log -j 1 --progress spam:dir:/dane/spam/20170601/
> status: starting scan stage                              now: 2017-06-02 09:41:49
> status: completed scan stage, 23 messages                now: 2017-06-02 09:41:49
> status: starting run stage                               now: 2017-06-02 09:41:49
> open of ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log failed: No such file or directory at ./mass-check line 617.
> + LOGLIST=' ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log'
> + set +x
> rsync -qPcvz  ham-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log spam-mmiroslaw-ham:dir:/dane/spam/HAM_DOUSUNIECIA/.log mmiroslaw@rsync.spamassassin.org::corpus/
> The source and destination cannot both be remote.
> rsync error: syntax or usage error (code 1) at main.c(1274) [Receiver=3.1.2]
> ^C
> 
> Why name of logs file are building with slashes? Slashes are not allowed as filename.
> 
> Marcin
> 

In the .automasscheck.cf around line 53 there should be something like this:

run_all_masschecks() {
   ### sample: single corpus ###
   run_masscheck single-corpus \

Did you remove the 'single-corpus' from the run_masscheck argument? 
 From what I can tell in your bash -x output (thanks for that by the 
way), it looks like the first argument to the run_masscheck function is 
'ham:dir:/dane/spam/HAM_DOUSUNIECIA/' and it probably should be 
'single-corpus'.

Mine looks like this:

run_all_masschecks() {
   ### sample: single corpus ###
   run_masscheck single-corpus \
         ham:dir:$MAILDIR/.Ham/ \
         spam:dir:$MAILDIR/.Spam/

I have a wrapper script that sets the $MAILDIR then calls the 
automasscheck-minimal.sh script to do a couple of things before and 
afterwards for reporting and emailing the output.

Dave