You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by Jari Fredriksson <ja...@iki.fi> on 2015/11/19 20:55:06 UTC

We have some kind of rsync problem now?

Seems that mass check has not worked for a 2 days now, and fails on the 
rsync request. Can't pull down anything.


-- 
jarif.bit

Re: We have some kind of rsync problem now?

Posted by Benny Pedersen <me...@junc.eu>.
Jari Fredriksson skrev den 2015-11-20 00:42:

> ++ RSYNC_USERNAME=jarif
> ++ RSYNC_PASSWORD=qGcFOjAnu8iKuJ6p
  rm -f /home/jarif/.auto-mass-check.running

hopefully this password is now changed

be carefull

Re: We have some kind of rsync problem now?

Posted by Jari Fredriksson <ja...@iki.fi>.
On 20.11.2015 0.22, Kevin A. McGrail wrote:
> On 11/19/2015 5:18 PM, Jari Fredriksson wrote:
>> On 20.11.2015 0:08, Kevin A. McGrail wrote:
>>> On 11/19/2015 3:17 PM, John Hardin wrote:
>>>> On Thu, 19 Nov 2015, Jari Fredriksson wrote:
>>>>
>>>>> Seems that mass check has not worked for a 2 days now, and fails on
>>>>> the rsync request. Can't pull down anything.
>>>>
>>>> And the ruleqa web UI is reporting conflicting results:
>>>>
>>>>
>>>> http://ruleqa.spamassassin.org/20151117-r1714732-n
>>>>
>>>>     20151118-r1714950-n
>>>>
>>>>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc bb-guenther_fraud
>>>>     bb-jhardin bb-jhardin_fraud bb-jm bb-kmcgrail bb-traps bb-zmi
>>>>     bpoliakoff darxus dwarren grenier jarif kam-ninja kpg-core zmi [+]
>>>>
>>>>
>>>> http://ruleqa.spamassassin.org/20151118-r1714950-n
>>>>
>>>>     20151119-r1714950-n
>>>>
>>>>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc kam-ninja [+]
>>>>
>>>>
>>>> Looks like date logic is screwy somewhere, two dates on masschecks
>>>> of the same revision? That could be an SVN issue. We've had some svn
>>>> issues that have blocked downloads of the latest code rev which is
>>>> added to the logs to check that everyone used the correct version.
>>>> Incorrect versions are ignored.
>>
>> Well, I may have "domestic" problems, as I have problem using my
>> Windows/cygwin for auto-mass-check and now trying on my Linux dual boot:
>>
>> jarif@whirlwind:~$ auto-mass-check.sh
>> Syncing nightly_mass_check
>> rsync: change_dir "/nightly_mass_check" (in tagged_builds) failed: No
>> such file or directory (2)
>> rsync error: some files/attrs were not transferred (see previous
>> errors) (code 23) at main.c(1655) [Receiver=3.1.1]
>> ERROR: rsync failed in some way, aborting...
>>
>>
>> But sure looks like a remote problem to me.
>>
> You might need to create a nightly_mass_check dir?
>
>

I'm running the provided auto-mass-check.sh which has worked fine for 
years now.

I added now -x in the bash shebang of it:

$ auto-mass-check.sh
Syncing nightly_mass_check
rsync: change_dir "/nightly_mass_check" (in tagged_builds) failed: No 
such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) 
(code 23) at main.c(1655) [Receiver=3.1.1]
ERROR: rsync failed in some way, aborting...
jarif@whirlwind:~$ vi bin/auto-mass-check.sh
jarif@whirlwind:~$ auto-mass-check.sh
+ unset LOGPREFIX
+ unset RSYNC_USERNAME
+ unset RSYNC_PASSWORD
+ unset WORKDIR
+ unset CHECKDIR
+ export LC_ALL=C
+ LC_ALL=C
+ '[' -e /home/jarif/.auto-mass-check.cf ']'
+ . /home/jarif/.auto-mass-check.cf
++ LOGPREFIX=jarif
++ RSYNC_USERNAME=jarif
++ RSYNC_PASSWORD=qGcFOjAnu8iKuJ6p
++ WORKDIR=/home/jarif/masscheckwork
++ CHECKDIR=
+ LOCK=/home/jarif/.auto-mass-check.running
+ test -f /home/jarif/.auto-mass-check.running
+ touch /home/jarif/.auto-mass-check.running
+ trap 'rm -f /home/jarif/.auto-mass-check.running' EXIT SIGHUP SIGINT 
SIGTERM
+ setup_checktype
+ unset NET LOGTYPE
+ export RSYNC_PASSWORD
+ '[' '!' -d /home/jarif/masscheckwork ']'
+ '[' '' == --mcsx ']'
+ '[' '' == --psblx ']'
+ '[' '' == --weekly ']'
+ '[' '' == --nightly ']'
+ date -u
+ grep -q '^Sat'
+ TYPE=nightly_mass_check
+ echo 'Syncing nightly_mass_check'
Syncing nightly_mass_check
+ rsync -qrz --progress --delete 
rsync://rsync.spamassassin.org/tagged_builds/nightly_mass_check/ 
/home/jarif/masscheckwork/nightly_mass_check/
rsync: change_dir "/nightly_mass_check" (in tagged_builds) failed: No 
such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) 
(code 23) at main.c(1655) [Receiver=3.1.1]
+ retval=23
+ JOBS=7
+ LOGTYPE=
+ RSYNCMOD=corpus
+ '[' 23 -ne 0 ']'
+ echo 'ERROR: rsync failed in some way, aborting...'
ERROR: rsync failed in some way, aborting...
+ exit 1
+ rm -f /home/jarif/.auto-mass-check.running



-- 
jarif.bit

Re: We have some kind of rsync problem now?

Posted by Benny Pedersen <me...@junc.eu>.
Jari Fredriksson skrev den 2015-11-20 00:43:

> Please change it asap!

echo "password-string" | sigtool --hex-dump >password.hex

now use this string in clamav to reject if you forget it

sample jari.ldb:
jari.ldb.1;Target:0;(0);content-from-password.hex-here

save the sample in clamav database dir and reload clamd

Re: We have some kind of rsync problem now?

Posted by Jari Fredriksson <ja...@iki.fi>.
On 20.11.2015 0.22, Kevin A. McGrail wrote:
>>
> You might need to create a nightly_mass_check dir?
>
>

I goofed now and sent my rsync-password to the list!

Please change it asap!

-- 
jarif.bit

Re: We have some kind of rsync problem now?

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
On 11/19/2015 5:18 PM, Jari Fredriksson wrote:
> On 20.11.2015 0:08, Kevin A. McGrail wrote:
>> On 11/19/2015 3:17 PM, John Hardin wrote:
>>> On Thu, 19 Nov 2015, Jari Fredriksson wrote:
>>>
>>>> Seems that mass check has not worked for a 2 days now, and fails on 
>>>> the rsync request. Can't pull down anything.
>>>
>>> And the ruleqa web UI is reporting conflicting results:
>>>
>>>
>>> http://ruleqa.spamassassin.org/20151117-r1714732-n
>>>
>>>     20151118-r1714950-n
>>>
>>>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc bb-guenther_fraud
>>>     bb-jhardin bb-jhardin_fraud bb-jm bb-kmcgrail bb-traps bb-zmi
>>>     bpoliakoff darxus dwarren grenier jarif kam-ninja kpg-core zmi [+]
>>>
>>>
>>> http://ruleqa.spamassassin.org/20151118-r1714950-n
>>>
>>>     20151119-r1714950-n
>>>
>>>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc kam-ninja [+]
>>>
>>>
>>> Looks like date logic is screwy somewhere, two dates on masschecks 
>>> of the same revision? That could be an SVN issue. We've had some svn 
>>> issues that have blocked downloads of the latest code rev which is 
>>> added to the logs to check that everyone used the correct version.  
>>> Incorrect versions are ignored.
>
> Well, I may have "domestic" problems, as I have problem using my 
> Windows/cygwin for auto-mass-check and now trying on my Linux dual boot:
>
> jarif@whirlwind:~$ auto-mass-check.sh
> Syncing nightly_mass_check
> rsync: change_dir "/nightly_mass_check" (in tagged_builds) failed: No 
> such file or directory (2)
> rsync error: some files/attrs were not transferred (see previous 
> errors) (code 23) at main.c(1655) [Receiver=3.1.1]
> ERROR: rsync failed in some way, aborting...
>
>
> But sure looks like a remote problem to me.
>
You might need to create a nightly_mass_check dir?



Re: We have some kind of rsync problem now?

Posted by Jari Fredriksson <ja...@iki.fi>.
On 20.11.2015 0:08, Kevin A. McGrail wrote:
> On 11/19/2015 3:17 PM, John Hardin wrote:
>> On Thu, 19 Nov 2015, Jari Fredriksson wrote:
>>
>>> Seems that mass check has not worked for a 2 days now, and fails on 
>>> the rsync request. Can't pull down anything.
>>
>> And the ruleqa web UI is reporting conflicting results:
>>
>>
>> http://ruleqa.spamassassin.org/20151117-r1714732-n
>>
>>     20151118-r1714950-n
>>
>>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc 
>> bb-guenther_fraud
>>     bb-jhardin bb-jhardin_fraud bb-jm bb-kmcgrail bb-traps bb-zmi
>>     bpoliakoff darxus dwarren grenier jarif kam-ninja kpg-core zmi 
>> [+]
>>
>>
>> http://ruleqa.spamassassin.org/20151118-r1714950-n
>>
>>     20151119-r1714950-n
>>
>>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc kam-ninja [+]
>>
>>
>> Looks like date logic is screwy somewhere, two dates on masschecks 
>> of the same revision? That could be an SVN issue.  We've had some svn 
>> issues that have blocked downloads of the latest code rev which is 
>> added to the logs to check that everyone used the correct version.  
>> Incorrect versions are ignored.

Well, I may have "domestic" problems, as I have problem using my 
Windows/cygwin for auto-mass-check and now trying on my Linux dual boot:

jarif@whirlwind:~$ auto-mass-check.sh
Syncing nightly_mass_check
rsync: change_dir "/nightly_mass_check" (in tagged_builds) failed: No 
such file or directory (2)
rsync error: some files/attrs were not transferred (see previous 
errors) (code 23) at main.c(1655) [Receiver=3.1.1]
ERROR: rsync failed in some way, aborting...


But sure looks like a remote problem to me.

-- 
jarif.bit

Re: We have some kind of rsync problem now?

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
On 11/19/2015 3:17 PM, John Hardin wrote:
> On Thu, 19 Nov 2015, Jari Fredriksson wrote:
>
>> Seems that mass check has not worked for a 2 days now, and fails on 
>> the rsync request. Can't pull down anything.
>
> And the ruleqa web UI is reporting conflicting results:
>
>
> http://ruleqa.spamassassin.org/20151117-r1714732-n
>
>     20151118-r1714950-n
>
>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc bb-guenther_fraud
>     bb-jhardin bb-jhardin_fraud bb-jm bb-kmcgrail bb-traps bb-zmi
>     bpoliakoff darxus dwarren grenier jarif kam-ninja kpg-core zmi [+]
>
>
> http://ruleqa.spamassassin.org/20151118-r1714950-n
>
>     20151119-r1714950-n
>
>     axb-8mile axb-coi-bulk axb-generic axb-ham-misc kam-ninja [+]
>
>
> Looks like date logic is screwy somewhere, two dates on masschecks of 
> the same revision? 
That could be an SVN issue.  We've had some svn issues that have blocked 
downloads of the latest code rev which is added to the logs to check 
that everyone used the correct version.  Incorrect versions are ignored.

Re: We have some kind of rsync problem now?

Posted by John Hardin <jh...@impsec.org>.
On Thu, 19 Nov 2015, Jari Fredriksson wrote:

> Seems that mass check has not worked for a 2 days now, and fails on the rsync 
> request. Can't pull down anything.

And the ruleqa web UI is reporting conflicting results:


http://ruleqa.spamassassin.org/20151117-r1714732-n

 	20151118-r1714950-n

 	axb-8mile axb-coi-bulk axb-generic axb-ham-misc bb-guenther_fraud
 	bb-jhardin bb-jhardin_fraud bb-jm bb-kmcgrail bb-traps bb-zmi
 	bpoliakoff darxus dwarren grenier jarif kam-ninja kpg-core zmi [+]


http://ruleqa.spamassassin.org/20151118-r1714950-n

 	20151119-r1714950-n

 	axb-8mile axb-coi-bulk axb-generic axb-ham-misc kam-ninja [+]


Looks like date logic is screwy somewhere, two dates on masschecks of the 
same revision?


-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   If guns kill people, then...
     -- pencils miss spel words.
     -- cars make people drive drunk.
     -- spoons make people fat.
-----------------------------------------------------------------------

Re: We have some kind of rsync problem now?

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
On 11/19/2015 9:31 PM, John Hardin wrote:
> I'd say wait until tomorrow to let it finish the masscheck for the 
> 19th and see what it looks like.
It's likely going to be svn causing the nightly_masscheck dir to be 
missing.



Re: We have some kind of rsync problem now?

Posted by John Hardin <jh...@impsec.org>.
On Thu, 19 Nov 2015, Kevin A. McGrail wrote:

> On 11/19/2015 3:57 PM, John Hardin wrote:
>>  On Thu, 19 Nov 2015, Jari Fredriksson wrote:
>> 
>> >  Seems that mass check has not worked for a 2 days now, and fails on the 
>> >  rsync request. Can't pull down anything.
>>
>>  I just uploaded my corpora (I don't do local checks) successfully.
> 
> We have published rules for the last 11 days.
>
> Your corpus appears used last night:
>
> Checking corpus/usable-corpus-set1/ham-net-jarif.log for SVN 1714294...
> # SVN revision: 1714294

That revision is apparently for the masscheck run on 11/14.

> Not sure I see an issue...

Take a look at the two ruleqa website URLs below. They're reporting 
different results for the (supposedly) same masscheck run (1714950).

On the pages through http://ruleqa.spamassassin.org/20151117-r1714732-n 
Jari's corpus is in the list for all masschecks, but on 
http://ruleqa.spamassassin.org/20151119-r1714950-n it *disappears* from 
the 1714950 masscheck (as do others). It's right now still too early to 
look at http://ruleqa.spamassassin.org/20151119-r1715127-n

I'd say wait until tomorrow to let it finish the masscheck for the 19th 
and see what it looks like.

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   WSJ on the Financial Stimulus package: "...today there are 700,000
   fewer jobs than [the administration] predicted we would have if we
   had done nothing at all."
-----------------------------------------------------------------------

Re: We have some kind of rsync problem now?

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
On 11/19/2015 3:57 PM, John Hardin wrote:
> On Thu, 19 Nov 2015, Jari Fredriksson wrote:
>
>> Seems that mass check has not worked for a 2 days now, and fails on 
>> the rsync request. Can't pull down anything.
>
> I just uploaded my corpora (I don't do local checks) successfully.
>
We have published rules for the last 11 days.

Your corpus appears used last night:

Checking corpus/usable-corpus-set1/ham-net-jarif.log for SVN 1714294...
# SVN revision: 1714294

Not sure I see an issue...

Re: We have some kind of rsync problem now?

Posted by John Hardin <jh...@impsec.org>.
On Thu, 19 Nov 2015, Jari Fredriksson wrote:

> Seems that mass check has not worked for a 2 days now, and fails on the rsync 
> request. Can't pull down anything.

I just uploaded my corpora (I don't do local checks) successfully.

-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org    FALaholic #11174     pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   If guns kill people, then...
     -- pencils miss spel words.
     -- cars make people drive drunk.
     -- spoons make people fat.
-----------------------------------------------------------------------