You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by da...@chaosreigns.com on 2012/02/26 16:26:40 UTC
No sa-updates this week due to insufficient masscheck spam corpora
Spams: 122574 (short 27426)
Hams: 183150
It looks like the only change since last week is the loss of grenier's
corpora. I can't verify that's enough to make the difference because from
week's output because it has been overwritten by only net-axb-ned-phish and
net-axb-phish (axb, you're probably starting those at the wrong time). Two
weeks ago net-grenier only had 629 spams, so I guess the problem is
primarily reduction in spams in corpora that did get uploaded.
I did remove my net-darxus-trap a couple weeks ago largely to get the
processing to finish within one day. At that time it wasn't a problem, now
it would have gotten us over the threshold. I'd try to run it now, but I
fear that would result in weird overwriting of the already reported data
(bug 6753).
20120225
Missing net-grenier - last seen 20120218.
Missing net-axb-phish - last seen 20120211.
Missing net-axb-ned-phish - last seen 20120211.
Missing net-axb-ham - last seen 20120211.
Missing net-axb-fraud-feeds - last seen 20120211.
Missing net-axb-fraud-autofilter - last seen 20120211.
Missing net-darxus-trap - last seen 20120204.
Missing net-axb-brasil - last seen 20120204.
Missing net-bernie-mix - last seen 20120121.
Missing net-bernie-it_batt - last seen 20120121.
Missing net-bernie-fsf - last seen 20120121.
Missing net-axb-fraud - last seen 20111119.
Missing net-kgolding - last seen 20111015.
Missing net-dos - last seen 20111015.
Missing net-nbebout - last seen 20110528.
--
"Judge if you want. We are all going to die. I intend to deserve it."
- http://www.ASofterWorld.com/index.php?id=421
http://www.ChaosReigns.com
Re: No sa-updates this week due to insufficient masscheck spam corpora
Posted by Jari Fredriksson <ja...@iki.fi>.
27.2.2012 17:31, Axb kirjoitti:
> On 02/27/2012 04:24 PM, Kevin A. McGrail wrote:
>> On 2/26/2012 10:26 AM, darxus@chaosreigns.com wrote:
>>> Spams: 122574 (short 27426)
>>> Hams: 183150
>
>> Thanks for keeping an eye on this. It can stay a medium priority but we
>> do need to get more masscheckers into the fray. It'll improve things for
>> everyone.
>
> I'm curious - what kind of hardware are you guys throwing at your
> masscheckers?
>
> Seems to me this stuff takes AGES to process on a dual core 1.8 Ghz with
> 4GB ram / Intel SSD drive.
>
>
>
$ free -m
total used free shared buffers cached
Mem: 1506 1462 44 0 80 680
-/+ buffers/cache: 701 805
Swap: 1079 19 1060
$ cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
stepping : 5
cpu MHz : 2666.329
cache size : 8192 KB
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss syscall nx
rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology
tsc_reliable nonstop_tsc aperfmperf pni ssse3 cx16 sse4_1 sse4_2 popcnt
hypervisor lahf_lm ida
bogomips : 5332.65
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
stepping : 5
cpu MHz : 2666.329
cache size : 8192 KB
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss syscall nx
rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology
tsc_reliable nonstop_tsc aperfmperf pni ssse3 cx16 sse4_1 sse4_2 popcnt
hypervisor lahf_lm ida
bogomips : 5332.65
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:
Takes max. 1.5 hours daily to process my corpus.
--
Slow day. Practice crawling.
Re: No sa-updates this week due to insufficient masscheck spam
corpora
Posted by Daniel McDonald <da...@austinenergy.com>.
On 2/27/12 9:31 AM, "Axb" <ax...@gmail.com> wrote:
> On 02/27/2012 04:24 PM, Kevin A. McGrail wrote:
>> On 2/26/2012 10:26 AM, darxus@chaosreigns.com wrote:
>>> Spams: 122574 (short 27426)
>>> Hams: 183150
>
>> Thanks for keeping an eye on this. It can stay a medium priority but we
>> do need to get more masscheckers into the fray. It'll improve things for
>> everyone.
>
> I'm curious - what kind of hardware are you guys throwing at your
> masscheckers?
This one runs about 40 minutes.
$ free -m
total used free shared buffers cached
Mem: 5975 5636 338 0 151 4258
-/+ buffers/cache: 1226 4749
Swap: 12284 35 12248
$ cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 0
cpu cores : 4
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6147.22
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 1
cpu cores : 4
apicid : 2
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.38
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 2
cpu cores : 4
apicid : 4
initial apicid : 4
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.37
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 3
cpu cores : 4
apicid : 6
initial apicid : 6
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.37
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 4
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 0
cpu cores : 4
apicid : 1
initial apicid : 1
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.38
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 5
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 1
cpu cores : 4
apicid : 3
initial apicid : 3
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.38
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 6
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 2
cpu cores : 4
apicid : 5
initial apicid : 5
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.37
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 7
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
stepping : 5
cpu MHz : 3068.000
cache size : 8192 KB
physical id : 0
siblings : 8
core id : 3
cpu cores : 4
apicid : 7
initial apicid : 7
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp
lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc
aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1
sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips : 6146.38
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
>
> Seems to me this stuff takes AGES to process on a dual core 1.8 Ghz with
> 4GB ram / Intel SSD drive.
>
>
>
Re: No sa-updates this week due to insufficient masscheck spam corpora
Posted by Axb <ax...@gmail.com>.
On 02/27/2012 04:24 PM, Kevin A. McGrail wrote:
> On 2/26/2012 10:26 AM, darxus@chaosreigns.com wrote:
>> Spams: 122574 (short 27426)
>> Hams: 183150
> Thanks for keeping an eye on this. It can stay a medium priority but we
> do need to get more masscheckers into the fray. It'll improve things for
> everyone.
I'm curious - what kind of hardware are you guys throwing at your
masscheckers?
Seems to me this stuff takes AGES to process on a dual core 1.8 Ghz with
4GB ram / Intel SSD drive.
Re: No sa-updates this week due to insufficient masscheck spam corpora
Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
On 2/26/2012 10:26 AM, darxus@chaosreigns.com wrote:
> Spams: 122574 (short 27426)
> Hams: 183150
>
>
Thanks for keeping an eye on this. It can stay a medium priority but we
do need to get more masscheckers into the fray. It'll improve things
for everyone.
Regards,
KAM