Line 50:
Line 50:
==Statistics==
==Statistics==
+
===DSPAM Specific Statistics===
You can follow how DSPAM is doing by use of the dspam_stats command. Below is an example where I started the tagging process before training was complete. Here you can see that 4 emails reported as False Negatives meaning DSPAM claimed they were ham and SpamAssassin scored them as Spam (above spamlevel).
You can follow how DSPAM is doing by use of the dspam_stats command. Below is an example where I started the tagging process before training was complete. Here you can see that 4 emails reported as False Negatives meaning DSPAM claimed they were ham and SpamAssassin scored them as Spam (above spamlevel).
Line 107:
Line 108:
Notice the retraining of DSPAM that took place after a DSPAM classification as Innocent but with a total SpamAssassin score of 14.9
Notice the retraining of DSPAM that took place after a DSPAM classification as Innocent but with a total SpamAssassin score of 14.9
+
+
===SpamAssassin General Statistics===
+
You can monitor with rules are fired by SpamAssassin for both spam and ham with this little script which runs through the /var/log/spamd/current log file.
+
+
cd /usr/bin/
+
wget http://sme.swerts-knudsen.dk/downloads/DSPAM/sa-stats
+
chmod +x sa-stats
+
./sa-stats
+
+
The output will look something like this.
+
+
Email: 2895 Autolearn: 2591 AvgScore: 22.54 AvgScanTime: 3.74 sec
+
Spam: 2165 Autolearn: 2075 AvgScore: 33.86 AvgScanTime: 3.44 sec
+
Ham: 730 Autolearn: 516 AvgScore: -11.05 AvgScanTime: 4.64 sec
+
Time Spent Running SA: 3.01 hours
+
Time Spent Processing Spam: 2.07 hours
+
Time Spent Processing Ham: 0.94 hours
+
TOP SPAM RULES FIRED
+
----------------------------------------------------------------------
+
RANK RULE NAME COUNT %OFMAIL %OFSPAM %OFHAM
+
----------------------------------------------------------------------
+
1 RCVD_IN_APEWSL2 1809 67.05 83.56 18.08
+
2 RCVD_IN_BRBL 1789 62.04 82.63 0.96
+
3 RAZOR2_CHECK 1786 61.93 82.49 0.96
+
4 BAYES_99 1780 61.49 82.22 0.00
+
5 RAZOR2_CF_RANGE_51_100 1759 61.00 81.25 0.96
+
6 DIGEST_MULTIPLE 1656 57.37 76.49 0.68
+
7 DCC_CHECK 1567 56.93 72.38 11.10
+
8 URIBL_BLACK 1528 53.26 70.58 1.92
+
9 RCVD_IN_XBL 1494 51.64 69.01 0.14
+
10 RAZOR2_CF_RANGE_E8_51_100 1485 51.47 68.59 0.68
+
11 RCVD_IN_JMF_BL 1484 51.68 68.55 1.64
+
12 PYZOR_CHECK 1445 50.36 66.74 1.78
+
13 RCVD_IN_PBL 1413 48.95 65.27 0.55
+
14 URIBL_JP_SURBL 1347 46.53 62.22 0.00
+
15 URIBL_SBL 1320 45.60 60.97 0.00
+
16 URIBL_WS_SURBL 1294 44.70 59.77 0.00
+
17 DSPAM_SPAM_99 1147 39.62 52.98 0.00
+
18 SEM_URIRED 1135 39.79 52.42 2.33
+
19 SEM_URI 1002 34.78 46.28 0.68
+
20 HTML_MESSAGE 981 52.92 45.31 75.48
+
----------------------------------------------------------------------
+
TOP HAM RULES FIRED
+
----------------------------------------------------------------------
+
RANK RULE NAME COUNT %OFMAIL %OFSPAM %OFHAM
+
----------------------------------------------------------------------
+
1 BAYES_00 715 25.98 1.71 97.95
+
2 DSPAM_HAM_99 696 25.01 1.29 95.34
+
3 HTML_MESSAGE 551 52.92 45.31 75.48
+
4 SPF_PASS 329 13.68 3.09 45.07
+
5 RCVD_IN_JMF_W 145 5.11 0.14 19.86
+
6 RCVD_IN_APEWSL2 132 67.05 83.56 18.08
+
7 MIME_HTML_ONLY 131 14.82 13.76 17.95
+
8 SPF_HELO_PASS 96 3.52 0.28 13.15
+
9 DCC_CHECK 81 56.93 72.38 11.10
+
10 RCVD_IN_DNSWL_MED 63 2.18 0.00 8.63
+
11 RCVD_IN_DNSWL_LOW 62 2.14 0.00 8.49
+
12 SARE_SUB_ENC_UTF8 59 3.56 2.03 8.08
+
13 MPART_ALT_DIFF 55 2.63 0.97 7.53
+
14 USER_IN_WHITELIST 48 1.66 0.00 6.58
+
15 MIME_HTML_MOSTLY 43 2.00 0.69 5.89
+
16 MIME_QP_LONG_LINE 31 2.56 1.99 4.25
+
17 EXTRA_MPART_TYPE 31 1.52 0.60 4.25
+
18 MIME_BASE64_BLANKS 31 1.07 0.00 4.25
+
19 HTML_IMAGE_RATIO_06 29 1.04 0.05 3.97
+
20 MISSING_MID 28 1.52 0.74 3.84
+
----------------------------------------------------------------------
==FAQ==
==FAQ==