Line 50: |
Line 50: |
| ==Statistics== | | ==Statistics== |
| | | |
| + | ===DSPAM Specific Statistics=== |
| You can follow how DSPAM is doing by use of the dspam_stats command. Below is an example where I started the tagging process before training was complete. Here you can see that 4 emails reported as False Negatives meaning DSPAM claimed they were ham and SpamAssassin scored them as Spam (above spamlevel). | | You can follow how DSPAM is doing by use of the dspam_stats command. Below is an example where I started the tagging process before training was complete. Here you can see that 4 emails reported as False Negatives meaning DSPAM claimed they were ham and SpamAssassin scored them as Spam (above spamlevel). |
| | | |
Line 107: |
Line 108: |
| | | |
| Notice the retraining of DSPAM that took place after a DSPAM classification as Innocent but with a total SpamAssassin score of 14.9 | | Notice the retraining of DSPAM that took place after a DSPAM classification as Innocent but with a total SpamAssassin score of 14.9 |
| + | |
| + | ===SpamAssassin General Statistics=== |
| + | You can monitor with rules are fired by SpamAssassin for both spam and ham with this little script which runs through the /var/log/spamd/current log file. |
| + | |
| + | cd /usr/bin/ |
| + | wget http://sme.swerts-knudsen.dk/downloads/DSPAM/sa-stats |
| + | chmod +x sa-stats |
| + | ./sa-stats |
| + | |
| + | The output will look something like this. |
| + | |
| + | Email: 2895 Autolearn: 2591 AvgScore: 22.54 AvgScanTime: 3.74 sec |
| + | Spam: 2165 Autolearn: 2075 AvgScore: 33.86 AvgScanTime: 3.44 sec |
| + | Ham: 730 Autolearn: 516 AvgScore: -11.05 AvgScanTime: 4.64 sec |
| + | Time Spent Running SA: 3.01 hours |
| + | Time Spent Processing Spam: 2.07 hours |
| + | Time Spent Processing Ham: 0.94 hours |
| + | TOP SPAM RULES FIRED |
| + | ---------------------------------------------------------------------- |
| + | RANK RULE NAME COUNT %OFMAIL %OFSPAM %OFHAM |
| + | ---------------------------------------------------------------------- |
| + | 1 RCVD_IN_APEWSL2 1809 67.05 83.56 18.08 |
| + | 2 RCVD_IN_BRBL 1789 62.04 82.63 0.96 |
| + | 3 RAZOR2_CHECK 1786 61.93 82.49 0.96 |
| + | 4 BAYES_99 1780 61.49 82.22 0.00 |
| + | 5 RAZOR2_CF_RANGE_51_100 1759 61.00 81.25 0.96 |
| + | 6 DIGEST_MULTIPLE 1656 57.37 76.49 0.68 |
| + | 7 DCC_CHECK 1567 56.93 72.38 11.10 |
| + | 8 URIBL_BLACK 1528 53.26 70.58 1.92 |
| + | 9 RCVD_IN_XBL 1494 51.64 69.01 0.14 |
| + | 10 RAZOR2_CF_RANGE_E8_51_100 1485 51.47 68.59 0.68 |
| + | 11 RCVD_IN_JMF_BL 1484 51.68 68.55 1.64 |
| + | 12 PYZOR_CHECK 1445 50.36 66.74 1.78 |
| + | 13 RCVD_IN_PBL 1413 48.95 65.27 0.55 |
| + | 14 URIBL_JP_SURBL 1347 46.53 62.22 0.00 |
| + | 15 URIBL_SBL 1320 45.60 60.97 0.00 |
| + | 16 URIBL_WS_SURBL 1294 44.70 59.77 0.00 |
| + | 17 DSPAM_SPAM_99 1147 39.62 52.98 0.00 |
| + | 18 SEM_URIRED 1135 39.79 52.42 2.33 |
| + | 19 SEM_URI 1002 34.78 46.28 0.68 |
| + | 20 HTML_MESSAGE 981 52.92 45.31 75.48 |
| + | ---------------------------------------------------------------------- |
| + | TOP HAM RULES FIRED |
| + | ---------------------------------------------------------------------- |
| + | RANK RULE NAME COUNT %OFMAIL %OFSPAM %OFHAM |
| + | ---------------------------------------------------------------------- |
| + | 1 BAYES_00 715 25.98 1.71 97.95 |
| + | 2 DSPAM_HAM_99 696 25.01 1.29 95.34 |
| + | 3 HTML_MESSAGE 551 52.92 45.31 75.48 |
| + | 4 SPF_PASS 329 13.68 3.09 45.07 |
| + | 5 RCVD_IN_JMF_W 145 5.11 0.14 19.86 |
| + | 6 RCVD_IN_APEWSL2 132 67.05 83.56 18.08 |
| + | 7 MIME_HTML_ONLY 131 14.82 13.76 17.95 |
| + | 8 SPF_HELO_PASS 96 3.52 0.28 13.15 |
| + | 9 DCC_CHECK 81 56.93 72.38 11.10 |
| + | 10 RCVD_IN_DNSWL_MED 63 2.18 0.00 8.63 |
| + | 11 RCVD_IN_DNSWL_LOW 62 2.14 0.00 8.49 |
| + | 12 SARE_SUB_ENC_UTF8 59 3.56 2.03 8.08 |
| + | 13 MPART_ALT_DIFF 55 2.63 0.97 7.53 |
| + | 14 USER_IN_WHITELIST 48 1.66 0.00 6.58 |
| + | 15 MIME_HTML_MOSTLY 43 2.00 0.69 5.89 |
| + | 16 MIME_QP_LONG_LINE 31 2.56 1.99 4.25 |
| + | 17 EXTRA_MPART_TYPE 31 1.52 0.60 4.25 |
| + | 18 MIME_BASE64_BLANKS 31 1.07 0.00 4.25 |
| + | 19 HTML_IMAGE_RATIO_06 29 1.04 0.05 3.97 |
| + | 20 MISSING_MID 28 1.52 0.74 3.84 |
| + | ---------------------------------------------------------------------- |
| | | |
| ==FAQ== | | ==FAQ== |