Email Statistics

Email Statistics

How to get statistics about the performance of your mail server

Built-In Statistical Reports

Server-Manager

Some email statistics can be seen from server-manager under "Administration", "Mail log file analysis"

qplogsumm.pl

SME 7.2 and later include the 'logterse' plugin to qpsmtpd as well as the 'qplogsumm.pl' statistics script. 'qplogsumm.pl' updates /var/log/qpsmtpd/state with per-plugin statistics for any qpsmtpd plugin that appears in a qpsmtpd logterse entry each time the qpsmtpd log is rotated.

Normally, SME conceals the /var/log/???/state files from 'View log files' in the server-manager. You can expose /var/log/qpsmtpd/state using the instructions shown here: http://bugs.contribs.org/process_bug.cgi

Contribs & Addons

Brian Read's spamfilter-stats-7.pl

Brian Read's mailstats.pl script analyzes your qpsmtpd log files and sends a daily email to "admin" summarizing that day's email activity.

Download & Installation

wget -O /etc/cron.d/mailstats.cron \
http://mirror.contribs.org/smeserver/contribs/bread/mailstats/mailstats.cron
wget -O /usr/bin/spamfilter-stats-7.pl \
http://mirror.contribs.org/smeserver/contribs/bread/mailstats/spamfilter-stats-7.pl

WARNING: Make sure that these files are accessible before executing the above commands! If you are unable to access http://mirror.contribs.org/smeserver/contribs/bread/mailstats/ the above commands will create empty files, overwriting existing versions.

Configuration

The latest release (v0.6.15) supports several SME database options:

• Create the service

config set mailstats service

• Status

config setprop mailstats Status ("enabled"|"disabled")

• Column Headings (enable, supress or only show if nonzero)

config setprop mailstats <column header> ("yes"|"no"|"auto")

• QpsmtpCodes

config setprop mailstats QpsmtpdCodes ("enabled"|"disabled")

• SpamAssassin Rules

config setprop mailstats SARules ("enabled"|"disabled")

• JunkMailList

config setprop mailstats JunkMailList  ("enabled"|"disabled")

• SpamAssassin Rule Percent Threshold for report cutoff

config setprop mailstats SARulePercentThreshold (0.5)

• Email to send report

config setprop mailstats Email (admin) - email to send report

In older versions, the email recipient is specified in the spamfilter-stats-7.pl file, using:

 $opt{'mail'}     = "admin";

which will deliver email to the local 'admin' account on your SME server. Configure email forwarding in server-manager::Collaboration::Users::admin to deliver the emails to another location.

Handling @*.u Logfiles

Multilog occasionally generates log files that end in ".u" instead of ".s". The multilog manual says this:

• .s: This file is completely processed and safely written to disk.
• .u: This file was being created at the moment of an outage. It may have been truncated. It has not been processed.

The latest version of mailstats.cron will process "@*" and "current", so will catch all log files. Earlier versions only processed "*.s" and "current".

qplogtail

qplogtail is a script intended to help monitor /var/log/qpsmtpd/current and extract a concise but meaningful display of what the server is up to.

qplogtail extracts 5 kinds of information:

1. Normal connections:
   28545 Accepted connection 4/30 from 86.139.2.73 ...
2. Errors in violation of Instances:
   5146 Too many connections: 40 >= 40. Waiting one second.
3. Errors in violation of InstancesPerIP:
   5320 hosts_allow plugin: Too many connections from 212.100.229.201: 6 > 5Denying connection.
4. Messages blocked by any qpsmtpd plugin:
   15751 logging::logterse plugin: ` 82.210.181.241 241-pra-6.acn.waw.pl 241-pra-6.acn.waw.pl <Glasteinzhza@ask-it-here.com> dnsbl 903 http://www.spamhaus.org/query/bl?ip=82.210.181.241 msg denied before queued
5. Messages queued for delivery:
   15587 logging::logterse plugin: ` 128.220.32.40 miami.deuvis.com miami.deuvis.com <aapple@deuvis.com> <c.wolf@ncxr.org> queued <200709270344.l8R3iq0b010299@deuvis.com> No, hits=-2.6 required=5.0_

Each smtp transaction will generate two lines of output containing:

msgid   remote_ip   x/40
msgid   remote_ip   dispostion   details

Sample output:

# qplogtail
14185   213.37.31.24    dnsbl   msg denied before queued
14262   64.233.184.243  1/40
14262   64.233.184.243  queued  No, hits=-101.1 required=5.0_
14320   71.8.114.81     1/40
14320   71.8.114.81     dnsbl   msg denied before queued
14349   200.63.233.145  1/40
14349   200.63.233.145  dnsbl   msg denied before queued

To install:

cd /usr/local/bin
wget -O qplogtail http://bugs.contribs.org/attachment.cgi?id=1379
chmod 755 qplogtail

To run:

qplogtail

Direct comments or questions to Bugzilla:3418

---