Changes

==Built-In Email Reports==

==Built-In Email Reports==

Some email statistics can be seen from server-manager under "Administration", "[[Mail_log_file_analysis|Mail log file analysis]]"

Some email statistics can be seen from server-manager under "Administration", "Mail log file analysis"

 

SME 7.2 and later include the 'logterse' plugin to qpsmtpd as well as the 'qplogsumm.pl' statistics script.

SME 7.2 and later include the 'logterse' plugin to qpsmtpd as well as the 'qplogsumm.pl' statistics script.

All in-bound SMTP connections are handled by qpsmtpd.  In addition to the qplogsumm ''summary'' information described here, you can view the raw qpsmtpd logs as described in [[Mail_log_file_analysis]].

''logterse'' creates a one-line summary of each qpsmtpd transaction and writes it to the log

file.  In order to view ''only'' these one-line-per-message extracts from the qpsmtpd log:

* Select ''View log files'' in server-manager

** hopefully you will actually have ''some'' real email arriving at your server (not all ''dnsbl'' entries as shown here)

** results are ''<tab>'' delimited, so you can easily ''Copy'' and ''Paste Special / Text'' into Excel for further analysis

2008-11-08 06:35:41.724563500 26375 logging::logterse plugin: ` 58.126.113.198 Unknown [58.126.113.198] <benny@surecom.com> rhsbl 901 Not supporting null originator (DSN) msg denied before queued

2008-11-08 06:37:41.211401500 26409 logging::logterse plugin: ` 87.103.146.91 pmsn.91.146.103.87.sable.dsl.krasnet.ru pmsn.91.146.103.87.sable.dsl.krasnet.ru <dwtrupsm@trups.com> dnsbl 903 http://www.spamhaus.org/query/bl?ip=87.103.146.91 msg denied before queued</nowiki>

====qplogsumm.pl====

===qplogsumm.pl===

qplogsumm.pl updates /var/log/qpsmtpd/state with per-plugin statistics for any qpsmtpd plugin that appears in a qpsmtpd logterse entry each time the qpsmtpd log is rotated.  

qplogsumm.pl updates /var/log/qpsmtpd/state with per-plugin statistics for any qpsmtpd plugin that appears in a qpsmtpd logterse entry each time the qpsmtpd log is rotated.  

e-smith-viewlogfiles-1.8.0-4 (released Nov 28 2007) or later will allow you to 'View' /var/log/qpsmtpd/state from 'View log files' in the server-manager (earlier versions conceal all files named "state" - [[bugzilla:3416|Bug 3416]]).

e-smith-viewlogfiles-1.8.0-4 (released Nov 28 2007) or later will allow you to 'View' /var/log/qpsmtpd/state from 'View log files' in the server-manager (earlier versions conceal all files named "state" - [[bugzilla:3416|Bug 3416]]).

=====Enable qplogsumm=====

====Enable qplogsumm====

qplogsumm.pl is disabled by default in smeserver-qpsmtpd-1.2.1-52.el4.sme and later ([[bugzilla:3727|Bug 3727]]).  Enable it with

qplogsumm.pl is disabled by default in smeserver-qpsmtpd-1.2.1-52.el4.sme and later ([[bugzilla:3727|Bug 3727]]).  Enable it with

  config setprop qpsmtpd qplogsumm enabled

  config setprop qpsmtpd qplogsumm enabled

  signal-event email-update

  signal-event email-update

=====Force first log rotation=====

====Force first log rotation====

qplogsumm.pl only updates its statistics when the qpsmtpd log file is rotated.  This can take several days on a moderately busy server, and could take weeks or months on some servers.

qplogsumm.pl only updates its statistics when the qpsmtpd log file is rotated.  This can take several days on a moderately busy server, and could take weeks or months on some servers.

  kill -ALRM `cat /var/service/qpsmtpd/log/supervise/pid`

  kill -ALRM `cat /var/service/qpsmtpd/log/supervise/pid`

=====Potential Problems=====

====Potential Problems====

======/var/log/qpsmtpd/state missing======

=====/var/log/qpsmtpd/state missing=====

qplogsumm.pl will completely lock all in-bound email if <tt>/var/log/qpsmtpd/state</tt> is missing when multilog attempts to rotate the qpsmtpd log file ([[bugzilla:3393|Bug 3393]]).  This will never happen under normal circumstances - only in the event of a disk error or if the administrator moves or deletes the existing file.  If this does happen, the problem can be resolved using

qplogsumm.pl will completely lock all in-bound email if <tt>/var/log/qpsmtpd/state</tt> is missing when multilog attempts to rotate the qpsmtpd log file ([[bugzilla:3393|Bug 3393]]).  This will never happen under normal circumstances - only in the event of a disk error or if the administrator moves or deletes the existing file.  If this does happen, the problem can be resolved using

   touch /var/log/qpsmtpd/state

   touch /var/log/qpsmtpd/state

   sv restart /var/log/qpsmtpd

   sv restart /var/log/qpsmtpd

======Unprocessed Log Files======

=====Unprocessed Log Files=====

If qpsmtpd is terminated abnormally (due to a power failure, for example), the log files may not be completely "processed".  If this happens, you will have files in <tt>/var/log/qpsmtpd</tt> with names like the one shown below, ending in '''.u''':<code> @4000000048ec03873b1a841c.u</code>

If qpsmtpd is terminated abnormally (due to a power failure, for example), the log files may not be completely "processed".  If this happens, you will have files in <tt>/var/log/qpsmtpd</tt> with names like the one shown below, ending in '''.u''':<code> @4000000048ec03873b1a841c.u</code>

The transactions in these '''.u''' log files will '''not''' be included in the summary information in <tt>/var/log/qpsmtpd/state</tt>

The transactions in these '''.u''' log files will '''not''' be included in the summary information in <tt>/var/log/qpsmtpd/state</tt>

==== qmail: Outgoing SMTP traffic ====

=== qmail: Outgoing SMTP traffic ===

Once a message has been accepted by ''qpsmtpd'' it is handed to ''qmail'' for delivery.

''qmail'' log file analysis and some statistics are described in [[Mail_log_file_analysis]]

 

* If the message is addressed to a remote email address, qmail either delivers the message directly to the recipient's mail server, or to the relay mail server value at ''server-manager::email::Address of internet provider's mail''

Note that since all spam filtering is done by qpsmtpd, ''qmail'' log files or analysis tools will contain spam filtering statistics.

==Contribs & Addons==

===Contribs & Addons===

===Brian Read's spamfilter-stats-7.pl===

====Brian Read's spamfilter-stats-7.pl====

Brian Read's mailstats contrib analyzes your qpsmtpd log files and sends an email to the specified email address summarizing your SME server activity.

Brian Read's mailstats contrib analyzes your qpsmtpd log files and sends an email to the specified email address summarizing your SME server activity.

Full details can be found at '''[[mailstats]]'''

Full details can be found at '''[[mailstats]]'''

====Qmail_Statistics_(AWStats)====

===Qmail_Statistics_(AWStats)===

Michael Weinberger has assembled a script that allows you to easily install awstats and configure it to provide email delivery statistics.

Michael Weinberger has assembled a script that allows you to easily install awstats and configure it to provide email delivery statistics.

Full details can be found at '''[[Qmail_Statistics_(AWStats)]]'''

Full details can be found at '''[[Qmail_Statistics_(AWStats)]]'''

====qplogtail====

===qplogtail===

qplogtail is a script intended to help monitor /var/log/qpsmtpd/current and extract a concise but meaningful display of what the server is up to.

qplogtail is a script intended to help monitor /var/log/qpsmtpd/current and extract a concise but meaningful display of what the server is up to.

Direct comments or questions to [[Bugzilla:3418]]

Direct comments or questions to [[Bugzilla:3418]]

====qploggrep====

===qploggrep===

<b>qploggrep</b> allows you to search your existing qpsmtpd logs as though they had been generated by <b>qplogtail</b>, then display matching results.

<b>qploggrep</b> allows you to search your existing qpsmtpd logs as though they had been generated by <b>qplogtail</b>, then display matching results.

* ''qploggrep'' uses a case-insensitive search, so <tt>qploggrep abc</tt> will locate lines containing ''abc'', ''ABC'', ''aBc'', etc.

* ''qploggrep'' uses a case-insensitive search, so <tt>qploggrep abc</tt> will locate lines containing ''abc'', ''ABC'', ''aBc'', etc.

====[[Qpsmtpd_connection_time]]====

===[[Qpsmtpd_connection_time]]===

See [[qpsmtpd_connection_time]]

See [[qpsmtpd_connection_time]]

----

----

[[Category:Howto]]

[[Category:Howto]]