SME8.0 QA
Version 8.0 testing
This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.
The document should be used as Work In Progress so please feel free to add additional test scenarios, comments and add "Pass" if you have finished a specific test so that other testers can see what still needs to be done.
In general - check the related logfile(s) for each test
- don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
- A list of currently reported bugs for SME 8.0 is here: http://bugs.contribs.org/show_bug.cgi?id=3640
Test guidelines
Here are some guidelines from other users:
Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play. :)
When ready go into Bugzilla and review the open bugs. Find any that you can duplicate and report your results, even if just to confirm someone elses report is valid. If you find during your testing something does not work for you, and a bug does not exist, open a new bug.
The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.
For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:
- log in in server-manager
- create ibay
- test for directory created (-f /home/e-smith/ibays/ibayname)
- check for account (ibayname) created
- check for group (ibayname) created
- anaylze log for errors/exceptions
but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):
- log in in server-manager
- create ibay with invalid name
- check the error in the server-manager screen
- check no account (ibayname) is created
- check no group (ibayname) os created
- check that the error is present in the log file
Installation types
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.
to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)
- RAID1 (with lvm)
Comments:
- RAID1 "nolvm" - Pass
Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested
- RAID5 (with lvm)
Comments:
- RAID5 "nolvm"
Comments:
- RAIDx (with lvm)
Comments:
- RAIDx "nolvm"
Comments:
- RAID5 "with nospare"
Comments:
Upgrade from older versions
to check: /var/log/messages
- from 7.4
Comments:
- from 7.3
Comments:
- from 7.2
Comments:
- from 7.1
Comments:
- older 7.0
Comments:
Configurations
- server-gateway - Pass
Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN
- server-only
Comments:
Server roles
- PDC - setup Primary Domain Controller - Pass
Steps:
- join PC to domain and test domain user logon on that PC - Pass
- domain user password change via Ctrl-Alt-Del - still to be tested
Comments:
- Workgroup server
Comments:
User/groups setup
- create new user account,
-reset user password,
-lock/unlock account,
-add/remove user to different groups
-delete user account
-re create deleted user account
-reset user password user account
to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure
Ibay setup
- create new ibay,
- ibay access protected by password,
-copy/delete files in ibays
to check: /var/log/messages, /var/log/httpd/admin_error_log
Email server
- pop3(s)
Comments:
- imap(s) - Pass
Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external
to check: /var/log/pop3(s)/current; /var/log/imap(s)/current
ClamAV
- Clam/email integration
to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log
- regular Clam scans
enable regular scanning in server-manager and check results (email to admin)
Comments:
DHCP server
- test IP allocation for predefined MAC addresses (= 'static' IP allocation)
to check: /var/log/messages
Remote access/VPN
Set a number of PPTP clients in server manager and test remote access (repeatedly)
ldap
test access from various email clients
- Outlook,
- Outlook Express,
- Thunderbird - Pass
tested from LAN PCs (Windows & Ubuntu) and external (public ldap access enabled)
- more (?)
Backup
Contribs
add individual contribs here