Difference between revisions of "SME8.0 QA"

From SME Server
Jump to navigationJump to search
m (wikify some more)
Line 5: Line 5:
  
 
In general
 
In general
−
<br />- check the related logfile(s) for each test
+
* check the related logfile(s) for each test
−
<br />- don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
+
* don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
−
<br />- A list of currently reported bugs for SME 8.0 is here: http://bugs.contribs.org/show_bug.cgi?id=3640
+
* A list of currently reported bugs for SME 8.0 is here: [[bugzilla:3640]]
  
 
===Test guidelines===
 
===Test guidelines===
Line 15: Line 15:
  
 
When ready go into Bugzilla and review the open bugs. Find any that you can duplicate and report your results, even if just to confirm someone elses report is valid. If you find during your testing something does not work for you, and a bug does not exist, open a new bug.
 
When ready go into Bugzilla and review the open bugs. Find any that you can duplicate and report your results, even if just to confirm someone elses report is valid. If you find during your testing something does not work for you, and a bug does not exist, open a new bug.
−
--------------
+
----
 
The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.
 
The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.
  
 
For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:
 
For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:
  
−
- log in in server-manager
+
* log in in server-manager
−
<br />- create ibay
+
* create ibay
−
<br />- test for directory created (-f /home/e-smith/ibays/ibayname)
+
* test for directory created (-f /home/e-smith/ibays/ibayname)
−
<br />- check for account (ibayname) created
+
* check for account (ibayname) created
−
<br />- check for group (ibayname) created
+
* check for group (ibayname) created
−
<br />- anaylze log for errors/exceptions
+
* anaylze log for errors/exceptions
  
 
but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):
 
but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):
  
−
- log in in server-manager
+
* log in in server-manager
−
<br />- create ibay with invalid name
+
* create ibay with invalid name
−
<br />- check the error in the server-manager screen
+
* check the error in the server-manager screen
−
<br />- check no account (ibayname) is created
+
* check no account (ibayname) is created
−
<br />- check no group (ibayname) os created
+
* check no group (ibayname) os created
−
<br />- check that the error is present in the log file
+
* check that the error is present in the log file
−
--------------
+
----
−
 
 
 
===Installation types===
 
===Installation types===
 
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.
 
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.
Line 79: Line 78:
 
*PDC - setup Primary Domain Controller - Pass
 
*PDC - setup Primary Domain Controller - Pass
 
Steps:  
 
Steps:  
−
<br />- join PC to domain and test domain user logon on that PC - Pass
+
* join PC to domain and test domain user logon on that PC - Pass
−
<br />- domain user password change via Ctrl-Alt-Del - still to be tested
+
* domain user password change via Ctrl-Alt-Del - still to be tested
  
 
Comments:
 
Comments:
Line 87: Line 86:
  
 
===User/groups setup===
 
===User/groups setup===
−
- create new user account,  
+
* create new user account,  
−
<br />-reset user password,  
+
*reset user password,  
−
<br />-lock/unlock account,  
+
*lock/unlock account,  
−
<br />-add/remove user to different groups
+
*add/remove user to different groups
−
<br />-delete user account
+
*delete user account
−
<br />-re create deleted user account
+
*re create deleted user account
−
<br />-reset user password user account
+
*reset user password user account
 
to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure
 
to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure
  
 
===Ibay setup===
 
===Ibay setup===
−
- create new ibay,  
+
* create new ibay,  
−
<br />- ibay access protected by password,  
+
* ibay access protected by password,  
−
<br />-copy/delete files in ibays
+
* copy/delete files in ibays
  
 
to check: /var/log/messages, /var/log/httpd/admin_error_log
 
to check: /var/log/messages, /var/log/httpd/admin_error_log
Line 134: Line 133:
 
===ldap===
 
===ldap===
 
test access from various email clients  
 
test access from various email clients  
−
<br />- Outlook,  
+
* Outlook,  
−
<br />- Outlook Express,  
+
* Outlook Express,  
−
<br />- Thunderbird - Pass  
+
* Thunderbird - Pass  
−
<br />tested from LAN PCs (Windows & Ubuntu) and external (public ldap access enabled)  
+
tested from LAN PCs (Windows & Ubuntu) and external (public ldap access enabled)  
−
<br />- more (?)
+
* more (?)
  
 
===Backup===
 
===Backup===

Revision as of 07:52, 29 August 2009

Version 8.0 testing

This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.

The document should be used as Work In Progress so please feel free to add additional test scenarios, comments and add "Pass" if you have finished a specific test so that other testers can see what still needs to be done.

In general

  • check the related logfile(s) for each test
  • don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
  • A list of currently reported bugs for SME 8.0 is here: bugzilla:3640

Test guidelines

Here are some guidelines from other users:

Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play. :)

When ready go into Bugzilla and review the open bugs. Find any that you can duplicate and report your results, even if just to confirm someone elses report is valid. If you find during your testing something does not work for you, and a bug does not exist, open a new bug.

The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.

For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:

  • log in in server-manager
  • create ibay
  • test for directory created (-f /home/e-smith/ibays/ibayname)
  • check for account (ibayname) created
  • check for group (ibayname) created
  • anaylze log for errors/exceptions

but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):

  • log in in server-manager
  • create ibay with invalid name
  • check the error in the server-manager screen
  • check no account (ibayname) is created
  • check no group (ibayname) os created
  • check that the error is present in the log file

Installation types

Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.

to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)

  • RAID1 (with lvm)

Comments:

  • RAID1 "nolvm" - Pass

Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested

  • RAID5 (with lvm)

Comments:

  • RAID5 "nolvm"

Comments:

  • RAIDx (with lvm)

Comments:

  • RAIDx "nolvm"

Comments:

  • RAID5 "with nospare"

Comments:

Upgrade from older versions

to check: /var/log/messages

  • from 7.4

Comments:

  • from 7.3

Comments:

  • from 7.2

Comments:

  • from 7.1

Comments:

  • older 7.0

Comments:

Configurations

  • server-gateway - Pass

Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN

  • server-only

Comments:

Server roles

  • PDC - setup Primary Domain Controller - Pass

Steps:

  • join PC to domain and test domain user logon on that PC - Pass
  • domain user password change via Ctrl-Alt-Del - still to be tested

Comments:

  • Workgroup server

Comments:

User/groups setup

  • create new user account,
  • reset user password,
  • lock/unlock account,
  • add/remove user to different groups
  • delete user account
  • re create deleted user account
  • reset user password user account

to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure

Ibay setup

  • create new ibay,
  • ibay access protected by password,
  • copy/delete files in ibays

to check: /var/log/messages, /var/log/httpd/admin_error_log

Email server

  • pop3(s)

Comments:

  • imap(s) - Pass

Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external

to check: /var/log/pop3(s)/current; /var/log/imap(s)/current

ClamAV

  • Clam/email integration

to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log

  • regular Clam scans

enable regular scanning in server-manager and check results (email to admin)

Comments:

DHCP server

  • test IP allocation - Pass


- for predefined MAC addresses (= 'static' IP allocation)
- for dynamic IPs

Comments: Both scenarios tested

to check: /var/log/messages

Remote access/VPN

Set a number of PPTP clients in server manager and test remote access (repeatedly)

ldap

test access from various email clients

  • Outlook,
  • Outlook Express,
  • Thunderbird - Pass

tested from LAN PCs (Windows & Ubuntu) and external (public ldap access enabled)

  • more (?)

Backup

Contribs

add individual contribs here

Retrieved from "https://wiki.koozali.org/index.php?title=SME8.0_QA&oldid=13370"