SME8.0 QA

From SME Server
Jump to navigation Jump to search

Version 8.0 testing

This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.

The document should be used as Work In Progress so please feel free to add additional test scenarios, comments and add "Pass" if you have finished a specific test so that other testers can see what still needs to be done.

All tests here should be based on the currently available version 8.0 beta 4 (09/2009). Once a next version (maybe a next beta or release candidate) is released, we plan to use this existing document as the template for that next version and might have to do most if not all of these tests again on that newer version! The more details for our procedures we document here, the easier it might be for more testers to join our efforts!

In general

  • check the related logfile(s) for each test
  • don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
  • A list of currently reported bugs for SME 8.0 is here: bugzilla:3640

Test guidelines

Here are some guidelines from other users:

Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play. :)

When ready go into Bugzilla and review the open bugs. Find any that you can duplicate and report your results, even if just to confirm someone elses report is valid. If you find during your testing something does not work for you, and a bug does not exist, open a new bug.

The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.

For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:

  • log in in server-manager
  • create ibay
  • test for directory created (-f /home/e-smith/ibays/ibayname)
  • check for account (ibayname) created
  • check for group (ibayname) created
  • anaylze log for errors/exceptions

but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):

  • log in in server-manager
  • create ibay with invalid name
  • check the error in the server-manager screen
  • check no account (ibayname) is created
  • check no group (ibayname) os created
  • check that the error is present in the log file

Installation types

Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.

to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)

  • RAID1 (with lvm)

Comments:

  • RAID1 "nolvm" - Pass

Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested

  • RAID5 (with lvm)

Comments:

  • RAID5 "nolvm"

Comments:

  • RAIDx (with lvm)

Comments:

  • RAIDx "nolvm"

Comments:

  • RAID5 "with nospare"

Comments:

Upgrade from older versions

to check: /var/log/messages

  • from 7.4

Comments:

  • from 7.3

Comments:

  • from 7.2

Comments:

  • from 7.1

Comments:

  • older 7.0

Comments:

Configurations

  • server-gateway - Pass

Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN

  • server-only

Comments:

Server roles

  • PDC - setup Primary Domain Controller - Pass

Steps:

  • join PC to domain (as user 'admin') and test domain user logon on that PC - Pass
  • join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin) - Pass

Comments: The user 'michael' is part of that group: 

db accounts show domain-admin-group 
domain-admin-group=group
   Description=Domain Admins
   Gid=5010
   Members=admin,michael
   Uid=5010

Comments: Here is a log extract from /var/log/messages for the latest join: 

Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined) 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: NEW twt042lt$=machine 
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Creating Unix user and group  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Locking account  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: Locking password for user twt042lt$.  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: passwd: Success  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016
  • domain user password change via Ctrl-Alt-Del - Partially

Comments: Several combinations tested, incl. invalid combinations (e.g. password too short); succesfully changed; case sensitivity tested; testing was done with the following setting in place: 

db configuration show passwordstrength
passwordstrength=configuration
   Admin=none
   Ibays=none
   Users=none

Might need more testing with better password strength.

  • Workgroup server

Comments:

User/groups setup

  • create new user account - partially passed only

Comments: Although user create via server-manager looks OK, the logs indicate other problems: 

Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: OLD test101=(undefined) 
Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: NEW test101= 
... cut - all good ...
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Processing event: user-create test101 
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S04user-create-unix 
... cut - all good ... 
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Locking password for user test101.  
... cut ... 
Aug 30 07:12:42 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/actions/generic_template_expand 
Aug 30 07:12:42 mdo002sv esmith::event[20906]: expanding /etc/dhcpd.conf  
... cut ...
Aug 30 07:12:45 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S25ldap-update 
Aug 30 07:12:46 mdo002sv esmith::event[20906]: failed to add entry for uid=test101,dc=ht,dc=co,dc=nz: attribute 'uid' not allowed at /etc/e-smith/events/user-create/S25ldap-update line 159.  
... cut - (ldap) issue above

Will investigate ldap issue ( bug 2859 + bug 5159 )

  • reset user password - Pass

Comments: server-manager message OK, eventlog check OK

  • lock/unlock account - Pass

Comments: both activities checked; server-manager messages OK, eventlog check OK

  • add/remove user to different groups - Pass

Comments: added user to various other groups and later removed from all of these groups

  • delete user account
  • re create deleted user account
  • reset user password user account

to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure

Ibay setup

  • create new ibay,
  • ibay access protected by password,
  • copy/delete files in ibays

to check: /var/log/messages, /var/log/httpd/admin_error_log

Email server

  • pop3(s)

Comments:

  • imap(s) - Pass

Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external

to check: /var/log/pop3(s)/current; /var/log/imap(s)/current

ClamAV

  • Clam/email integration

to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log

  • regular Clam scans

enable regular scanning in server-manager and check results (email to admin)

Comments:

DHCP server

  • test IP allocation - Pass


- for predefined MAC addresses (= 'static' IP allocation)
- for dynamic IPs

Comments: Both scenarios tested

to check: /var/log/messages

Remote access/VPN

Set a number of PPTP clients in server manager and test remote access (repeatedly)

ldap

test access from various email clients

  • Outlook,
  • Outlook Express,
  • Thunderbird - Pass

tested from LAN PCs (Windows & Ubuntu) and external (public ldap access enabled)

  • more (?)

Backup

Contribs

add individual contribs here

Retrieved from "https://wiki.koozali.org/index.php?title=SME8.0_QA&oldid=13386"