SME8.0 QA

Version 8.0 testing

This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.

The document should be used as Work In Progress so please feel free to add additional test scenarios and comments

All tests here should be based on the currently available version 8.0 beta 4 (09/2009). Once a next version (maybe a later beta or release candidate) is released, we plan to use this existing document as the template for that next version and might have to do most if not all of these tests again on that newer version! The more details for our procedures we document here, the easier it might be for more testers to join our efforts!

In general

• check the related logfile(s) for each test
• don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
• A list of currently reported bugs for SME 8.0 is here: bugzilla matrix

Test guidelines

The purpose of the page is mostly to verify features are working, you can list a bug number if you like but we don't intend to duplicate the tracking provided by bugzilla:

Executive Summary

In general almost everything works as well as in SME 7

The obvious bugs are

USB Backup, various sub systems need tweaking before USB Disks can be mounted

LDAP searches fail, there is a workaround but devs are waiting to see if they will rewrite LDAP completely

Verification

Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play. :)

The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.

For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:

• log in in server-manager
• create ibay
• test for directory created (-f /home/e-smith/ibays/ibayname)
• check for account (ibayname) created
• check for group (ibayname) created
• anaylze log for errors/exceptions

but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):

• log in in server-manager
• create ibay with invalid name
• check the error in the server-manager screen
• check no account (ibayname) is created
• check no group (ibayname) is created
• check that the error is present in the log file

Header codes

Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly

• header x - unchecked
• header ? - questions, or more to do
• header bug - there is a bug
• header - blank means the section has passed

Installation

Installation types

Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.

to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)

• RAID1 nolvm spares=2 - Pass

Comments:

• RAID1 "nolvm" - Pass

Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested

• RAID5 (with lvm) spares=0 - Pass

Comments:

• RAID5 nolvm spares=2 - Pass

Comments:

• RAID6 (with lvm) spare=1 multipart - Pass

Comments:

• RAIDx "nolvm"

Comments:

Upgrading x

Upgrade from older versions x

to check: /var/log/messages

• from 7.4

• from 7.3

• from 7.2

• from 7.1

• older 7.0

Console ?

• cosmetic bug 3561

briefly displays 'Could not open pci table...'

Check Status

Pass - the server displays 'This sever has been running for ...'

Configure Server ?

basic configuration works, eg NIC's, password, host and domain names

DHCP server

• test IP allocation - Pass

for predefined MAC addresses (= 'static' IP allocation)

for dynamic IPs

Server-gateway

• Pass

Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN

Server-only

Comments:

Comments: Both scenarios tested

Test internet

• Pass - Prompt displays, then 'The test was successful...'

Reboot

• Pass for each of

reboot

reconfigure

shutdown

Raid

• pass

console, option 5, displays correctly for single disk

displays correctly for various RAID scenarios, all those combinations which we tested under SME8.0_QA#Installation_types

another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state.

Access Server Manger

• Pass - server-manager displays and navigation works

View Support

• Pass, The GPL text displays

Backup to USB -bug

see bug 4809

Server Manager ?

Collaboration ?

Users -bug

adding and deleting users works, there is a bug but is only with adding users to the ldap directory

• create new user account - partially passed only

Comments: Although user create via server-manager looks OK, the logs indicate other problems:

Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: OLD test101=(undefined) 
Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: NEW test101= 
... cut - all good ...
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Processing event: user-create test101 
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S04user-create-unix 
... cut - all good ... 
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Locking password for user test101.  
... cut ... 
Aug 30 07:12:42 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/actions/generic_template_expand 
Aug 30 07:12:42 mdo002sv esmith::event[20906]: expanding /etc/dhcpd.conf  
... cut ...
Aug 30 07:12:45 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S25ldap-update 
Aug 30 07:12:46 mdo002sv esmith::event[20906]: failed to add entry for uid=test101,dc=ht,dc=co,dc=nz: attribute 'uid' not allowed at /etc/e-smith/events/user-create/S25ldap-update line 159.  
... cut - (ldap) issue above

Will investigate ldap issue ( bug 2859 + bug 5159 )

• reset user password - Pass

Comments: server-manager message OK, eventlog check OK

• lock/unlock account - Pass

Comments: both activities checked; server-manager messages OK, eventlog check OK

• add/remove user to different groups - Pass

Comments: added user to various other groups and later removed from all of these groups

• delete user account - Pass (partially only)

Server manager message: An error occurred while trying to delete the user but the user name is actually removed from the list of users Extract from messages log:

Sep  6 18:09:49 mdo002sv esmith::event[2209]: Running event handler: /etc/e-smith/events/user-delete/S25ldap-delete 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 fd=11 ACCEPT from IP=127.0.0.1:55366 (IP=0.0.0.0:389) 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 BIND dn="cn=root,dc=ht,dc=co,dc=nz" method=128 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 BIND dn="cn=root,dc=ht,dc=co,dc=nz" mech=SIMPLE ssf=0 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 RESULT tag=97 err=0 text= 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=1 SRCH base="dc=ht,dc=co,dc=nz" scope=2 deref=2 filter="(uid=test101)" 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=1 SEARCH RESULT tag=101 err=32 nentries=0 text= 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 fd=11 closed (connection lost) 
Sep  6 18:09:50 mdo002sv esmith::event[2209]: Failed ldap search: No such object at /etc/e-smith/events/user-delete/S25ldap-delete line 63.  

I suspect this to be related to the above ldap issue ( bugs 2859 + bug 5159 )

• re create deleted user account - Tested but failed (assuming due to above user-delete only partially working)
• reset user password user account - Pass

Here is an extract from one test:

Sep  6 18:17:45 mdo002sv esmith::event[2313]: Processing event: password-modify test103 
Sep  6 18:17:45 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/actions/generic_template_expand 
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/dhcpd.conf  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/rssh.conf  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/ftpusers  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/pptpd.conf  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/proftpd.conf  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/options.pptpd  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/ip-up.local  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/ip-down.local  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/raddb/users  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/raddb/radiusd.conf  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/accounts.deny  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/users.allow  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/accounts.allow  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: generic_template_expand=action|Event|password-modify|Action|generic_template_expand|Start|1252217865 382477|End|1252217866 894907|Elapsed|1.51243 
Sep  6 18:17:46 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/password-modify/S25count-active-user-accounts 
Sep  6 18:17:47 mdo002sv /etc/e-smith/events/password-modify/S25count-active-user-accounts[2315]: /home/e-smith/db/configuration: OLD ActiveAccounts=6 
Sep  6 18:17:47 mdo002sv /etc/e-smith/events/password-modify/S25count-active-user-accounts[2315]: /home/e-smith/db/configuration: NEW ActiveAccounts=7 
Sep  6 18:17:47 mdo002sv esmith::event[2313]: S25count-active-user-accounts=action|Event|password-modify|Action|S25count-active-user-accounts|Start|1252217866 895433|End|1252217867 40990|Elapsed|0.145557 
Sep  6 18:17:47 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/actions/adjust-services 
Sep  6 18:17:47 mdo002sv esmith::event[2313]: adjusting supervised radiusd (sigterm)  
Sep  6 18:17:47 mdo002sv esmith::event[2313]: adjusting supervised radiusd (up)  
Sep  6 18:17:47 mdo002sv esmith::event[2313]: adjust-services=action|Event|password-modify|Action|adjust-services|Start|1252217867 41580|End|1252217867 395625|Elapsed|0.354045 

to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure

Groups -bug

Adding a removeing groups works, with the same ldap issue as for users

Pseudonyms

• Pass

created a pseudonym jane to sent to usera

created a pseudonym jane@test.org to userb

sent mail to both which was received as expected

Information Bays x

User access via file sharing ?

basic smb file access working as expected

to test, permissions etc

Public access via web

Primary web site access tested form public Internet. If not configured, the default (".. under construction ..") works.

Administration x

Backup and restore x

Backup x

to desktop

a server with a small amount of data created a smeserver.tgz correctly

to workstation

• pass - tested a set of three to a cifs share

to usb disk -bug

bug 4809

Restore x

from workstation

• pass - tested a set of three to a cifs share, with verification

View log files

view log files works, including filtering and highlighting

download logfile works

Mail log files

local mail delivery is reported

external mail delivery is tested (ongoing use for a 'production' home server) and email logs are OK

Reboot and shutdown

• Pass for each of

reboot

reconfigure

shutdown

Security x

Remote access x

VPN / PPTP

• Pass

Set a number of PPTP clients in server manager and test remote access (repeatedly)

SSH ?

• Pass - remote access from local network on port other than 22
• todo - test external access allowed and denied

Port forwarding ?

server gateway - todo

server only - pass

"This server is currently in serveronly mode and portforwarding is not possible."

Proxy settings ?

Web

net access via the squid proxy works

net access is disabled via squid proxy if disabled

Configuration ?

Software Installer

Updates

updates via the panel work

the updates available warning displays

Settings

Settings can be changed

Installing additional software works

Installing:
 wvdial               i386         1.54.0-5.2.2.1            base         131 k
Installing for dependencies:
 libwvstreams         i386         4.2.2-2.1                 base         657 k

and Removing

Removing:
 wvdial          i386          1.54.0-5.2.2.1          installed          264 k

Date and time

'Set Date and Time' manually works

'Configure Network Time Server' works, if you enter a valid time server

[a blank value for the time server reverts to manual date and time]

Workgroup ?

Domain controller ?

• PDC - setup Primary Domain Controller - Pass

Steps:

• join PC to domain (as user 'admin') and test domain user logon on that PC - Pass
• join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin) - Pass

Comments: The user 'michael' is part of that group:

db accounts show domain-admin-group 
domain-admin-group=group
   Description=Domain Admins
   Gid=5010
   Members=admin,michael
   Uid=5010

Comments: Here is a log extract from /var/log/messages for the latest join:

Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined) 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: NEW twt042lt$=machine 
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Creating Unix user and group  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Locking account  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: Locking password for user twt042lt$.  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: passwd: Success  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016 

• domain user password change via Ctrl-Alt-Del - Partially

Comments: Several combinations tested, incl. invalid combinations (e.g. password too short); successfully changed; case sensitivity tested; testing was done with the following setting in place:

db configuration show passwordstrength
passwordstrength=configuration
   Admin=none
   Ibays=none
   Users=none

Might need more testing with better password strength.

• Workgroup server

Comments:

Directory -bug

various bugs, see bugzilla

Test access from various email clients, list client, platform, Operating system, local and or external

Hostnames

set a hostname to a remote server works

set a hostname to self works

set hostname for other host on the local network - passed (tested with several other hosts)

Domains ?

2nd domain added, web and email works

DNS options to be tested

Email ?

Access ?

• webmail works

• pop3(s)

Comments:

• imap(s) - Pass

Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external

to check: /var/log/pop3(s)/current; /var/log/imap(s)/current

Antivirus

• Clam/email integration - Pass

to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log; email headers

Comments: Server runs in a semi production state - as a home server with various email accounts for family members (static IP, registered domain name). Have done regular checks for quite some time and there is nothing unusual or unexpected in all email logs. Incl. email header checks for spam recognition and filtering.

• regular Clam scans - Pass

enable regular scanning in server-manager and check results (email to admin)

Comments: Runs weekly without problems, emails to admin working.

Review

Basic server information is displayed

Miscellaneous

Support

The GPL text is displayed

Starter Website

Site created after entering text as prompted

Other x

Languages x

Displays ok, translations up-to-date

Contribs

Contribs have there own page SME8.0_Contribs_QA