SME8.0 QA

From SME Server
Revision as of 07:26, 6 September 2009 by Mdo (talk | contribs) (→‎ClamAV)
Jump to navigation Jump to search

Version 8.0 testing

This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.

The document should be used as Work In Progress so please feel free to add additional test scenarios, comments and add "Pass" if you have finished a specific test so that other testers can see what still needs to be done.

All tests here should be based on the currently available version 8.0 beta 4 (09/2009). Once a next version (maybe a next beta or release candidate) is released, we plan to use this existing document as the template for that next version and might have to do most if not all of these tests again on that newer version! The more details for our procedures we document here, the easier it might be for more testers to join our efforts!

In general

  • check the related logfile(s) for each test
  • don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
  • A list of currently reported bugs for SME 8.0 is here: bugzilla:3640

Test guidelines

Here are some guidelines from other users:

Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play. :)

When ready go into Bugzilla and review the open bugs. Find any that you can duplicate and report your results, even if just to confirm someone elses report is valid. If you find during your testing something does not work for you, and a bug does not exist, open a new bug.

The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.

For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:

  • log in in server-manager
  • create ibay
  • test for directory created (-f /home/e-smith/ibays/ibayname)
  • check for account (ibayname) created
  • check for group (ibayname) created
  • anaylze log for errors/exceptions

but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):

  • log in in server-manager
  • create ibay with invalid name
  • check the error in the server-manager screen
  • check no account (ibayname) is created
  • check no group (ibayname) os created
  • check that the error is present in the log file

Installation types

Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.

to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)

  • RAID1 (with lvm)

Comments:

  • RAID1 "nolvm" - Pass

Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested

  • RAID5 (with lvm)

Comments:

  • RAID5 "nolvm"

Comments:

  • RAIDx (with lvm)

Comments:

  • RAIDx "nolvm"

Comments:

  • RAID5 "with nospare"

Comments:

Upgrade from older versions

to check: /var/log/messages

  • from 7.4

Comments:

  • from 7.3

Comments:

  • from 7.2

Comments:

  • from 7.1

Comments:

  • older 7.0

Comments:

Configurations

  • server-gateway - Pass

Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN

  • server-only

Comments:

Server roles

  • PDC - setup Primary Domain Controller - Pass

Steps:

  • join PC to domain (as user 'admin') and test domain user logon on that PC - Pass
  • join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin) - Pass

Comments: The user 'michael' is part of that group: 

db accounts show domain-admin-group 
domain-admin-group=group
   Description=Domain Admins
   Gid=5010
   Members=admin,michael
   Uid=5010

Comments: Here is a log extract from /var/log/messages for the latest join: 

Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined) 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: NEW twt042lt$=machine 
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Creating Unix user and group  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Locking account  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: Locking password for user twt042lt$.  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: passwd: Success  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016
  • domain user password change via Ctrl-Alt-Del - Partially

Comments: Several combinations tested, incl. invalid combinations (e.g. password too short); succesfully changed; case sensitivity tested; testing was done with the following setting in place: 

db configuration show passwordstrength
passwordstrength=configuration
   Admin=none
   Ibays=none
   Users=none

Might need more testing with better password strength.

  • Workgroup server

Comments:

User/groups setup

  • create new user account - partially passed only

Comments: Although user create via server-manager looks OK, the logs indicate other problems: 

Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: OLD test101=(undefined) 
Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: NEW test101= 
... cut - all good ...
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Processing event: user-create test101 
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S04user-create-unix 
... cut - all good ... 
Aug 30 07:12:41 mdo002sv esmith::event[20906]: Locking password for user test101.  
... cut ... 
Aug 30 07:12:42 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/actions/generic_template_expand 
Aug 30 07:12:42 mdo002sv esmith::event[20906]: expanding /etc/dhcpd.conf  
... cut ...
Aug 30 07:12:45 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S25ldap-update 
Aug 30 07:12:46 mdo002sv esmith::event[20906]: failed to add entry for uid=test101,dc=ht,dc=co,dc=nz: attribute 'uid' not allowed at /etc/e-smith/events/user-create/S25ldap-update line 159.  
... cut - (ldap) issue above

Will investigate ldap issue ( bug 2859 + bug 5159 )

  • reset user password - Pass

Comments: server-manager message OK, eventlog check OK

  • lock/unlock account - Pass

Comments: both activities checked; server-manager messages OK, eventlog check OK

  • add/remove user to different groups - Pass

Comments: added user to various other groups and later removed from all of these groups

  • delete user account - Pass (partially only)

Server manager message: An error occurred while trying to delete the user but the user name is actually removed from the list of users Extract from messages log: 

Sep  6 18:09:49 mdo002sv esmith::event[2209]: Running event handler: /etc/e-smith/events/user-delete/S25ldap-delete 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 fd=11 ACCEPT from IP=127.0.0.1:55366 (IP=0.0.0.0:389) 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 BIND dn="cn=root,dc=ht,dc=co,dc=nz" method=128 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 BIND dn="cn=root,dc=ht,dc=co,dc=nz" mech=SIMPLE ssf=0 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 RESULT tag=97 err=0 text= 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=1 SRCH base="dc=ht,dc=co,dc=nz" scope=2 deref=2 filter="(uid=test101)" 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 op=1 SEARCH RESULT tag=101 err=32 nentries=0 text= 
Sep  6 18:09:50 mdo002sv slapd[3259]: conn=0 fd=11 closed (connection lost) 
Sep  6 18:09:50 mdo002sv esmith::event[2209]: Failed ldap search: No such object at /etc/e-smith/events/user-delete/S25ldap-delete line 63.

I suspect this to be related to the above ldap issue ( bugs 2859 + bug 5159 )

  • re create deleted user account - Tested but failed (assuming due to above user-delete only partially working)
  • reset user password user account - Pass

Here is an extract from one test: 

Sep  6 18:17:45 mdo002sv esmith::event[2313]: Processing event: password-modify test103 
Sep  6 18:17:45 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/actions/generic_template_expand 
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/dhcpd.conf  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/rssh.conf  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/ftpusers  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/pptpd.conf  
Sep  6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/proftpd.conf  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/options.pptpd  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/ip-up.local  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/ip-down.local  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/raddb/users  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/raddb/radiusd.conf  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/accounts.deny  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/users.allow  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/accounts.allow  
Sep  6 18:17:46 mdo002sv esmith::event[2313]: generic_template_expand=action|Event|password-modify|Action|generic_template_expand|Start|1252217865 382477|End|1252217866 894907|Elapsed|1.51243 
Sep  6 18:17:46 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/password-modify/S25count-active-user-accounts 
Sep  6 18:17:47 mdo002sv /etc/e-smith/events/password-modify/S25count-active-user-accounts[2315]: /home/e-smith/db/configuration: OLD ActiveAccounts=6 
Sep  6 18:17:47 mdo002sv /etc/e-smith/events/password-modify/S25count-active-user-accounts[2315]: /home/e-smith/db/configuration: NEW ActiveAccounts=7 
Sep  6 18:17:47 mdo002sv esmith::event[2313]: S25count-active-user-accounts=action|Event|password-modify|Action|S25count-active-user-accounts|Start|1252217866 895433|End|1252217867 40990|Elapsed|0.145557 
Sep  6 18:17:47 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/actions/adjust-services 
Sep  6 18:17:47 mdo002sv esmith::event[2313]: adjusting supervised radiusd (sigterm)  
Sep  6 18:17:47 mdo002sv esmith::event[2313]: adjusting supervised radiusd (up)  
Sep  6 18:17:47 mdo002sv esmith::event[2313]: adjust-services=action|Event|password-modify|Action|adjust-services|Start|1252217867 41580|End|1252217867 395625|Elapsed|0.354045

to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure

Ibay setup

  • create new ibay,
  • ibay access protected by password,
  • copy/delete files in ibays

to check: /var/log/messages, /var/log/httpd/admin_error_log

Email server

  • pop3(s)

Comments:

  • imap(s) - Pass

Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external

to check: /var/log/pop3(s)/current; /var/log/imap(s)/current

ClamAV

  • Clam/email integration - Pass

to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log; email headers

Comments: Server runs in a semi production state - as a home server with various email accounts for family members (static IP, registered domain name). Have done regular checks for quite some time and there is nothing unusual or unexpected in all email logs. Incl. email header checks for spam recognition and filtering.

  • regular Clam scans - Pass

enable regular scanning in server-manager and check results (email to admin)

Comments: Runs weekly without problems, emails to admin working.

DHCP server

  • test IP allocation - Pass


- for predefined MAC addresses (= 'static' IP allocation)
- for dynamic IPs

Comments: Both scenarios tested

to check: /var/log/messages

Remote access/VPN

Set a number of PPTP clients in server manager and test remote access (repeatedly)

ldap

test access from various email clients

  • Outlook,
  • Outlook Express,
  • Thunderbird - Pass

tested from LAN PCs (Windows & Ubuntu) and external (public ldap access enabled)

  • more (?)

Backup

Contribs

add individual contribs here

Retrieved from "https://wiki.koozali.org/index.php?title=SME8.0_QA&oldid=13388"