Difference between revisions of "SME8.0 QA"
m (→Console x) |
m (→Console x) |
||
Line 109: | Line 109: | ||
==Raid x== | ==Raid x== | ||
− | ==Access Server Manger | + | ==Access Server Manger== |
+ | Pass - server-manager displays and navigation works | ||
==View Support ?== | ==View Support ?== | ||
Line 115: | Line 116: | ||
see bug 1899, future - cleanup | see bug 1899, future - cleanup | ||
+ | |||
+ | can you exit the screen ? how ? | ||
==Backup to USB x== | ==Backup to USB x== |
Revision as of 11:45, 11 September 2009
Version 8.0 testing
This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.
The document should be used as Work In Progress so please feel free to add additional test scenarios and comments
and add "Pass" if you have finished a specific test so that other testers can see what still needs to be done.
All tests here should be based on the currently available version 8.0 beta 4 (09/2009). Once a next version (maybe a next beta or release candidate) is released, we plan to use this existing document as the template for that next version and might have to do most if not all of these tests again on that newer version! The more details for our procedures we document here, the easier it might be for more testers to join our efforts!
In general
- check the related logfile(s) for each test
- don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
- A list of currently reported bugs for SME 8.0 is here:
bugzilla:3640
Test guidelines
The purpose of the page is mostly to verify features are working, you can list a bug number if you like but we don't intend to duplicate the tracking provided by bugzilla:3640
Verification
Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play. :)
The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.
For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:
- log in in server-manager
- create ibay
- test for directory created (-f /home/e-smith/ibays/ibayname)
- check for account (ibayname) created
- check for group (ibayname) created
- anaylze log for errors/exceptions
but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):
- log in in server-manager
- create ibay with invalid name
- check the error in the server-manager screen
- check no account (ibayname) is created
- check no group (ibayname) is created
- check that the error is present in the log file
Header codes
Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly
header x - unchecked header ? - questions header bug - there is a bug and make sure it's in bugzilla header - blank means the section has passed
Installation x
Installation types x
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.
to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)
- RAID1 nolvm spares=2 - Pass
Comments:
- RAID1 "nolvm" - Pass
Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested
- RAID5 (with lvm) spares=0 - Pass
Comments:
- RAID5 nolvm spares=2 - Pass
Comments:
- RAID6 (with lvm) spare=1 multipart - Pass
Comments:
- RAIDx "nolvm"
Comments:
Upgrading x
Upgrade from older versions x
to check: /var/log/messages
- from 7.4
- from 7.3
- from 7.2
- from 7.1
- older 7.0
Console x
Check Status
Pass - This sever has been running for ...
Configure Server x
DHCP server
- test IP allocation - Pass
- for predefined MAC addresses (= 'static' IP allocation) - for dynamic IPs
Server-gateway
- Pass
Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN
Server-only
Comments:
Comments: Both scenarios tested
Test internet
Pass - Prompt displays, then 'The test was successful...'
Reboot x
Raid x
Access Server Manger
Pass - server-manager displays and navigation works
View Support ?
'Mitel Networks' is repeated 5 times, the dates are wrong, also their link is dead,
see bug 1899, future - cleanup
can you exit the screen ? how ?
Backup to USB x
Server Manager x
Collaboration x
Users bug
- create new user account - partially passed only
Comments: Although user create via server-manager looks OK, the logs indicate other problems:
Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: OLD test101=(undefined) Aug 30 07:12:40 mdo002sv /etc/e-smith/web/panels/manager/cgi-bin/useraccounts[20905]: /home/e-smith/db/accounts: NEW test101= ... cut - all good ... Aug 30 07:12:41 mdo002sv esmith::event[20906]: Processing event: user-create test101 Aug 30 07:12:41 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S04user-create-unix ... cut - all good ... Aug 30 07:12:41 mdo002sv esmith::event[20906]: Locking password for user test101. ... cut ... Aug 30 07:12:42 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/actions/generic_template_expand Aug 30 07:12:42 mdo002sv esmith::event[20906]: expanding /etc/dhcpd.conf ... cut ... Aug 30 07:12:45 mdo002sv esmith::event[20906]: Running event handler: /etc/e-smith/events/user-create/S25ldap-update Aug 30 07:12:46 mdo002sv esmith::event[20906]: failed to add entry for uid=test101,dc=ht,dc=co,dc=nz: attribute 'uid' not allowed at /etc/e-smith/events/user-create/S25ldap-update line 159. ... cut - (ldap) issue above
Will investigate ldap issue ( bug 2859 + bug 5159 )
- reset user password - Pass
Comments: server-manager message OK, eventlog check OK
- lock/unlock account - Pass
Comments: both activities checked; server-manager messages OK, eventlog check OK
- add/remove user to different groups - Pass
Comments: added user to various other groups and later removed from all of these groups
- delete user account - Pass (partially only)
Server manager message: An error occurred while trying to delete the user but the user name is actually removed from the list of users Extract from messages log:
Sep 6 18:09:49 mdo002sv esmith::event[2209]: Running event handler: /etc/e-smith/events/user-delete/S25ldap-delete Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 fd=11 ACCEPT from IP=127.0.0.1:55366 (IP=0.0.0.0:389) Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 BIND dn="cn=root,dc=ht,dc=co,dc=nz" method=128 Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 BIND dn="cn=root,dc=ht,dc=co,dc=nz" mech=SIMPLE ssf=0 Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 op=0 RESULT tag=97 err=0 text= Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 op=1 SRCH base="dc=ht,dc=co,dc=nz" scope=2 deref=2 filter="(uid=test101)" Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 op=1 SEARCH RESULT tag=101 err=32 nentries=0 text= Sep 6 18:09:50 mdo002sv slapd[3259]: conn=0 fd=11 closed (connection lost) Sep 6 18:09:50 mdo002sv esmith::event[2209]: Failed ldap search: No such object at /etc/e-smith/events/user-delete/S25ldap-delete line 63.
I suspect this to be related to the above ldap issue ( bugs 2859 + bug 5159 )
- re create deleted user account - Tested but failed (assuming due to above user-delete only partially working)
- reset user password user account - Pass
Here is an extract from one test:
Sep 6 18:17:45 mdo002sv esmith::event[2313]: Processing event: password-modify test103 Sep 6 18:17:45 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/actions/generic_template_expand Sep 6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/dhcpd.conf Sep 6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/rssh.conf Sep 6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/ftpusers Sep 6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/pptpd.conf Sep 6 18:17:45 mdo002sv esmith::event[2313]: expanding /etc/proftpd.conf Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/options.pptpd Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/ip-up.local Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/ppp/ip-down.local Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/raddb/users Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/raddb/radiusd.conf Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/accounts.deny Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/users.allow Sep 6 18:17:46 mdo002sv esmith::event[2313]: expanding /etc/e-smith/pam/accounts.allow Sep 6 18:17:46 mdo002sv esmith::event[2313]: generic_template_expand=action|Event|password-modify|Action|generic_template_expand|Start|1252217865 382477|End|1252217866 894907|Elapsed|1.51243 Sep 6 18:17:46 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/password-modify/S25count-active-user-accounts Sep 6 18:17:47 mdo002sv /etc/e-smith/events/password-modify/S25count-active-user-accounts[2315]: /home/e-smith/db/configuration: OLD ActiveAccounts=6 Sep 6 18:17:47 mdo002sv /etc/e-smith/events/password-modify/S25count-active-user-accounts[2315]: /home/e-smith/db/configuration: NEW ActiveAccounts=7 Sep 6 18:17:47 mdo002sv esmith::event[2313]: S25count-active-user-accounts=action|Event|password-modify|Action|S25count-active-user-accounts|Start|1252217866 895433|End|1252217867 40990|Elapsed|0.145557 Sep 6 18:17:47 mdo002sv esmith::event[2313]: Running event handler: /etc/e-smith/events/actions/adjust-services Sep 6 18:17:47 mdo002sv esmith::event[2313]: adjusting supervised radiusd (sigterm) Sep 6 18:17:47 mdo002sv esmith::event[2313]: adjusting supervised radiusd (up) Sep 6 18:17:47 mdo002sv esmith::event[2313]: adjust-services=action|Event|password-modify|Action|adjust-services|Start|1252217867 41580|End|1252217867 395625|Elapsed|0.354045
to check: /var/log/messages, /var/log/httpd/admin_error_log, /var/log/secure
Groups bug
same ldap issue as users
Quotas x
Pseudonyms x
Information Bays x
User access via file sharing x
Public access via web x
dynamic content
Administration x
Backup and restore x
Backup x
to desktop x
to tape x
to workstation x
to usb disk x
Restore x
from desktop (console) x
from tape x
from workstation x
from usb disk x
View log files x
Mail lof files x
Reboot and shutdown x
Security x
Remote access x
VPN / PPTP
Set a number of PPTP clients in server manager and test remote access (repeatedly)
Remote management x
SSH x
FTP x
Local Networks x
Port forwarding x
Proxy settings x
Mail x
Web x
Configuration x
Software Installer x
Updates x
Settings x
Date and time x
Workgroup x
Domain controller ?
- PDC - setup Primary Domain Controller - Pass
Steps:
- join PC to domain (as user 'admin') and test domain user logon on that PC - Pass
- join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin) - Pass
Comments: The user 'michael' is part of that group:
db accounts show domain-admin-group domain-admin-group=group Description=Domain Admins Gid=5010 Members=admin,michael Uid=5010
Comments: Here is a log extract from /var/log/messages for the latest join:
Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined) Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: NEW twt042lt$=machine Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Creating Unix user and group Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Locking account Aug 30 07:04:52 mdo002sv esmith::event[20711]: Locking password for user twt042lt$. Aug 30 07:04:52 mdo002sv esmith::event[20711]: passwd: Success Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016
- domain user password change via Ctrl-Alt-Del - Partially
Comments: Several combinations tested, incl. invalid combinations (e.g. password too short); successfully changed; case sensitivity tested; testing was done with the following setting in place:
db configuration show passwordstrength passwordstrength=configuration Admin=none Ibays=none Users=none
Might need more testing with better password strength.
- Workgroup server
Comments:
Roaming profiles x
Directory bug
Test access from various email clients, list client, platform, Operating system, local and or external
Printers x
Hostnames x
Domains x
Email x
Access x
Filtering x
Reception x
- pop3(s)
Comments:
- imap(s) - Pass
Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external
to check: /var/log/pop3(s)/current; /var/log/imap(s)/current
Delivery x
Antivirus
- Clam/email integration - Pass
to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log; email headers
Comments: Server runs in a semi production state - as a home server with various email accounts for family members (static IP, registered domain name). Have done regular checks for quite some time and there is nothing unusual or unexpected in all email logs. Incl. email header checks for spam recognition and filtering.
- regular Clam scans - Pass
enable regular scanning in server-manager and check results (email to admin)
Comments: Runs weekly without problems, emails to admin working.
Review x
Miscellaneous x
Support x
Starter Website x
Other x
Languages x
Displays ok, translations up-to-date
Danish x
Dutch x
Estonian x
French x
German x
Greek x
Hungarian x
Indonesian x
Italian x
Norwegian x
Portuguese x
Portuguese Brazil x
Romanian x
Russian x
Slovenian x
Spanish x
Swedish x
Contribs
Not included on this page