Difference between revisions of "SME8.0 QA"

From SME Server
Jump to navigationJump to search
 
(78 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
=Version 8.0 testing=
 
=Version 8.0 testing=
This document lists tests that we need to do to get version 8.0 closer to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.
+
This document lists tests that we need to do to get version 8.0 to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.
  
The document should be used as Work In Progress so please feel free to add additional test scenarios and comments
+
The document should be used as Work In Progress so please feel free to add additional test scenarios and comments.
  
All tests here should be based on the latest available version ''''8.0 beta 4''''. (with updates including smeupdates-testing you have a preview of a work in progress ''''8.0 beta 5'''')
+
All tests here should be based on the latest available version ''''8.0 beta 7''''. (with updates including smeupdates-testing you have a preview of a work in progress ''''8.0RC1'''')
  
In general
+
In general:
 
* check the related logfile(s) for each test
 
* check the related logfile(s) for each test
 
* don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
 
* don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
Line 29: Line 29:
 
* check for account (ibayname) created
 
* check for account (ibayname) created
 
* check for group (ibayname) created
 
* check for group (ibayname) created
* anaylze log for errors/exceptions
+
* analyze log for errors/exceptions
  
 
but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):
 
but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):
Line 41: Line 41:
  
 
==Test Schedule and Header codes==
 
==Test Schedule and Header codes==
A sample test sheet is provided below.  Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly
+
A sample test schedule is provided below.  Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly.  The test list below starts with no headers since we start afresh.  The intention is for testers to update this document to reflect their testing, thus avoiding duplication.
 
* header blank - unchecked  
 
* header blank - unchecked  
 
* header ?  - questions, or more to do
 
* header ?  - questions, or more to do
 
* header bug - there is a bug
 
* header bug - there is a bug
 
* header Pass - means the section has been tested and has passed
 
* header Pass - means the section has been tested and has passed
 +
 +
Some sample comments have been left from previous work during testing of sme7.0b4 for information since they outline useful procedures, please add your own comments as applicable.
  
 
=Installation=
 
=Installation=
  
 
==Installation types==
 
==Installation types==
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.
+
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.  Note that you need to test each scenario separately, meaning reinstalling from scratch for each test - you cannot modify a Raid configuration after a system has been installed.
  
to check: /var/log/messages; server-console, item 5; cat /proc/mdstat (which is the same as server-console, item 5;)
+
Check this for each configuration:
 +
: /var/log/messages  
 +
: server-console, item 5  
 +
: cat /proc/mdstat (which is the same as server-console, item 5;)
  
*RAID1 nolvm spares=2 - Pass
+
*RAID1 nolvm spares=2
 
Comments:
 
Comments:
*RAID1 "nolvm" - Pass
+
*RAID1 "nolvm"  
 
Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested
 
Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested
*RAID5 (with lvm) spares=0 - Pass
+
*RAID5 (with lvm) spares=0  
 
Comments:
 
Comments:
*RAID5 nolvm spares=2 - Pass
+
*RAID5 nolvm spares=2  
 
Comments:
 
Comments:
*RAID6 (with lvm) spare=1 multipart - Pass
+
*RAID6 (with lvm) spare=1 multipart  
 
Comments:
 
Comments:
 
*RAIDx "nolvm"
 
*RAIDx "nolvm"
Line 71: Line 76:
 
==Upgrade from older versions ==
 
==Upgrade from older versions ==
  
===From 7.4===
+
==CD upgrade from a clean SME7.5.1==
CD upgrade from a clean SME7.4 installation to SME8b4.
+
Installation to SME8.0RC1 cannot be tested until an ISO of SME8.0RC1 is available.
  
 
The message as below in ''/var/log/messages'' can be safely ignored, see: [[bugzilla:5486]]:
 
The message as below in ''/var/log/messages'' can be safely ignored, see: [[bugzilla:5486]]:
Line 93: Line 98:
  
 
''/root/upgrade.log'' :
 
''/root/upgrade.log'' :
* For ''db4 error(22)'': [[bugzilla:5489]]
+
* For ''db4 error(22)'': (check if it has been fixed) [[bugzilla:5489]]
 
* For ''No module mptscsi found'': [[bugzilla:5490]]
 
* For ''No module mptscsi found'': [[bugzilla:5490]]
 
* For ''PHP Warning:  PHP Startup: Unable to load dynamic library'': [[bugzilla:5491]]
 
* For ''PHP Warning:  PHP Startup: Unable to load dynamic library'': [[bugzilla:5491]]
  
===from 7.3 and lower===
+
===from 7.4.0 and lower===
 +
 
 +
If in doubt, first update to 7.5.1
 +
 
 +
==YUM upgrade from a clean SME7.5.1==
 +
* Test Yum upgrade following procedures found in http://wiki.contribs.org/SME_Server_8
 +
 
 +
===from 7.4.0 and lower===
  
If in doubt, first update to 7.4
+
If in doubt, first update to 7.5.1
  
 
=Console =
 
=Console =
  
* cosmetic bug 3561
+
* cosmetic bug 3561 (check if it has been fixed) [[bugzilla:3561]]
 
briefly displays 'Could not open pci table...'
 
briefly displays 'Could not open pci table...'
  
 
==Check Status==
 
==Check Status==
Pass - the server displays 'This sever has been running for ...'
+
* The server displays 'This sever has been running for ...'
  
 
==Configure Server==
 
==Configure Server==
  
basic configuration works, eg NIC's, password, host and domain names
+
* Basic configuration works, eg NIC's, password, host and domain names
  
 
===DHCP server===
 
===DHCP server===
*test IP allocation - Pass
+
*test IP allocation  
 
: for predefined MAC addresses (= 'static' IP allocation)
 
: for predefined MAC addresses (= 'static' IP allocation)
 
: for dynamic IPs
 
: for dynamic IPs
  
 
===Server-gateway===
 
===Server-gateway===
*Pass
+
*Check functionality
Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN
+
Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN
  
 
===Server-only===
 
===Server-only===
 +
* Check functionality
 +
:Private server & gateway
 +
:Server-only
 
Comments:
 
Comments:
 
Comments: Both scenarios tested
 
  
 
==Test internet==
 
==Test internet==
* Pass - Prompt displays, then 'The test was successful...'
+
* Prompt displays, then 'The test was successful...'
  
 
==Reboot==
 
==Reboot==
* Pass for each of  
+
* Check each of the console options:
 
: reboot
 
: reboot
: reconfigure
+
: reconfigure  
 
: shutdown
 
: shutdown
  
 
==Raid==
 
==Raid==
*pass
+
*Check each of the following:
  
console, option 5, displays correctly for single disk
+
: console, option 5, displays correctly for single disk  
  
displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]]   
+
: console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]]   
  
another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state.
+
: another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state.
  
==Access Server Manger==
+
==Access Server Manager==
* Pass - server-manager displays and navigation works
+
* server-manager displays and navigation works
  
 
==View Support==
 
==View Support==
  
*Pass, The GPL text displays
+
*The GPL text displays
  
 
==Backup to USB==
 
==Backup to USB==
console restore, pass
+
: Check each of the following:
 +
* console restore
  
console backup, pass
+
* console backup
  
=Server Manager ?=
+
=Server Manager =
  
==Collaboration ?==
+
==Collaboration ==
  
 
===Users===
 
===Users===
  
*create new user account - PASS
+
*create new user account  
*reset user password - Pass
+
*reset user password  
Comments: server-manager message OK, eventlog check OK
+
Comments: i.e. server-manager message OK, eventlog check OK
*lock/unlock account - Pass
+
*lock/unlock account
Comments: both activities checked; server-manager messages OK, eventlog check OK
+
Comments: i.e. both activities checked; server-manager messages OK, eventlog check OK
*add/remove user to different groups - Pass
+
*add/remove user to different groups
Comments: added user to various other groups and later removed from all of these groups
+
Comments: i.e. added user to various other groups and later removed from all of these groups
*delete user account - Pass
+
*delete user account  
*re create deleted user account - PASS
+
*re create deleted user account
*reset user password user account - Pass
+
*reset user password user account
  
 
===Groups===
 
===Groups===
Add, modify and remove groups - PASS
+
* Add, modify and remove groups
 +
: Comments:
  
 
===Quotas===
 
===Quotas===
* Setting quota (soft:10MB / hard: 20MB) and going over hard limit works: -PASS
+
* Setting quota (soft:10MB / hard: 20MB) and going over hard limit works:  
 
   # dd if=/dev/zero of=/mnt/user-a/user-a_21MB bs=22020096 count=1
 
   # dd if=/dev/zero of=/mnt/user-a/user-a_21MB bs=22020096 count=1
 
   1+0 records in
 
   1+0 records in
Line 184: Line 199:
 
   dd: closing output file `/mnt/user-a/user-a_21MB': No space left on device
 
   dd: closing output file `/mnt/user-a/user-a_21MB': No space left on device
  
* Setting quota (soft:20MB / hard: 40MB) and going over soft limit works: -PASS
+
* Setting quota (soft:20MB / hard: 40MB) and going over soft limit works:  
 
   To: User B <user-b@testdomain.lan>
 
   To: User B <user-b@testdomain.lan>
 
   From: "Automated quota report" <do-not-reply@testdomain.lan>
 
   From: "Automated quota report" <do-not-reply@testdomain.lan>
Line 197: Line 212:
 
===Pseudonyms===
 
===Pseudonyms===
  
* Pass
+
* Test the following:
  
:created a pseudonym jane to sent to usera
+
:created a pseudonym jane to sent to usera  
 
:created a pseudonym jane@test.org to userb
 
:created a pseudonym jane@test.org to userb
 
   
 
   
sent mail to both which was received as expected
+
: Comment: i.e. sent mail to both which was received as expected
  
===Information Bays x===
+
===Information Bays===
  
 
====User access via file sharing ====
 
====User access via file sharing ====
  
basic smb file access working as expected. Permissions checked (smb) with several groups, users and all permission-combinations
+
* basic smb file access working as expected
 +
* Permissions checked (smb) with several groups, users and all permission-combinations
  
====Public access via web ?====
+
====Public access via web====
  
* Primary website access tested form public Internet. If not configured, the default (".. under construction ..") works.
+
* Primary website access tested form public Internet. If not configured, the default (".. under construction ..") works
* Ibay accessible for http(s) from outside network without password - PASS
+
* Ibay accessible for http(s) from outside network without password
* Ibay accessible for http(s) from outside network with a password -NEEDS TESTING
+
* Ibay accessible for http(s) from outside network with a password
* Ibay accessible for http(s) from local network without password and outside network with a pass -NEEDS TESTING
+
* Ibay accessible for http(s) from local network without password and outside network with a password
  
 
====Local access via web====
 
====Local access via web====
* Primary website accessible for http(s) from the local network -PASS
+
* Primary website accessible for http(s) from the local network  
  
* Ibay not accessible for http(s) from local network when set to 'No Access' -PASS
+
* Ibay not accessible for http(s) from local network when set to 'No Access'  
* Ibay accessible for http(s) from local network without password -PASS
+
* Ibay accessible for http(s) from local network without password
* Ibay accessible for http(s) from local network with a password -PASS
+
* Ibay accessible for http(s) from local network with a password  
  
  
''/var/log/httpd/error_log'' ([http://bugs.contribs.org/show_bug.cgi?id=5492 Bug #5492]):
+
''/var/log/httpd/error_log'' ([http://bugs.contribs.org/show_bug.cgi?id=5492 Bug #5492]): (still existing?)
 
   [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
 
   [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
 
   [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!?
 
   [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!?
  
====Public access via ftp -x====
+
====Public access via ftp==
 +
* check functionality as applicable
 +
:Comment:
  
 
====Local access via ftp====
 
====Local access via ftp====
* Primary & ibay not accessible when ftp set to 'No Access' -PASS
+
* Primary & ibay not accessible when ftp set to 'No Access'  
* Primary ibay accessible anonymous for download, not upload -PASS
+
* Primary ibay accessible anonymous for download, not upload  
* Ibay (no password required) accessible anonymous without password for download, not upload -PASS
+
* Ibay (no password required) accessible anonymous without password for download, not upload  
* Ibay (password required) accessible anonymous only with password for download, not upload -PASS
+
* Ibay (password required) accessible anonymous only with password for download, not upload  
  
* User homedir accessible with username+pass for download and upload -PASS
+
* User homedir accessible with username+pass for download and upload  
* Ibay accessible with username+pass for download and upload (with ibay permissions correctly set) -PASS
+
* Ibay accessible with username+pass for download and upload (with ibay permissions correctly set)  
* Ibay accessible with username+pass for download and not upload (with ibay permissions correctly set) -PASS
+
* Ibay accessible with username+pass for download and not upload (with ibay permissions correctly set)  
* Ibay not accessible with username+pass (with ibay permissions correctly set) -PASS
+
* Ibay not accessible with username+pass (with ibay permissions correctly set)
  
====Dynamic content ?====
+
====Dynamic content====
* PHP scripts in Primary ibay are interpreted and displayed -PASS
+
* PHP scripts in Primary ibay are interpreted and displayed
* PHP scripts in ibay are/not interpreted and displayed when dynamic content is enabled/disabled -PASS
+
* PHP scripts in ibay are/not interpreted and displayed when dynamic content is enabled/disabled
  
* CGI scripts (cgi-bin) -NEEDS TESTING
+
* CGI scripts (cgi-bin)
  
==Administration x==
+
==Administration==
  
 
===Backup and restore ===
 
===Backup and restore ===
Line 256: Line 274:
 
=====to desktop=====
 
=====to desktop=====
  
a server with a small amount of data created a smeserver.tgz correctly
+
Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly
  
=====to tape x=====
+
=====to tape=====
  
TO DO
+
Comment:
  
 
=====to workstation=====
 
=====to workstation=====
  
* pass - tested a set of three to a cifs share
+
Comment: i.e. tested a set of three to a cifs share
  
 
=====to usb disk =====
 
=====to usb disk =====
pass
 
  
 +
Comment:
 
====Restore ====
 
====Restore ====
pass
 
  
 +
Comment:
 
=====from desktop=====
 
=====from desktop=====
Restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass
+
Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass
 +
 
 +
=====from tape=====
  
=====from tape x=====
+
Comment:
  
TO DO
 
 
=====from workstation=====
 
=====from workstation=====
  
* pass - tested a set of three to a cifs share, with verification
+
Comment: i.e. tested a set of three to a cifs share, with verification
  
 
=====from usb disk =====
 
=====from usb disk =====
  
pass
+
Comment:
 
 
 
===View log files===
 
===View log files===
  
view log files works, including filtering and highlighting
+
* view log files works, including filtering and highlighting
  
download logfile works
+
* download logfile works
  
 
===Mail log files===
 
===Mail log files===
  
local mail delivery is reported  
+
* local mail delivery is reported  
  
external mail delivery is tested (ongoing use for a 'production' home server) and email logs are OK
+
* external mail delivery is tested (ongoing use for a 'production' home server) and email logs are OK
  
 
===Reboot and shutdown===
 
===Reboot and shutdown===
* Pass for each of  
+
* Test from server-manager for each of:
 
:reboot  
 
:reboot  
 
:reconfigure  
 
:reconfigure  
 
:shutdown
 
:shutdown
  
==Security x==
+
==Security==
  
 
===Remote access===
 
===Remote access===
  
 
====VPN / PPTP ====
 
====VPN / PPTP ====
* Pass
+
* Check functionality
 
:Set a number of PPTP clients in server manager and test remote access (repeatedly)
 
:Set a number of PPTP clients in server manager and test remote access (repeatedly)
  
Line 315: Line 333:
  
 
====SSH====
 
====SSH====
*Pass - remote access from local network on port other than 22
+
Check the following:
*External user/password access denied (port 22 and other) when set to 'No access' or 'Local network' --PASS
+
*remote access from local network on port other than 22
*External user/password access allowed (port 22 and other) when set to 'Entire internet' --PASS
+
*External user/password access denied (port 22 and other) when set to 'No access' or 'Local network'  
*External user/password access denied (port 22 and other) for root when 'allow administrative commandline' to 'No' --PASS
+
*External user/password access allowed (port 22 and other) when set to 'Entire internet'  
*External user/password access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' --PASS
+
*External user/password access denied (port 22 and other) for root when 'allow administrative commandline' to 'No'  
*External user/password access denied (port 22 and other) when 'allow standard password' set to 'No' -PASS
+
*External user/password access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No'  
*External certificate access denied (port 22 and other) for root when 'administrative commandline' to 'No' and 'allow standard password' set to 'No' -PASS
+
*External user/password access denied (port 22 and other) when 'allow standard password' set to 'No'  
*External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' -PASS
+
*External certificate access denied (port 22 and other) for root when 'administrative commandline' to 'No' and 'allow standard password' set to 'No'  
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No' -PASS
+
*External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'  
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' -PASS
+
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No'
 +
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'  
  
 
====FTP====
 
====FTP====
* Ftp access allowed for Primary, ibays and users when access set to 'Allowe access ...' -PASS
+
* Ftp access allowed for Primary, ibays and users when access set to 'Allowe access ...'  
* Ftp access refused for Primary, ibays and users when access set to 'No Access' -PASS
+
* Ftp access refused for Primary, ibays and users when access set to 'No Access'  
  
===Local Networks x===
+
===Local Networks===
 +
Comment:
  
 
===Port forwarding===
 
===Port forwarding===
 +
Check the following scenarios:
  
server gateway - PASS
+
* server gateway
  
Tested successfully with port 3389 (RDP) to WIndows terminal server on LAN
+
Comment: i.e. tested successfully with port 3389 (RDP) to WIndows terminal server on LAN
  
server only - pass
+
* server only
  
"This server is currently in serveronly mode and portforwarding is not possible."
+
Comment: i.e."This server is currently in server-only mode and port forwarding is not possible."
  
 
===Proxy settings===
 
===Proxy settings===
Line 346: Line 367:
 
====Mail====
 
====Mail====
  
*Smtp proxy enabled - PASS
+
*Smtp proxy enabled  
Test with Thunderbird client - Email delivery works and the headers clearly show that the local smtp server has been used for the delivery rather the smtp that was setup in the email client   
+
Comment: i.e. Test with Thunderbird client - Email delivery works and the headers clearly show that the local smtp server has been used for the delivery rather the smtp that was setup in the email client   
  
*Smtp proxy disabled - PASS
+
*Smtp proxy disabled
Follow up test to above with the same Thunderbird configuration - this time the intended, external smtp server has been used for the delivery and NOT the local smtp server.
+
Comment: i.e. Follow up test to above with the same Thunderbird configuration - this time the intended, external smtp server has been used for the delivery and NOT the local smtp server.
 +
 
 +
*Smtp proxy blocked (recently implemented)
 +
Comment:
  
 
====Web====
 
====Web====
 +
Check the following:
 +
* net access via the squid proxy works
  
net access via the squid proxy works
+
* net access is disabled via squid proxy if disabled
 
 
net access is disabled via squid proxy if disabled
 
  
 
==Configuration ==
 
==Configuration ==
Line 364: Line 388:
 
====Updates====
 
====Updates====
  
updates via the panel work
+
* updates via the panel work
  
the updates available warning displays
+
* the updates available warning displays
  
 
====Settings====
 
====Settings====
  
Settings can be changed
+
* Settings can be changed
  
Installing additional software works
+
* Installing additional software works  
 +
: Examples:
  
 
  Installing:
 
  Installing:
Line 388: Line 413:
 
'Set Date and Time' manually works
 
'Set Date and Time' manually works
  
'Configure Network Time Server' works, if you enter a valid time server
+
'Configure Network Time Server' works if you enter a valid time server
  
 
===Workgroup ===
 
===Workgroup ===
Line 395: Line 420:
 
Now also working for windows 7 PC's
 
Now also working for windows 7 PC's
  
*PDC - setup Primary Domain Controller - Pass
+
*PDC - setup Primary Domain Controller  
Steps:  
+
Suggested steps:  
* join PC to domain (as user 'admin') and test domain user logon on that PC - Pass
+
* join PC to domain (as user 'admin') and test domain user logon on that PC
* join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin) - Pass
+
* join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin)
 
Comments: The user 'michael' is part of that group:
 
Comments: The user 'michael' is part of that group:
 
  db accounts show domain-admin-group  
 
  db accounts show domain-admin-group  
Line 407: Line 432:
 
     Uid=5010
 
     Uid=5010
 
   
 
   
Comments: Here is a log extract from /var/log/messages for the latest join:
+
Comments: i.e. log extract from /var/log/messages for the latest join:
 
  Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account  
 
  Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account  
 
  Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined)  
 
  Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined)  
Line 417: Line 442:
 
  Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016  
 
  Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016  
  
* domain user password change via Ctrl-Alt-Del - Partially
+
* domain user password change via Ctrl-Alt-Del  
Comments: Several combinations tested, incl. invalid combinations (e.g. password too short); successfully changed; case sensitivity tested; testing was done with the following setting in place:
+
Comments: i.e. several combinations tested, incl. invalid combinations (e.g. password too short); successfully changed; case sensitivity tested; testing was done with the following setting in place:
 
  db configuration show passwordstrength
 
  db configuration show passwordstrength
 
  passwordstrength=configuration
 
  passwordstrength=configuration
Line 428: Line 453:
  
 
====Workgroup server ====
 
====Workgroup server ====
Connect to samba share, pass
+
* Connect to samba share
  
 +
====Roaming profiles====
  
====Roaming profiles====
+
* Test with WinXP Pro AND Win7 Pro clients
  
Tested successfully with WinXP Pro AND Win7 clients - PASS
+
Comments:
  
 
===Directory===
 
===Directory===
 +
Check the following:
 +
* Directory (LDAP) access
  
Directory (LDAP) access - PASS
+
*Test access from various email clients, list client, platform, Operating system, local and or external:
  
Test access from various email clients, list client, platform, Operating system, local and or external
+
In example:
 
+
: Webmail (list address book contents via string like "mich" shows all Michael(s))
-  webmail (list address book contents via string like "mich" shows all Michael(s)) - PASS
+
: Thunderbird LDAP test on local network
- Thunderbird LDAP test on local network - PASS
 
  
 
===Printers ===
 
===Printers ===
 
Attached/created LTP,USB and network printer; Printing test page:
 
Attached/created LTP,USB and network printer; Printing test page:
* USB printer -PASS
+
* USB printer  
* LTP printer -PASS
+
* LTP printer
* Network printer -PASS
+
* Network printer
  
 
===Hostnames===
 
===Hostnames===
Line 459: Line 486:
 
(tested with several other hosts)
 
(tested with several other hosts)
  
===Domains ?===
+
===Domains===
  
2nd domain added, web and email works
+
* 2nd domain added, web and email works
  
DNS options to be tested
+
* Test all DNS options
  
===Email ?===
+
===Email===
  
====Access ?====
+
====Access====
 +
Test functionality for the following:
 +
*webmail
  
*webmail works
+
*pop3(s)  
 
 
*pop3(s)
 
 
Comments:
 
Comments:
  
*imap(s) - Pass
+
*imap(s)  
Comments: Intensive, ongoing testing with imap & imaps access from LAN PCs and external
+
Comments: i.e. Intensive, ongoing testing with imap & imaps access from LAN PCs and external
  
to check: /var/log/pop3(s)/current; /var/log/imap(s)/current
+
* check: /var/log/pop3(s)/current
 +
* check: /var/log/imap(s)/current
  
====Filtering x====
+
====Filtering====
  
====Reception x====
+
====Reception====
  
====Delivery x====
+
====Delivery====
  
 
===Antivirus ===
 
===Antivirus ===
*Clam/email integration - Pass
+
Clam/email integration
 
 
to check: /var/log/qmail/current; /var/log/spamd/current; /var/log/qpsmtpd/current; /var/log/clamd/current; /var/log/clamd/smeserver-clamscan.log; email headers
 
  
Comments: Server runs in a semi production state - as a home server with various email accounts for family members (static IP, registered domain name). Have done regular checks for quite some time and there is nothing unusual or unexpected in all email logs. Incl. email header checks for spam recognition and filtering.
+
* Check: /var/log/qmail/current
 +
* Check: /var/log/spamd/current
 +
* Check: /var/log/qpsmtpd/current
 +
* Check: /var/log/clamd/current
 +
* Check: /var/log/clamd/smeserver-clamscan.log
 +
* Check: email headers
  
*regular Clam scans - Pass
+
Comments: i.e. Server runs in a semi production state - as a home server with various email accounts for family members (static IP, registered domain name). Have done regular checks for quite some time and there is nothing unusual or unexpected in all email logs. Incl. email header checks for spam recognition and filtering.
enable regular scanning in server-manager and check results (email to admin)
 
  
Comments: Runs weekly without problems, emails to admin working.
+
* Check regular Clam scans
 +
* Enable regular scanning in server-manager and check results (email to admin)
  
 +
Comments: i.e. Runs weekly without problems, emails to admin working.
  
 
===Review===
 
===Review===

Latest revision as of 04:24, 12 April 2012

Version 8.0 testing

This document lists tests that we need to do to get version 8.0 to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.

The document should be used as Work In Progress so please feel free to add additional test scenarios and comments.

All tests here should be based on the latest available version '8.0 beta 7'. (with updates including smeupdates-testing you have a preview of a work in progress '8.0RC1')

In general:

  • check the related logfile(s) for each test
  • don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
  • A list of currently reported bugs for SME 8.0 is here: bugzilla matrix

Test guidelines

The purpose of the page is mostly to verify features are working, you can list a bug number if you like but we don't intend to duplicate the tracking provided by bugzilla:

Executive Summary

In general everything works as well as in SME 7, if not better.

Verification

Create a test environment, either virtually or with spare hardware. Install the latest release, add some test users/ibays/domains/websites, send some internal e-mails, copy some files to/from ibays, perform a backup and restore. Perform as many functions that you can based on your knowledge and test environment abilities. Play and have fun :)

The scenario's should be as complex as needed, but also as simple as possible, testing one unique feature where possible.

For instance creating an ibay could mean something like this, perhaps even incomplete as I am doing this from the top of my head:

  • log in in server-manager
  • create ibay
  • test for directory created (-f /home/e-smith/ibays/ibayname)
  • check for account (ibayname) created
  • check for group (ibayname) created
  • analyze log for errors/exceptions

but also (and that is the most work mostly) test exceptions (names too long, starting with a number, containing a _, as well as all other exceptions):

  • log in in server-manager
  • create ibay with invalid name
  • check the error in the server-manager screen
  • check no account (ibayname) is created
  • check no group (ibayname) is created
  • check that the error is present in the log file

Test Schedule and Header codes

A sample test schedule is provided below. Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly. The test list below starts with no headers since we start afresh. The intention is for testers to update this document to reflect their testing, thus avoiding duplication.

  • header blank - unchecked
  • header ? - questions, or more to do
  • header bug - there is a bug
  • header Pass - means the section has been tested and has passed

Some sample comments have been left from previous work during testing of sme7.0b4 for information since they outline useful procedures, please add your own comments as applicable.

Installation

Installation types

Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc. Note that you need to test each scenario separately, meaning reinstalling from scratch for each test - you cannot modify a Raid configuration after a system has been installed.

Check this for each configuration:

/var/log/messages
server-console, item 5
cat /proc/mdstat (which is the same as server-console, item 5;)
  • RAID1 nolvm spares=2

Comments:

  • RAID1 "nolvm"

Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested

  • RAID5 (with lvm) spares=0

Comments:

  • RAID5 nolvm spares=2

Comments:

  • RAID6 (with lvm) spare=1 multipart

Comments:

  • RAIDx "nolvm"

Comments:

Upgrading

Upgrade from older versions

CD upgrade from a clean SME7.5.1

Installation to SME8.0RC1 cannot be tested until an ISO of SME8.0RC1 is available.

The message as below in /var/log/messages can be safely ignored, see: bugzilla:5486:

 Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 75: Duplicate column name 'File_priv'
 Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 81: Duplicate column name 'Grant_priv'
 Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 82: Duplicate column name 'Grant_priv'
 Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 83: Duplicate column name 'Grant_priv'
 Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 94: Duplicate column name 'ssl_type'
 Sep 24 00:22:18 sme74clean mysql.init: ERROR 1061 (42000) at line 105: Duplicate key name 'Grantor'
 Sep 24 00:22:19 sme74clean mysql.init: ERROR 1054 (42S22) at line 131: Unknown column 'Type' in 'columns_priv'
 Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 153: Duplicate column name 'type'
 Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 163: Duplicate column name 'Show_db_priv'
 Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 180: Duplicate column name 'max_questions'
 Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 190: Duplicate column name 'Create_tmp_table_priv'
 Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 193: Duplicate column name 'Create_tmp_table_priv'
 Sep 24 00:22:20 sme74clean mysql.init: ERROR 1054 (42S22) at line 282: Unknown column 'Create_view_priv' in 'where clause'
 Sep 24 00:22:22 sme74clean mysql.init: ERROR 1054 (42S22) at line 317: Unknown column 'Create_routine_priv' in 'where clause'
 Sep 24 00:22:24 sme74clean mysql.init: ERROR 1054 (42S22) at line 366: Unknown column 'Create_user_priv' in 'where clause'
 Sep 24 00:22:25 sme74clean mysql.init: ERROR 1060 (42S21) at line 386: Duplicate column name 'Routine_type'

/root/upgrade.log :

from 7.4.0 and lower

If in doubt, first update to 7.5.1

YUM upgrade from a clean SME7.5.1

from 7.4.0 and lower

If in doubt, first update to 7.5.1

Console

briefly displays 'Could not open pci table...'

Check Status

  • The server displays 'This sever has been running for ...'

Configure Server

  • Basic configuration works, eg NIC's, password, host and domain names

DHCP server

  • test IP allocation
for predefined MAC addresses (= 'static' IP allocation)
for dynamic IPs

Server-gateway

  • Check functionality

Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN

Server-only

  • Check functionality
Private server & gateway
Server-only

Comments:

Test internet

  • Prompt displays, then 'The test was successful...'

Reboot

  • Check each of the console options:
reboot
reconfigure
shutdown

Raid

  • Check each of the following:
console, option 5, displays correctly for single disk
console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under SME8.0_QA#Installation_types
another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state.

Access Server Manager

  • server-manager displays and navigation works

View Support

  • The GPL text displays

Backup to USB

Check each of the following:
  • console restore
  • console backup

Server Manager

Collaboration

Users

  • create new user account
  • reset user password

Comments: i.e. server-manager message OK, eventlog check OK

  • lock/unlock account

Comments: i.e. both activities checked; server-manager messages OK, eventlog check OK

  • add/remove user to different groups

Comments: i.e. added user to various other groups and later removed from all of these groups

  • delete user account
  • re create deleted user account
  • reset user password user account

Groups

  • Add, modify and remove groups
Comments:

Quotas

  • Setting quota (soft:10MB / hard: 20MB) and going over hard limit works:
 # dd if=/dev/zero of=/mnt/user-a/user-a_21MB bs=22020096 count=1
 1+0 records in
 1+0 records out
 dd: closing output file `/mnt/user-a/user-a_21MB': No space left on device
  • Setting quota (soft:20MB / hard: 40MB) and going over soft limit works:
 To: User B <user-b@testdomain.lan>
 From: "Automated quota report" <do-not-reply@testdomain.lan>
 Subject: You have exceeded your disk quota
 
 Your current disk usage: 21.08 Mb
 Your maximum usage: 40.00 Mb
 Warnings start at: 20.00 Mb
 Grace period ends: Fri Oct  2 09:06:22 2009
 System name: sme8b4clean

Pseudonyms

  • Test the following:
created a pseudonym jane to sent to usera
created a pseudonym jane@test.org to userb
Comment: i.e. sent mail to both which was received as expected

Information Bays

User access via file sharing

  • basic smb file access working as expected
  • Permissions checked (smb) with several groups, users and all permission-combinations

Public access via web

  • Primary website access tested form public Internet. If not configured, the default (".. under construction ..") works
  • Ibay accessible for http(s) from outside network without password
  • Ibay accessible for http(s) from outside network with a password
  • Ibay accessible for http(s) from local network without password and outside network with a password

Local access via web

  • Primary website accessible for http(s) from the local network
  • Ibay not accessible for http(s) from local network when set to 'No Access'
  • Ibay accessible for http(s) from local network without password
  • Ibay accessible for http(s) from local network with a password


/var/log/httpd/error_log (Bug #5492): (still existing?)

 [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
 [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!?

==Public access via ftp

  • check functionality as applicable
Comment:

Local access via ftp

  • Primary & ibay not accessible when ftp set to 'No Access'
  • Primary ibay accessible anonymous for download, not upload
  • Ibay (no password required) accessible anonymous without password for download, not upload
  • Ibay (password required) accessible anonymous only with password for download, not upload
  • User homedir accessible with username+pass for download and upload
  • Ibay accessible with username+pass for download and upload (with ibay permissions correctly set)
  • Ibay accessible with username+pass for download and not upload (with ibay permissions correctly set)
  • Ibay not accessible with username+pass (with ibay permissions correctly set)

Dynamic content

  • PHP scripts in Primary ibay are interpreted and displayed
  • PHP scripts in ibay are/not interpreted and displayed when dynamic content is enabled/disabled
  • CGI scripts (cgi-bin)

Administration

Backup and restore

Backup

to desktop

Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly

to tape

Comment:

to workstation

Comment: i.e. tested a set of three to a cifs share

to usb disk

Comment:

Restore

Comment:

from desktop

Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass

from tape

Comment:

from workstation

Comment: i.e. tested a set of three to a cifs share, with verification

from usb disk

Comment:

View log files

  • view log files works, including filtering and highlighting
  • download logfile works

Mail log files

  • local mail delivery is reported
  • external mail delivery is tested (ongoing use for a 'production' home server) and email logs are OK

Reboot and shutdown

  • Test from server-manager for each of:
reboot
reconfigure
shutdown

Security

Remote access

VPN / PPTP

  • Check functionality
Set a number of PPTP clients in server manager and test remote access (repeatedly)

Remote management

SSH

Check the following:

  • remote access from local network on port other than 22
  • External user/password access denied (port 22 and other) when set to 'No access' or 'Local network'
  • External user/password access allowed (port 22 and other) when set to 'Entire internet'
  • External user/password access denied (port 22 and other) for root when 'allow administrative commandline' to 'No'
  • External user/password access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No'
  • External user/password access denied (port 22 and other) when 'allow standard password' set to 'No'
  • External certificate access denied (port 22 and other) for root when 'administrative commandline' to 'No' and 'allow standard password' set to 'No'
  • External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'
  • External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No'
  • External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'

FTP

  • Ftp access allowed for Primary, ibays and users when access set to 'Allowe access ...'
  • Ftp access refused for Primary, ibays and users when access set to 'No Access'

Local Networks

Comment:

Port forwarding

Check the following scenarios:

  • server gateway

Comment: i.e. tested successfully with port 3389 (RDP) to WIndows terminal server on LAN

  • server only

Comment: i.e."This server is currently in server-only mode and port forwarding is not possible."

Proxy settings

Mail

  • Smtp proxy enabled

Comment: i.e. Test with Thunderbird client - Email delivery works and the headers clearly show that the local smtp server has been used for the delivery rather the smtp that was setup in the email client

  • Smtp proxy disabled

Comment: i.e. Follow up test to above with the same Thunderbird configuration - this time the intended, external smtp server has been used for the delivery and NOT the local smtp server.

  • Smtp proxy blocked (recently implemented)

Comment:

Web

Check the following:

  • net access via the squid proxy works
  • net access is disabled via squid proxy if disabled

Configuration

Software Installer

Updates

  • updates via the panel work
  • the updates available warning displays

Settings

  • Settings can be changed
  • Installing additional software works
Examples:
Installing:
 wvdial               i386         1.54.0-5.2.2.1            base         131 k
Installing for dependencies:
 libwvstreams         i386         4.2.2-2.1                 base         657 k

and Removing

Removing:
 wvdial          i386          1.54.0-5.2.2.1          installed          264 k

Date and time

'Set Date and Time' manually works

'Configure Network Time Server' works if you enter a valid time server

Workgroup

Domain controller

Now also working for windows 7 PC's

  • PDC - setup Primary Domain Controller

Suggested steps:

  • join PC to domain (as user 'admin') and test domain user logon on that PC
  • join (another) PC to domain (as a different user from group 'Domain Admins', NOT user admin)

Comments: The user 'michael' is part of that group:

db accounts show domain-admin-group 
domain-admin-group=group
   Description=Domain Admins
   Gid=5010
   Members=admin,michael
   Uid=5010

Comments: i.e. log extract from /var/log/messages for the latest join:

Aug 30 07:04:52 mdo002sv esmith::event[20711]: Running event handler: /etc/e-smith/events/machine-account-create/S10create-machine-account 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: OLD twt042lt$ (undefined) 
Aug 30 07:04:52 mdo002sv /etc/e-smith/events/machine-account-create/S10create-machine-account[20712]: /home/e-smith/db/accounts: NEW twt042lt$=machine 
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Creating Unix user and group  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: create-machine-account twt042lt$: Locking account  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: Locking password for user twt042lt$.  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: passwd: Success  
Aug 30 07:04:52 mdo002sv esmith::event[20711]: S10create-machine-account=action|Event|machine-account-create|Action|S10create-machine-account|Start|1251572692 236608|End|1251572692 708624|Elapsed|0.472016 
  • domain user password change via Ctrl-Alt-Del

Comments: i.e. several combinations tested, incl. invalid combinations (e.g. password too short); successfully changed; case sensitivity tested; testing was done with the following setting in place:

db configuration show passwordstrength
passwordstrength=configuration
   Admin=none
   Ibays=none
   Users=none

Might need more testing with better password strength.

Workgroup server

  • Connect to samba share

Roaming profiles

  • Test with WinXP Pro AND Win7 Pro clients

Comments:

Directory

Check the following:

  • Directory (LDAP) access
  • Test access from various email clients, list client, platform, Operating system, local and or external:

In example:

Webmail (list address book contents via string like "mich" shows all Michael(s))
Thunderbird LDAP test on local network

Printers

Attached/created LTP,USB and network printer; Printing test page:

  • USB printer
  • LTP printer
  • Network printer

Hostnames

set a hostname to a remote server works

set a hostname to self works

set hostname for other host on the local network - passed (tested with several other hosts)

Domains

  • 2nd domain added, web and email works
  • Test all DNS options

Email

Access

Test functionality for the following:

  • webmail
  • pop3(s)

Comments:

  • imap(s)

Comments: i.e. Intensive, ongoing testing with imap & imaps access from LAN PCs and external

  • check: /var/log/pop3(s)/current
  • check: /var/log/imap(s)/current

Filtering

Reception

Delivery

Antivirus

Clam/email integration

  • Check: /var/log/qmail/current
  • Check: /var/log/spamd/current
  • Check: /var/log/qpsmtpd/current
  • Check: /var/log/clamd/current
  • Check: /var/log/clamd/smeserver-clamscan.log
  • Check: email headers

Comments: i.e. Server runs in a semi production state - as a home server with various email accounts for family members (static IP, registered domain name). Have done regular checks for quite some time and there is nothing unusual or unexpected in all email logs. Incl. email header checks for spam recognition and filtering.

  • Check regular Clam scans
  • Enable regular scanning in server-manager and check results (email to admin)

Comments: i.e. Runs weekly without problems, emails to admin working.

Review

Basic server information is displayed

Miscellaneous

Support

The GPL text is displayed

Starter Website

Site created after entering text as prompted