Changes

Jump to navigation Jump to search
1,990 bytes added ,  09:18, 10 December 2015
m
Version info only
Line 1: Line 1: −
=Version 9.0 testing=
+
=Version 9.# testing=
This document lists tests that we need to do to get version 9.0 to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.
+
This document lists tests that we need to do to get version 9.# to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work.
    
The document should be used as Work In Progress so please feel free to add additional test scenarios and comments.
 
The document should be used as Work In Progress so please feel free to add additional test scenarios and comments.
   −
All tests here should be based on the latest available version ''''9.0 Alpha X''''. with updates including smeupdates-testing you have a preview of a work in progress  
+
All tests here should be based on the latest available version ''''9.# Beta X''''. with updates including smeupdates-testing you have a preview of a work in progress  
    
In general:
 
In general:
 
* check the related logfile(s) for each test
 
* check the related logfile(s) for each test
 
* don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
 
* don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported
* A list of currently reported bugs for SME Server 9.0 is here: [http://bugs.contribs.org/report.cgi?x_axis_field=bug_status&y_axis_field=target_milestone&product=SME+Server+9.X&format=table&action=wrap]
+
* A list of currently reported bugs for SME Server 9.# is here: [http://bugs.contribs.org/report.cgi?x_axis_field=bug_status&y_axis_field=target_milestone&product=SME+Server+9.X&format=table&action=wrap]
    
==Test guidelines==
 
==Test guidelines==
Line 15: Line 15:     
==Executive Summary==
 
==Executive Summary==
There has not been enough testing to indicate how well SME Server 9.0 is working.
+
There has not been enough testing to indicate how well SME Server 9.# is working.
    
==Verification==
 
==Verification==
Line 42: Line 42:  
==Test Schedule and Header codes==
 
==Test Schedule and Header codes==
 
A sample test schedule is provided below.  Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly.  The test list below starts with no headers since we start afresh.  The intention is for testers to update this document to reflect their testing, thus avoiding duplication.  
 
A sample test schedule is provided below.  Check one feature at a time and add comments. We will use a shorthand in the header line so we can check progress quickly.  The test list below starts with no headers since we start afresh.  The intention is for testers to update this document to reflect their testing, thus avoiding duplication.  
* header blank - unchecked  
+
* header blank = no header - unchecked  
* header ?  - questions, or more to do
+
* header ?  - questions, or more to do [please provide your name for follow-up]
* header bug - there is a bug
+
* header BUG - there is a bug - provide Bug reference number, i.e [Bug xxxx]
* header Pass - means the section has been tested and has passed
+
* header PASS - means the section has been tested and has passed [please provide your name for follow-up]
    
Some sample comments have been left from testing previous SME Server versions for information since they outline useful procedures, please add your own comments as applicable.
 
Some sample comments have been left from testing previous SME Server versions for information since they outline useful procedures, please add your own comments as applicable.
Line 52: Line 52:     
==Installation types==
 
==Installation types==
 +
 +
{| style="color:red;background-color:#ffffcc;"
 +
|
 +
WARNING!!!  There are no cmdline options that are supported yet (for SME 9), refer [[Bugzilla:7529#c6]]. 
 +
|}
 +
 
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.  Note that you need to test each scenario separately, meaning reinstalling from scratch for each test - you cannot modify a Raid configuration after a system has been installed.
 
Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc.  Note that you need to test each scenario separately, meaning reinstalling from scratch for each test - you cannot modify a Raid configuration after a system has been installed.
   Line 59: Line 65:  
: cat /proc/mdstat (which is the same as server-console, item 5;)
 
: cat /proc/mdstat (which is the same as server-console, item 5;)
    +
*RAID1 nodmraid
 +
Comment: the option "nodmraid" seems to work (dz00te)
 +
*RAID1 raid=1
 +
Comments: the raid=1 options doesn't force the raid1. see [[bugzilla:7529]]
 
*RAID1 nolvm spares=2
 
*RAID1 nolvm spares=2
 
Comments:
 
Comments:
*RAID1 "nolvm"
+
*RAID1 nolvm  
Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested
+
Comments: Installation was RAID1, nolvm with one physical disk only; adding second disk still to be tested.  BUG [check Bug #7528]
 
*RAID5 (with lvm) spares=0  
 
*RAID5 (with lvm) spares=0  
 
Comments:
 
Comments:
Line 72: Line 82:  
Comments:
 
Comments:
   −
=Upgrading N/A for now=
+
=Upgrading=
At the moment in-place upgrades are not supported, although there is an effort to make this work somehow.
+
In-place upgrades are not supported from SME8.#. It is necessary to backup and then restore.
For now it is necessary to take a backup, make a fresh install, and then restore the backup.
+
/boot partition is always RAID 1.
 +
 
 +
In-place upgrades to SME 9.1" *are* supported - from 9.0 only.
    
==Upgrade from older versions ==
 
==Upgrade from older versions ==
 
+
In-place upgrades to SME 9.1" *are* supported - from 9.0 only.
==CD upgrade from a clean SME7.5.1==
  −
Installation to SME8.0RC1 cannot be tested until an ISO of SME8.0RC1 is available.
  −
 
  −
The message as below in ''/var/log/messages'' can be safely ignored, see: [[bugzilla:5486]]:
  −
  Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 75: Duplicate column name 'File_priv'
  −
  Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 81: Duplicate column name 'Grant_priv'
  −
  Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 82: Duplicate column name 'Grant_priv'
  −
  Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 83: Duplicate column name 'Grant_priv'
  −
  Sep 24 00:22:18 sme74clean mysql.init: ERROR 1060 (42S21) at line 94: Duplicate column name 'ssl_type'
  −
  Sep 24 00:22:18 sme74clean mysql.init: ERROR 1061 (42000) at line 105: Duplicate key name 'Grantor'
  −
  Sep 24 00:22:19 sme74clean mysql.init: ERROR 1054 (42S22) at line 131: Unknown column 'Type' in 'columns_priv'
  −
  Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 153: Duplicate column name 'type'
  −
  Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 163: Duplicate column name 'Show_db_priv'
  −
  Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 180: Duplicate column name 'max_questions'
  −
  Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 190: Duplicate column name 'Create_tmp_table_priv'
  −
  Sep 24 00:22:19 sme74clean mysql.init: ERROR 1060 (42S21) at line 193: Duplicate column name 'Create_tmp_table_priv'
  −
  Sep 24 00:22:20 sme74clean mysql.init: ERROR 1054 (42S22) at line 282: Unknown column 'Create_view_priv' in 'where clause'
  −
  Sep 24 00:22:22 sme74clean mysql.init: ERROR 1054 (42S22) at line 317: Unknown column 'Create_routine_priv' in 'where clause'
  −
  Sep 24 00:22:24 sme74clean mysql.init: ERROR 1054 (42S22) at line 366: Unknown column 'Create_user_priv' in 'where clause'
  −
  Sep 24 00:22:25 sme74clean mysql.init: ERROR 1060 (42S21) at line 386: Duplicate column name 'Routine_type'
  −
 
  −
''/root/upgrade.log'' :
  −
* For ''db4 error(22)'': (check if it has been fixed) [[bugzilla:5489]]
  −
* For ''No module mptscsi found'': [[bugzilla:5490]]
  −
* For ''PHP Warning:  PHP Startup: Unable to load dynamic library'': [[bugzilla:5491]]
  −
 
  −
===from 7.4.0 and lower===
  −
 
  −
If in doubt, first update to 7.5.1
  −
 
  −
==YUM upgrade from a clean SME7.5.1==
  −
* Test Yum upgrade following procedures found in http://wiki.contribs.org/SME_Server_8
  −
 
  −
===from 7.4.0 and lower===
  −
 
  −
If in doubt, first update to 7.5.1
      
=Console =
 
=Console =
Line 120: Line 96:     
==Check Status==
 
==Check Status==
* The server displays 'This sever has been running for ...'
+
* The server displays 'This server has been running for ...'[PASS]
 +
Comment: Tested on beta 3 [chris burnat]
    
==Configure Server==
 
==Configure Server==
   −
* Basic configuration works?, eg NIC's, password, host and domain names
+
* Basic configuration works?, eg NIC's, password, host and domain names [PASS]  Comment: Tested on beta 3 [chris burnat]
    
===DHCP server===
 
===DHCP server===
 
*test IP allocation  
 
*test IP allocation  
: for predefined MAC addresses (= 'static' IP allocation)
+
: for predefined MAC addresses (= 'static' IP allocation) [PASS] (chrisb)
 
: for dynamic IPs
 
: for dynamic IPs
    
===Server-gateway===
 
===Server-gateway===
*Check functionality  
+
*Check functionality [PASS] Gateweay behing ADSL router, static IP, 5 WStations on LAN. Tested ssh,webmail, server-manager access from remote, FTP, etc - WS seems happy, Ubuntu MAC and Windows XP and 7Pro. (chrisb)
 
Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN
 
Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN
   Line 142: Line 119:     
==Test internet==
 
==Test internet==
* Prompt displays, then 'The test was successful...'
+
* Prompt displays, then 'The test was successful...' [PASS]  Comment:  Tested on beta 3 [chris burnat]
    
==Reboot==
 
==Reboot==
* Check each of the console options:  
+
* Check each of the console options: (david beveridge)
: reboot
+
: reboot [PASS]
: reconfigure  
+
: reconfigure [PASS]
: shutdown
+
: shutdown [PASS]
    
==Raid==
 
==Raid==
 
*Check each of the following:
 
*Check each of the following:
   −
: console, option 5, displays correctly for single disk  
+
: console, option 5, displays correctly for single disk [PASS]  Comment: Tested on beta 3 [chris burnat]
    
: console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]]   
 
: console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]]   
   −
: another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state.
+
: another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state [FAIL].
 +
Comment: Does not seem to work, installed on 200GB, then added another drive (500GB), item 5 does not detect the new drive.  Repeated this with sme8, drive is recognised and ready to add to mirror.  (Bug #7585 chrisb)
    
==Access Server Manager==
 
==Access Server Manager==
* server-manager displays and navigation works
+
* server-manager displays and navigation works [PASS] (chrisb)
 +
Comments: Some problems reported with access for alpha3 - check [Bug #7534] and [Bug #7538]
    
==View Support==
 
==View Support==
   −
*The GPL text displays
+
*The GPL text displays [PASS] (chris burnat)
    
==Backup to USB==
 
==Backup to USB==
 
: Check each of the following:
 
: Check each of the following:
* console restore
+
* console restore [FAILED]  Comment: performed restore from sme8 test system during installation of 9b3 - appears to restore OK, however, cannot access server-manager as reported by Jason [BUG #7547] However, restore of sm9 was also tested and was ok (chrisb)
 
+
Additional comments: whilst restore is completed successfully, there are a number of unnecessary lines of text appearing on the screen, refer [Bug #7539] and [Bug #7540]
* console backup
+
* console backup [PASS] Done one backup to USB and restore = ok.
    
=Server Manager =
 
=Server Manager =
 
+
* Accessing server-manager (local) - [PASS] (Chris burnat)
 +
* Accessing server-manager (from remote location) - [PASS] (Chris burnat)
 
==Collaboration ==
 
==Collaboration ==
   Line 246: Line 226:  
   [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!?
 
   [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!?
   −
====Public access via ftp==
+
====Public access via ftp====
 
* check functionality as applicable
 
* check functionality as applicable
 
:Comment:
 
:Comment:
Line 273: Line 253:  
====Backup ====
 
====Backup ====
   −
=====to desktop=====
+
=====to desktop===== [PASS]
 
+
Comment: backup OK, yet to test restore (chrisb)
 
Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly
 
Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly
   Line 281: Line 261:  
Comment:
 
Comment:
   −
=====to workstation=====
+
=====to workstation===== [PASS]
    
Comment: i.e. tested a set of three to a cifs share
 
Comment: i.e. tested a set of three to a cifs share
   −
=====to usb disk =====
+
=====to usb disk ===== [PASS]
 
+
Tested backup and restore, seems OK.
 
Comment:
 
Comment:
 
====Restore ====
 
====Restore ====
    
Comment:
 
Comment:
=====from desktop=====
+
=====from desktop===== [PASS]
 
Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass
 
Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass
   Line 298: Line 278:  
Comment:
 
Comment:
   −
=====from workstation=====
+
=====from workstation===== [PASS]
    
Comment: i.e. tested a set of three to a cifs share, with verification
 
Comment: i.e. tested a set of three to a cifs share, with verification
   −
=====from usb disk =====
+
=====from usb disk ===== [PASS]
   −
Comment:
+
Comment: Restore from sme9 backup is ok, however, restore from sme8 creates Havoc [Bug 7547]
 
===View log files===
 
===View log files===
   Line 319: Line 299:  
===Reboot and shutdown===
 
===Reboot and shutdown===
 
* Test from server-manager for each of:
 
* Test from server-manager for each of:
:reboot  
+
:reboot [PASS] (chris burnat)
:reconfigure  
+
:reconfigure [PASS] (chris burnat)
:shutdown
+
:shutdown [PASS] (chris burnat)
    
==Security==
 
==Security==
Line 330: Line 310:  
* Check functionality
 
* Check functionality
 
:Set a number of PPTP clients in server manager and test remote access (repeatedly)
 
:Set a number of PPTP clients in server manager and test remote access (repeatedly)
 +
Submitted bug 7546 because PPTP login fails due to missing radiusclient rpm. (david beveridge)
    
====Remote management====
 
====Remote management====
Line 335: Line 316:  
====SSH====
 
====SSH====
 
Check the following:
 
Check the following:
*remote access from local network on port other than 22
+
*remote access from local network on port other than 22 [PASS chrisb]
 
*External user/password access denied (port 22 and other) when set to 'No access' or 'Local network'  
 
*External user/password access denied (port 22 and other) when set to 'No access' or 'Local network'  
 
*External user/password access allowed (port 22 and other) when set to 'Entire internet'  
 
*External user/password access allowed (port 22 and other) when set to 'Entire internet'  
Line 344: Line 325:  
*External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'  
 
*External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'  
 
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No'
 
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No'
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'  
+
*External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No'
    
====FTP====
 
====FTP====
Line 389: Line 370:  
====Updates====
 
====Updates====
   −
* updates via the panel work
+
* updates via the panel work [PASS] (David Beveridge)
   −
* the updates available warning displays
+
* the updates available warning displays on this page [PASS] (David Beveridge)
    
====Settings====
 
====Settings====
Line 412: Line 393:  
===Date and time===
 
===Date and time===
   −
'Set Date and Time' manually works
+
'Set Date and Time' manually works [PASS] (David Beveridge)
   −
'Configure Network Time Server' works if you enter a valid time server
+
'Configure Network Time Server' works if you enter a valid time server [PASS] (David Beveridge)
    
===Workgroup ===
 
===Workgroup ===
Line 455: Line 436:  
====Workgroup server ====
 
====Workgroup server ====
 
* Connect to samba share
 
* Connect to samba share
 +
 +
(David Beveridge)
 +
Testing from Windows 2008R2 Server with SME IP Address entered into WINS on IPv4 Config. WorkGroupNames Matching
 +
<br>Also tried from Windows 8 Pro Workstation on a remote subnet (listed as a local network).  Different WorkGroup Name, WINS address set to SME Server.
 +
 +
net use x: \\sme9a3\Primary /user:admin<br>
 +
works and I have write access;
 +
login as a user and has read-only
 +
 +
create an ibay and grant rights then user can write to the volume
 +
 +
net view shows my printer as well. [PASS]
    
====Roaming profiles====
 
====Roaming profiles====
Line 471: Line 464:  
: Webmail (list address book contents via string like "mich" shows all Michael(s))
 
: Webmail (list address book contents via string like "mich" shows all Michael(s))
 
: Thunderbird LDAP test on local network
 
: Thunderbird LDAP test on local network
 +
 +
(David Beveridge)
 +
Tested Thunderbird, x86_64, CentOS 6.4 to a local network at another site. [PASS]
 +
Tested Webmail. LDAP contacts appear in there too [PASS]
    
===Printers ===
 
===Printers ===
Line 497: Line 494:  
====Access====
 
====Access====
 
Test functionality for the following:
 
Test functionality for the following:
*webmail  
+
*webmail [PASS] (chris burnat)
 +
Seems to be working ok. Send and received. [PASS]
 +
I sent a message to a bad email with UTF-8 encoding.
 +
When the bounce came back the UTF-8 sections were all messed up.
 +
I'm talking about Chinese and Cyrillic etc.
 +
I dunno if this is a problem.
 +
I had horde set to English (American).
 +
The copy I received in GMail was perfect.(David Beveridge)
   −
*pop3(s)  
+
*pop3(s) [FAIL]
Comments:
+
Comments: pop3 ok on port 110, but fails on port 995 (chris burnat)
    
*imap(s)  
 
*imap(s)  
Comments: i.e. Intensive, ongoing testing with imap & imaps access from LAN PCs and external
+
Used Sending and Receiving with Thunderbird with no problems on CentOS 6.4 x86_64 workstation. [PASS]<br>
 +
Windows 8 Pro Metro Mail Application  Cannot setup the account. <br>
 +
Basically SME Server won't allow plain text mode (despite giving the appearance that it can from Server-manager)
 +
and if you try to set up the Windows client in Secure Mode it complains the the certificates need to be installed by the administrator.
 +
I assume this is because they are a self signed cert.  Not really a problem as certs are only about $10,
 +
But I cannot see where to install it in the SME manager.  So as I see it the bug is that SME server
 +
offers plain text in the manager interface but the back end doesn't actually support it.  [FAIL]<br>
 +
Submitted [[bugzilla:7549|Bug 7549]]
 +
* [[bugzilla:7549|Bug 7549]] is now fixed. Can this be retried.
   −
* check: /var/log/pop3(s)/current
+
* check: /var/log/pop3(s)/current -nothing unusual (chrisb)
* check: /var/log/imap(s)/current
+
* check: /var/log/imap(s)/current -nothing unusual (chrisb)
    
====Filtering====
 
====Filtering====
Line 533: Line 545:  
===Review===
 
===Review===
   −
Basic server information is displayed
+
Basic server information is displayed [PASS] (chris burnat)
    
==Miscellaneous==
 
==Miscellaneous==
Line 540: Line 552:     
The GPL text is displayed
 
The GPL text is displayed
 +
(David Beveridge) [PASS]
    
===Starter Website===
 
===Starter Website===
   −
Site created after entering text as prompted
+
Site created after entering text as prompted<br>
 +
 
 +
(David Beverdige)
 +
That pretty much worked fine, so long as you're using an ANSI character set.<br>
 +
 
 +
Might have to do a NFR to fix that. [PASS]<br>
    
[[Category:SME Server Development Framework]]
 
[[Category:SME Server Development Framework]]
 
[[Category:SME9-Development]]
 
[[Category:SME9-Development]]

Navigation menu