Line 1: |
Line 1: |
− | =Version 9.0 testing= | + | =Version 9.# testing= |
− | This document lists tests that we need to do to get version 9.0 to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work. | + | This document lists tests that we need to do to get version 9.# to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work. |
| | | |
| The document should be used as Work In Progress so please feel free to add additional test scenarios and comments. | | The document should be used as Work In Progress so please feel free to add additional test scenarios and comments. |
| | | |
− | All tests here should be based on the latest available version ''''9.0 Alpha X''''. with updates including smeupdates-testing you have a preview of a work in progress | + | All tests here should be based on the latest available version ''''9.# Beta X''''. with updates including smeupdates-testing you have a preview of a work in progress |
| | | |
| In general: | | In general: |
| * check the related logfile(s) for each test | | * check the related logfile(s) for each test |
| * don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported | | * don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported |
− | * A list of currently reported bugs for SME Server 9.0 is here: [http://bugs.contribs.org/report.cgi?x_axis_field=bug_status&y_axis_field=target_milestone&product=SME+Server+9.X&format=table&action=wrap] | + | * A list of currently reported bugs for SME Server 9.# is here: [http://bugs.contribs.org/report.cgi?x_axis_field=bug_status&y_axis_field=target_milestone&product=SME+Server+9.X&format=table&action=wrap] |
| | | |
| ==Test guidelines== | | ==Test guidelines== |
Line 15: |
Line 15: |
| | | |
| ==Executive Summary== | | ==Executive Summary== |
− | There has not been enough testing to indicate how well SME Server 9.0 is working. | + | There has not been enough testing to indicate how well SME Server 9.# is working. |
| | | |
| ==Verification== | | ==Verification== |
Line 55: |
Line 55: |
| {| style="color:red;background-color:#ffffcc;" | | {| style="color:red;background-color:#ffffcc;" |
| | | | | |
− | WARNING!!! There are no cmdline options that are supported yet (for SME 9), refer Bug #7529 comment #6. | + | WARNING!!! There are no cmdline options that are supported yet (for SME 9), refer [[Bugzilla:7529#c6]]. |
| |} | | |} |
| | | |
Line 68: |
Line 68: |
| Comment: the option "nodmraid" seems to work (dz00te) | | Comment: the option "nodmraid" seems to work (dz00te) |
| *RAID1 raid=1 | | *RAID1 raid=1 |
− | Comments: BUG the raid=1 options doesn't force the raid1 [check Bug #7529] | + | Comments: the raid=1 options doesn't force the raid1. see [[bugzilla:7529]] |
| *RAID1 nolvm spares=2 | | *RAID1 nolvm spares=2 |
| Comments: | | Comments: |
Line 82: |
Line 82: |
| Comments: | | Comments: |
| | | |
− | =Upgrading N/A for now= | + | =Upgrading= |
− | At the moment in-place upgrades are not supported, although there is an effort to make this work somehow.
| + | In-place upgrades are not supported from SME8.#. It is necessary to backup and then restore. |
− | For now it is necessary to take a backup, make a fresh install, and then restore the backup.
| + | /boot partition is always RAID 1. |
| + | |
| + | In-place upgrades to SME 9.1" *are* supported - from 9.0 only. |
| | | |
| ==Upgrade from older versions == | | ==Upgrade from older versions == |
− | | + | In-place upgrades to SME 9.1" *are* supported - from 9.0 only. |
| | | |
| =Console = | | =Console = |
Line 103: |
Line 105: |
| ===DHCP server=== | | ===DHCP server=== |
| *test IP allocation | | *test IP allocation |
− | : for predefined MAC addresses (= 'static' IP allocation) | + | : for predefined MAC addresses (= 'static' IP allocation) [PASS] (chrisb) |
| : for dynamic IPs | | : for dynamic IPs |
| | | |
| ===Server-gateway=== | | ===Server-gateway=== |
− | *Check functionality | + | *Check functionality [PASS] Gateweay behing ADSL router, static IP, 5 WStations on LAN. Tested ssh,webmail, server-manager access from remote, FTP, etc - WS seems happy, Ubuntu MAC and Windows XP and 7Pro. (chrisb) |
| Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN | | Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN |
| | | |
Line 132: |
Line 134: |
| : console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]] | | : console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]] |
| | | |
− | : another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state. | + | : another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state [FAIL]. |
| + | Comment: Does not seem to work, installed on 200GB, then added another drive (500GB), item 5 does not detect the new drive. Repeated this with sme8, drive is recognised and ready to add to mirror. (Bug #7585 chrisb) |
| | | |
| ==Access Server Manager== | | ==Access Server Manager== |
− | * server-manager displays and navigation works | + | * server-manager displays and navigation works [PASS] (chrisb) |
| Comments: Some problems reported with access for alpha3 - check [Bug #7534] and [Bug #7538] | | Comments: Some problems reported with access for alpha3 - check [Bug #7534] and [Bug #7538] |
| | | |
Line 144: |
Line 147: |
| ==Backup to USB== | | ==Backup to USB== |
| : Check each of the following: | | : Check each of the following: |
− | * console restore [PASS] Comment: performed restore from sme8 test system during installation of 9b3 - all OK [chris burnat] | + | * console restore [FAILED] Comment: performed restore from sme8 test system during installation of 9b3 - appears to restore OK, however, cannot access server-manager as reported by Jason [BUG #7547] However, restore of sm9 was also tested and was ok (chrisb) |
| Additional comments: whilst restore is completed successfully, there are a number of unnecessary lines of text appearing on the screen, refer [Bug #7539] and [Bug #7540] | | Additional comments: whilst restore is completed successfully, there are a number of unnecessary lines of text appearing on the screen, refer [Bug #7539] and [Bug #7540] |
− | * console backup | + | * console backup [PASS] Done one backup to USB and restore = ok. |
| | | |
| =Server Manager = | | =Server Manager = |
| * Accessing server-manager (local) - [PASS] (Chris burnat) | | * Accessing server-manager (local) - [PASS] (Chris burnat) |
− | * Accessing server-manager (from remote location) | + | * Accessing server-manager (from remote location) - [PASS] (Chris burnat) |
| ==Collaboration == | | ==Collaboration == |
| | | |
Line 223: |
Line 226: |
| [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!? | | [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!? |
| | | |
− | ====Public access via ftp== | + | ====Public access via ftp==== |
| * check functionality as applicable | | * check functionality as applicable |
| :Comment: | | :Comment: |
Line 250: |
Line 253: |
| ====Backup ==== | | ====Backup ==== |
| | | |
− | =====to desktop===== | + | =====to desktop===== [PASS] |
− | | + | Comment: backup OK, yet to test restore (chrisb) |
| Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly | | Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly |
| | | |
Line 258: |
Line 261: |
| Comment: | | Comment: |
| | | |
− | =====to workstation===== | + | =====to workstation===== [PASS] |
| | | |
| Comment: i.e. tested a set of three to a cifs share | | Comment: i.e. tested a set of three to a cifs share |
| | | |
− | =====to usb disk ===== | + | =====to usb disk ===== [PASS] |
− | | + | Tested backup and restore, seems OK. |
| Comment: | | Comment: |
| ====Restore ==== | | ====Restore ==== |
| | | |
| Comment: | | Comment: |
− | =====from desktop===== | + | =====from desktop===== [PASS] |
| Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass | | Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass |
| | | |
Line 275: |
Line 278: |
| Comment: | | Comment: |
| | | |
− | =====from workstation===== | + | =====from workstation===== [PASS] |
| | | |
| Comment: i.e. tested a set of three to a cifs share, with verification | | Comment: i.e. tested a set of three to a cifs share, with verification |
| | | |
− | =====from usb disk ===== | + | =====from usb disk ===== [PASS] |
| | | |
− | Comment: | + | Comment: Restore from sme9 backup is ok, however, restore from sme8 creates Havoc [Bug 7547] |
| ===View log files=== | | ===View log files=== |
| | | |
Line 297: |
Line 300: |
| * Test from server-manager for each of: | | * Test from server-manager for each of: |
| :reboot [PASS] (chris burnat) | | :reboot [PASS] (chris burnat) |
− | :reconfigure | + | :reconfigure [PASS] (chris burnat) |
| :shutdown [PASS] (chris burnat) | | :shutdown [PASS] (chris burnat) |
| | | |
Line 313: |
Line 316: |
| ====SSH==== | | ====SSH==== |
| Check the following: | | Check the following: |
− | *remote access from local network on port other than 22 | + | *remote access from local network on port other than 22 [PASS chrisb] |
| *External user/password access denied (port 22 and other) when set to 'No access' or 'Local network' | | *External user/password access denied (port 22 and other) when set to 'No access' or 'Local network' |
| *External user/password access allowed (port 22 and other) when set to 'Entire internet' | | *External user/password access allowed (port 22 and other) when set to 'Entire internet' |
Line 322: |
Line 325: |
| *External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' | | *External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' |
| *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No' | | *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No' |
− | *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' | + | *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' |
| | | |
| ====FTP==== | | ====FTP==== |
Line 436: |
Line 439: |
| (David Beveridge) | | (David Beveridge) |
| Testing from Windows 2008R2 Server with SME IP Address entered into WINS on IPv4 Config. WorkGroupNames Matching | | Testing from Windows 2008R2 Server with SME IP Address entered into WINS on IPv4 Config. WorkGroupNames Matching |
− | Also tried from Windows 8 Pro Workstation on a remote subnet (listed as a local network). | + | <br>Also tried from Windows 8 Pro Workstation on a remote subnet (listed as a local network). Different WorkGroup Name, WINS address set to SME Server. |
| | | |
| net use x: \\sme9a3\Primary /user:admin<br> | | net use x: \\sme9a3\Primary /user:admin<br> |
Line 491: |
Line 494: |
| ====Access==== | | ====Access==== |
| Test functionality for the following: | | Test functionality for the following: |
− | *webmail | + | *webmail [PASS] (chris burnat) |
| Seems to be working ok. Send and received. [PASS] | | Seems to be working ok. Send and received. [PASS] |
| I sent a message to a bad email with UTF-8 encoding. | | I sent a message to a bad email with UTF-8 encoding. |
Line 500: |
Line 503: |
| The copy I received in GMail was perfect.(David Beveridge) | | The copy I received in GMail was perfect.(David Beveridge) |
| | | |
− | *pop3(s) | + | *pop3(s) [FAIL] |
− | Comments: | + | Comments: pop3 ok on port 110, but fails on port 995 (chris burnat) |
| | | |
| *imap(s) | | *imap(s) |
Line 511: |
Line 514: |
| But I cannot see where to install it in the SME manager. So as I see it the bug is that SME server | | But I cannot see where to install it in the SME manager. So as I see it the bug is that SME server |
| offers plain text in the manager interface but the back end doesn't actually support it. [FAIL]<br> | | offers plain text in the manager interface but the back end doesn't actually support it. [FAIL]<br> |
− | Submitted bug 7549 | + | Submitted [[bugzilla:7549|Bug 7549]] |
− | | + | * [[bugzilla:7549|Bug 7549]] is now fixed. Can this be retried. |
| | | |
− | * check: /var/log/pop3(s)/current | + | * check: /var/log/pop3(s)/current -nothing unusual (chrisb) |
− | * check: /var/log/imap(s)/current | + | * check: /var/log/imap(s)/current -nothing unusual (chrisb) |
| | | |
| ====Filtering==== | | ====Filtering==== |