Line 1: |
Line 1: |
− | =Version 9.0 testing= | + | =Version 9.# testing= |
− | This document lists tests that we need to do to get version 9.0 to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work. | + | This document lists tests that we need to do to get version 9.# to a final release. It's an attempt to invite as many testers as possible and to coordinate our testing work. |
| | | |
| The document should be used as Work In Progress so please feel free to add additional test scenarios and comments. | | The document should be used as Work In Progress so please feel free to add additional test scenarios and comments. |
| | | |
− | All tests here should be based on the latest available version ''''9.0 Alpha X''''. with updates including smeupdates-testing you have a preview of a work in progress | + | All tests here should be based on the latest available version ''''9.# Beta X''''. with updates including smeupdates-testing you have a preview of a work in progress |
| | | |
| In general: | | In general: |
| * check the related logfile(s) for each test | | * check the related logfile(s) for each test |
| * don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported | | * don't hesitate to raise a bug if there is an issue or something suspicious but check the Bugtracker before whether this might already be reported |
− | * A list of currently reported bugs for SME Server 9.0 is here: [http://bugs.contribs.org/report.cgi?x_axis_field=bug_status&y_axis_field=target_milestone&product=SME+Server+9.X&format=table&action=wrap] | + | * A list of currently reported bugs for SME Server 9.# is here: [http://bugs.contribs.org/report.cgi?x_axis_field=bug_status&y_axis_field=target_milestone&product=SME+Server+9.X&format=table&action=wrap] |
| | | |
| ==Test guidelines== | | ==Test guidelines== |
Line 15: |
Line 15: |
| | | |
| ==Executive Summary== | | ==Executive Summary== |
− | There has not been enough testing to indicate how well SME Server 9.0 is working. | + | There has not been enough testing to indicate how well SME Server 9.# is working. |
| | | |
| ==Verification== | | ==Verification== |
Line 52: |
Line 52: |
| | | |
| ==Installation types== | | ==Installation types== |
| + | |
| + | {| style="color:red;background-color:#ffffcc;" |
| + | | |
| + | WARNING!!! There are no cmdline options that are supported yet (for SME 9), refer [[Bugzilla:7529#c6]]. |
| + | |} |
| + | |
| Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc. Note that you need to test each scenario separately, meaning reinstalling from scratch for each test - you cannot modify a Raid configuration after a system has been installed. | | Different installation scenarios re. software RAID, LVM and NOSPARE usage, etc. Note that you need to test each scenario separately, meaning reinstalling from scratch for each test - you cannot modify a Raid configuration after a system has been installed. |
| | | |
Line 62: |
Line 68: |
| Comment: the option "nodmraid" seems to work (dz00te) | | Comment: the option "nodmraid" seems to work (dz00te) |
| *RAID1 raid=1 | | *RAID1 raid=1 |
− | Comments: BUG the raid=1 options doesn't force the raid1 [check Bug #7529] | + | Comments: the raid=1 options doesn't force the raid1. see [[bugzilla:7529]] |
| *RAID1 nolvm spares=2 | | *RAID1 nolvm spares=2 |
| Comments: | | Comments: |
Line 76: |
Line 82: |
| Comments: | | Comments: |
| | | |
− | =Upgrading N/A for now= | + | =Upgrading= |
− | At the moment in-place upgrades are not supported, although there is an effort to make this work somehow.
| + | In-place upgrades are not supported from SME8.#. It is necessary to backup and then restore. |
− | For now it is necessary to take a backup, make a fresh install, and then restore the backup.
| + | /boot partition is always RAID 1. |
| + | |
| + | In-place upgrades to SME 9.1" *are* supported - from 9.0 only. |
| | | |
| ==Upgrade from older versions == | | ==Upgrade from older versions == |
− | | + | In-place upgrades to SME 9.1" *are* supported - from 9.0 only. |
| | | |
| =Console = | | =Console = |
Line 88: |
Line 96: |
| | | |
| ==Check Status== | | ==Check Status== |
− | * The server displays 'This sever has been running for ...' | + | * The server displays 'This server has been running for ...'[PASS] |
| + | Comment: Tested on beta 3 [chris burnat] |
| | | |
| ==Configure Server== | | ==Configure Server== |
| | | |
− | * Basic configuration works?, eg NIC's, password, host and domain names | + | * Basic configuration works?, eg NIC's, password, host and domain names [PASS] Comment: Tested on beta 3 [chris burnat] |
| | | |
| ===DHCP server=== | | ===DHCP server=== |
| *test IP allocation | | *test IP allocation |
− | : for predefined MAC addresses (= 'static' IP allocation) | + | : for predefined MAC addresses (= 'static' IP allocation) [PASS] (chrisb) |
| : for dynamic IPs | | : for dynamic IPs |
| | | |
| ===Server-gateway=== | | ===Server-gateway=== |
− | *Check functionality | + | *Check functionality [PASS] Gateweay behing ADSL router, static IP, 5 WStations on LAN. Tested ssh,webmail, server-manager access from remote, FTP, etc - WS seems happy, Ubuntu MAC and Windows XP and 7Pro. (chrisb) |
| Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN | | Sample Comments: Running as gateway behind broadband router with static IP for several weeks; all sorts of incoming connections tested (email, ssh, webmail, server-manager access) successfully, also outgoing traffic from various PCs (Windows, Linux) on LAN |
| | | |
Line 110: |
Line 119: |
| | | |
| ==Test internet== | | ==Test internet== |
− | * Prompt displays, then 'The test was successful...' | + | * Prompt displays, then 'The test was successful...' [PASS] Comment: Tested on beta 3 [chris burnat] |
| | | |
| ==Reboot== | | ==Reboot== |
− | * Check each of the console options: | + | * Check each of the console options: (david beveridge) |
− | : reboot | + | : reboot [PASS] |
− | : reconfigure | + | : reconfigure [PASS] |
− | : shutdown | + | : shutdown [PASS] |
| | | |
| ==Raid== | | ==Raid== |
| *Check each of the following: | | *Check each of the following: |
| | | |
− | : console, option 5, displays correctly for single disk | + | : console, option 5, displays correctly for single disk [PASS] Comment: Tested on beta 3 [chris burnat] |
| | | |
| : console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]] | | : console, option 5, displays correctly for various RAID scenarios, all those combinations which we tested under [[SME8.0_QA#Installation_types]] |
| | | |
− | : another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state. | + | : another disk added to a one disk system, open console, option 5, prompted to add drive, drive added, option 5 states all drives in clean state [FAIL]. |
| + | Comment: Does not seem to work, installed on 200GB, then added another drive (500GB), item 5 does not detect the new drive. Repeated this with sme8, drive is recognised and ready to add to mirror. (Bug #7585 chrisb) |
| | | |
| ==Access Server Manager== | | ==Access Server Manager== |
− | * server-manager displays and navigation works | + | * server-manager displays and navigation works [PASS] (chrisb) |
| + | Comments: Some problems reported with access for alpha3 - check [Bug #7534] and [Bug #7538] |
| | | |
| ==View Support== | | ==View Support== |
| | | |
− | *The GPL text displays | + | *The GPL text displays [PASS] (chris burnat) |
| | | |
| ==Backup to USB== | | ==Backup to USB== |
| : Check each of the following: | | : Check each of the following: |
− | * console restore | + | * console restore [FAILED] Comment: performed restore from sme8 test system during installation of 9b3 - appears to restore OK, however, cannot access server-manager as reported by Jason [BUG #7547] However, restore of sm9 was also tested and was ok (chrisb) |
− | | + | Additional comments: whilst restore is completed successfully, there are a number of unnecessary lines of text appearing on the screen, refer [Bug #7539] and [Bug #7540] |
− | * console backup | + | * console backup [PASS] Done one backup to USB and restore = ok. |
| | | |
| =Server Manager = | | =Server Manager = |
− | | + | * Accessing server-manager (local) - [PASS] (Chris burnat) |
| + | * Accessing server-manager (from remote location) - [PASS] (Chris burnat) |
| ==Collaboration == | | ==Collaboration == |
| | | |
Line 214: |
Line 226: |
| [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!? | | [Thu Sep 24 22:45:56 2009] [warn] RSA server certificate CommonName (CN) `sme8b4clean.testdomain.lan' does NOT match server name!? |
| | | |
− | ====Public access via ftp== | + | ====Public access via ftp==== |
| * check functionality as applicable | | * check functionality as applicable |
| :Comment: | | :Comment: |
Line 241: |
Line 253: |
| ====Backup ==== | | ====Backup ==== |
| | | |
− | =====to desktop===== | + | =====to desktop===== [PASS] |
− | | + | Comment: backup OK, yet to test restore (chrisb) |
| Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly | | Comment: i.e. a server with a small amount of data created a smeserver.tgz correctly |
| | | |
Line 249: |
Line 261: |
| Comment: | | Comment: |
| | | |
− | =====to workstation===== | + | =====to workstation===== [PASS] |
| | | |
| Comment: i.e. tested a set of three to a cifs share | | Comment: i.e. tested a set of three to a cifs share |
| | | |
− | =====to usb disk ===== | + | =====to usb disk ===== [PASS] |
− | | + | Tested backup and restore, seems OK. |
| Comment: | | Comment: |
| ====Restore ==== | | ====Restore ==== |
| | | |
| Comment: | | Comment: |
− | =====from desktop===== | + | =====from desktop===== [PASS] |
| Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass | | Comment: i.e. restoring from desktop is actually via the console, put you .tgz on a cd or usb device, pass |
| | | |
Line 266: |
Line 278: |
| Comment: | | Comment: |
| | | |
− | =====from workstation===== | + | =====from workstation===== [PASS] |
| | | |
| Comment: i.e. tested a set of three to a cifs share, with verification | | Comment: i.e. tested a set of three to a cifs share, with verification |
| | | |
− | =====from usb disk ===== | + | =====from usb disk ===== [PASS] |
| | | |
− | Comment: | + | Comment: Restore from sme9 backup is ok, however, restore from sme8 creates Havoc [Bug 7547] |
| ===View log files=== | | ===View log files=== |
| | | |
Line 287: |
Line 299: |
| ===Reboot and shutdown=== | | ===Reboot and shutdown=== |
| * Test from server-manager for each of: | | * Test from server-manager for each of: |
− | :reboot | + | :reboot [PASS] (chris burnat) |
− | :reconfigure | + | :reconfigure [PASS] (chris burnat) |
− | :shutdown | + | :shutdown [PASS] (chris burnat) |
| | | |
| ==Security== | | ==Security== |
Line 298: |
Line 310: |
| * Check functionality | | * Check functionality |
| :Set a number of PPTP clients in server manager and test remote access (repeatedly) | | :Set a number of PPTP clients in server manager and test remote access (repeatedly) |
| + | Submitted bug 7546 because PPTP login fails due to missing radiusclient rpm. (david beveridge) |
| | | |
| ====Remote management==== | | ====Remote management==== |
Line 303: |
Line 316: |
| ====SSH==== | | ====SSH==== |
| Check the following: | | Check the following: |
− | *remote access from local network on port other than 22 | + | *remote access from local network on port other than 22 [PASS chrisb] |
| *External user/password access denied (port 22 and other) when set to 'No access' or 'Local network' | | *External user/password access denied (port 22 and other) when set to 'No access' or 'Local network' |
| *External user/password access allowed (port 22 and other) when set to 'Entire internet' | | *External user/password access allowed (port 22 and other) when set to 'Entire internet' |
Line 312: |
Line 325: |
| *External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' | | *External certificate access allowed (port 22 and other) for root when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' |
| *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No' | | *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'No' and 'allow standard password' set to 'No' |
− | *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' | + | *External certificate access allowed (port 22 and other) for user (if configured) when 'administrative commandline' to 'Yes' and 'allow standard password' set to 'No' |
| | | |
| ====FTP==== | | ====FTP==== |
Line 357: |
Line 370: |
| ====Updates==== | | ====Updates==== |
| | | |
− | * updates via the panel work | + | * updates via the panel work [PASS] (David Beveridge) |
| | | |
− | * the updates available warning displays | + | * the updates available warning displays on this page [PASS] (David Beveridge) |
| | | |
| ====Settings==== | | ====Settings==== |
Line 380: |
Line 393: |
| ===Date and time=== | | ===Date and time=== |
| | | |
− | 'Set Date and Time' manually works | + | 'Set Date and Time' manually works [PASS] (David Beveridge) |
| | | |
− | 'Configure Network Time Server' works if you enter a valid time server | + | 'Configure Network Time Server' works if you enter a valid time server [PASS] (David Beveridge) |
| | | |
| ===Workgroup === | | ===Workgroup === |
Line 423: |
Line 436: |
| ====Workgroup server ==== | | ====Workgroup server ==== |
| * Connect to samba share | | * Connect to samba share |
| + | |
| + | (David Beveridge) |
| + | Testing from Windows 2008R2 Server with SME IP Address entered into WINS on IPv4 Config. WorkGroupNames Matching |
| + | <br>Also tried from Windows 8 Pro Workstation on a remote subnet (listed as a local network). Different WorkGroup Name, WINS address set to SME Server. |
| + | |
| + | net use x: \\sme9a3\Primary /user:admin<br> |
| + | works and I have write access; |
| + | login as a user and has read-only |
| + | |
| + | create an ibay and grant rights then user can write to the volume |
| + | |
| + | net view shows my printer as well. [PASS] |
| | | |
| ====Roaming profiles==== | | ====Roaming profiles==== |
Line 439: |
Line 464: |
| : Webmail (list address book contents via string like "mich" shows all Michael(s)) | | : Webmail (list address book contents via string like "mich" shows all Michael(s)) |
| : Thunderbird LDAP test on local network | | : Thunderbird LDAP test on local network |
| + | |
| + | (David Beveridge) |
| + | Tested Thunderbird, x86_64, CentOS 6.4 to a local network at another site. [PASS] |
| + | Tested Webmail. LDAP contacts appear in there too [PASS] |
| | | |
| ===Printers === | | ===Printers === |
Line 465: |
Line 494: |
| ====Access==== | | ====Access==== |
| Test functionality for the following: | | Test functionality for the following: |
− | *webmail | + | *webmail [PASS] (chris burnat) |
| + | Seems to be working ok. Send and received. [PASS] |
| + | I sent a message to a bad email with UTF-8 encoding. |
| + | When the bounce came back the UTF-8 sections were all messed up. |
| + | I'm talking about Chinese and Cyrillic etc. |
| + | I dunno if this is a problem. |
| + | I had horde set to English (American). |
| + | The copy I received in GMail was perfect.(David Beveridge) |
| | | |
− | *pop3(s) | + | *pop3(s) [FAIL] |
− | Comments: | + | Comments: pop3 ok on port 110, but fails on port 995 (chris burnat) |
| | | |
| *imap(s) | | *imap(s) |
− | Comments: i.e. Intensive, ongoing testing with imap & imaps access from LAN PCs and external
| + | Used Sending and Receiving with Thunderbird with no problems on CentOS 6.4 x86_64 workstation. [PASS]<br> |
| + | Windows 8 Pro Metro Mail Application Cannot setup the account. <br> |
| + | Basically SME Server won't allow plain text mode (despite giving the appearance that it can from Server-manager) |
| + | and if you try to set up the Windows client in Secure Mode it complains the the certificates need to be installed by the administrator. |
| + | I assume this is because they are a self signed cert. Not really a problem as certs are only about $10, |
| + | But I cannot see where to install it in the SME manager. So as I see it the bug is that SME server |
| + | offers plain text in the manager interface but the back end doesn't actually support it. [FAIL]<br> |
| + | Submitted [[bugzilla:7549|Bug 7549]] |
| + | * [[bugzilla:7549|Bug 7549]] is now fixed. Can this be retried. |
| | | |
− | * check: /var/log/pop3(s)/current | + | * check: /var/log/pop3(s)/current -nothing unusual (chrisb) |
− | * check: /var/log/imap(s)/current | + | * check: /var/log/imap(s)/current -nothing unusual (chrisb) |
| | | |
| ====Filtering==== | | ====Filtering==== |
Line 501: |
Line 545: |
| ===Review=== | | ===Review=== |
| | | |
− | Basic server information is displayed | + | Basic server information is displayed [PASS] (chris burnat) |
| | | |
| ==Miscellaneous== | | ==Miscellaneous== |
Line 508: |
Line 552: |
| | | |
| The GPL text is displayed | | The GPL text is displayed |
| + | (David Beveridge) [PASS] |
| | | |
| ===Starter Website=== | | ===Starter Website=== |
| | | |
− | Site created after entering text as prompted | + | Site created after entering text as prompted<br> |
| + | |
| + | (David Beverdige) |
| + | That pretty much worked fine, so long as you're using an ANSI character set.<br> |
| + | |
| + | Might have to do a NFR to fix that. [PASS]<br> |
| | | |
| [[Category:SME Server Development Framework]] | | [[Category:SME Server Development Framework]] |
| [[Category:SME9-Development]] | | [[Category:SME9-Development]] |