wiki/team/qa/release-qa.md

213 lines
7.3 KiB
Markdown
Raw Permalink Normal View History

2020-03-02 14:44:06 +00:00
---
title: OpenMandriva Release QA
description:
published: true
2023-02-05 12:58:02 +00:00
date: 2022-11-04T17:56:09.907Z
2022-08-27 23:45:30 +01:00
tags: releases, policies, qa
editor: markdown
2020-12-23 12:41:18 +00:00
dateCreated: 2020-03-02T14:44:03.923Z
2020-03-02 14:44:06 +00:00
---
# OpenMandriva Release QA
>
> **THE RELEASE PROCESS**
{.is-info}
## ISO Install
2022-08-27 23:45:30 +01:00
### Installation
2020-03-02 14:44:06 +00:00
The distribution should boot from a basic memory stick created using
`dd if=”openmandriva iso” of=”dev/sd*” bs=4M`
2022-08-27 23:45:30 +01:00
The graphical and text installs should function as specified
2020-03-02 14:44:06 +00:00
The install process must work in different languages i.e. no missing translations.
2022-08-27 23:45:30 +01:00
Alternative keyboard layouts must work
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Graphical Install
The graphical install should occur at the most suitable resolution and colour resolution available from the system a minimum resolution of 1024 x 768 should be supported
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Administration and Artwork
The name of the release should be the current one
The licence agreement should display and be correct in its wording
The release notes should be current for the release in question and should be labelled as such
All artwork must be that approved for the current release
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### General Properties
No installation action requiring user intervention should appear off-screen for the resolution chosen (OK buttons; APPLY buttons, etc)
Where possible the user should be able to return to the previous step in the installation process. Where this is not possible the user should be warned that there is no reversion or possibility of revision from the next step (i.e. partition formatting)
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Hardware
The release must install on designated hardware platforms
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Network
2020-03-02 14:44:06 +00:00
Both wired and wireless configuration should be achievable with minimal user interaction
2022-08-27 23:45:30 +01:00
### Repositories
\-
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### X-Server
2020-03-02 14:44:06 +00:00
Automatic set-up of the X-server should function where drivers are not functional for the installed card the X-server should default to the VESA driver to provide a fail-safe option.
2022-08-27 23:45:30 +01:00
### Window Manager
2020-03-02 14:44:06 +00:00
The chosen window should install without error if this fails an alternative basic window manager should be offered. Automatic start-up of the window manager should be offered during the install.
2022-08-27 23:45:30 +01:00
### Printing
2020-03-02 14:44:06 +00:00
The cups server should be installed during the install process.
2022-08-27 23:45:30 +01:00
### Sound
2020-03-02 14:44:06 +00:00
The sound server should install automatically audible confirmation for the user should confirm this. If there is no sound card or if sound installation fails an appropriate message should be displayed.
#### User Setup
The installer should call for the provision of a root password.
The installer should force the creation of at least one user.
## Start Up
2022-08-27 23:45:30 +01:00
### Initial Boot
2020-03-02 14:44:06 +00:00
The boot flash should display properly on the monitor there should be no displacement of the image.
2022-08-27 23:45:30 +01:00
### Boot Manager
The boot manager must work for other OS installs
The boot manager must properly update should an alternative kernel be installed
2020-03-02 14:44:06 +00:00
The boot manager should show the proper options for boot as a minimum:
*Open-Mandriva Linux
Failsafe boot (boot to single user root terminal)
2022-08-27 23:45:30 +01:00
Rescue system*
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Graphical Login
2020-03-02 14:44:06 +00:00
The graphical login manager should display all users (excluding system users).
The chosen user should be the one that last logged in. In the case of a new installation it it should be the first entry when users are sorted alphabetically (a to z)
The keyboard cursor should start in the password text entry box.
If a shutdown/general purpose menu is included all functions must operate correctly.
The login manager must not allow access to the window manager without a password.
It should be possible to start a CLI interface login from the graphical login manager.
2022-08-27 23:45:30 +01:00
### Window Manager
2020-03-02 14:44:06 +00:00
After login the chosen window manager should startup without error
Visible indication of USB plugged devices should be easily seen. (including wireless and wired network devices)
In the case of USB disk/cdrom/memory drives these should all mount cleanly for the following filesystems ext2, ext3, ext4, fat32, ntfs3g and any encrypted file system drivers that may be included with the operating system.
2022-08-27 23:45:30 +01:00
### Servers
2020-03-02 14:44:06 +00:00
As a minimum Samba, Cups, ssh, nfs and ftp servers must function correctly
2022-08-27 23:45:30 +01:00
### Software Maintenance
The auto-update system must function correctly when internet access is available
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Configuration
The Open Mandriva Control Center should be fully operational
2020-03-02 14:44:06 +00:00
2022-08-27 23:45:30 +01:00
### Graphical Core Applications
2020-03-02 14:44:06 +00:00
The following list of applications should start without error and have the minimum of bugs.
#### System
Plasma Desktop
KDE configuration apps
Sound server (network sound should be functional)
Akonadi server
File indexing
Konsole
#### Office
Libre Office
Okular
#### Internet
Falkon
Firefox
Chromium
Browser Plugins
PDF support
Java
Kmail
Mozilla Thunderbird
2022-08-27 23:45:30 +01:00
IRC Client
2020-03-02 14:44:06 +00:00
#### File Management
Dolphin
(built in network access must also function)
2022-08-27 23:45:30 +01:00
Midnight Commander
2020-03-02 14:44:06 +00:00
#### File Editors
Kwrite
Kate
#### Development
Kdevelop
Eclipse
#### Graphics
Gwenview
Krita
DigiKam
#### Sound & Video
...
#### Tools
...
#### Utilities
2022-08-27 23:45:30 +01:00
Open Mandriva Welcome should be fully operational
2020-03-02 14:44:06 +00:00
...
#### CLI Core Applications
mc
vim
ed
vi
nano
emacs?
Bash
sh
binutils
man
less
netstat
bind
dhclient
M4
bison
grep
awk
sed
make
Autoconf
libtool
pkgconfig
scons
rpm
urpmi
perl
python
## Criteria for release approval
- All the programs listed above must be functional and able to open, process, close and save a file where appropriate. There must be no outstanding security issues.
- There must be no bugs that seriously compromise the functionality of the system as far as the user is concerned for the core packages listed above. Bugs in supplementary packages and contrib that do not adversely affect the running for the os may be tolerated. Bugs that will not be tolerated are excessive disk usage, high system resource consumption, memory leaks, window manager lockup and and any form of system freeze.
- It must be possible to install a different kernel from the OM repository without problems. The kernel installation script must properly update the boot manager and show the availability of the new kernel in the boot up screen. The original kernel must be renamed in such a manner as to make it clear that this was the original default kernel. The symbolic links which point to the default kernel must be properly updated.
- It must be possible to achieve network connectivity and where available be able to access the Internet. This should be possible for both wireless and wired connections;
- No commonly used server must fail to start;
- The system must be able to print from all applications that provide this service;
2022-08-27 23:45:30 +01:00
- The Software Repository Selector (om-repo-picker) should be fully operational;
2020-03-02 14:44:06 +00:00
- The packaging system and repos must be operational including OpenMandriva auto update;
- ISOs submitted for release must be properly named and dated.
## Checklist
2022-08-27 23:45:30 +01:00
QA Team and testers are encouraged to produce a detailed [checklist](https://github.com/OpenMandrivaAssociation/distribution/wiki/QA-Checklist-for-QA-and-testers) for ISO with list of detected bugs.<br />
2020-03-02 14:44:06 +00:00
It should contain typical use cases like:
1. Does iso burns on usb stick
1. Does the grub/boot screen appears
1. Does the options in grub/boot screen works
1. Does ISO boot to multi-user.target
1. Does ISO boot to graphical.target
1. Does autologin for live user works
1. Does default graphical desktop shows after autologin
1. Does default graphical desktop is useable (basics, like menu, file manager, web browser)
1. Does ISO boot in VirtualBox
1. Does ISO install in VirtualBox