4.2 KiB
| title | description | published | date | tags |
|---|---|---|---|---|
| QA/Getting Started | true | 2020-03-02T15:44:48.249Z | qa |
Getting Started with QA
We are glad that you are interested in QA. We have compiled this document to help you get started in helping us test OpenMandriva Lx.
You will need to use the command line to test more often than not. Make sure you have an accounts at ABF, OpenMandriva Issue Tracker, and Github.
QA Team daily communication takes place on Freenode IRC @ #openmandriva-cooker but remember that this is also where developers work so mind your IRC manners. Currently OpenMandriva contributor group is small enough that developers and QA work together on IRC. There is also a dedicated QA Forum.
QA Team members are encouraged to actively attend weekly TC meetings or if unable to attend to read the meeting logs to keep up with what is happening. They are announced here. TC meetings take place on Freenode IRC @ #openmandriva-cooker.
Setting up your OpenMandriva Lx system
Because you'll probably be working with untested (with our OS at least) software, we strongly urge you to use a dedicated or virtual machine for testing. For QA work on hardware (recommended if at all possible) it is recommended to have Rolling installed on a separate partition so you have a 'stable' system on another partition in case something breaks during testing.
Pre-release software comes through the testing repositories. Packages in Main repository take precedence over those in other repositories. Packages in Unsupported and Non-Free repositories are responsibility of the package maintainer not OpenMandriva developers.
QA-Team members need a thorough understanding of Release Plan and Repositories and Repository Policies. There will be more as we better document Openmandriva Lx but we like to keep documentation as simple and light as is feasible.
Workflow for packages is: Cooker > Rolling > Stable repo. Developers/package maintainers are responsible for initiating packages in Cooker and for moving them to Rolling/testing repos. Then QA takes over. Thus all QA Team members are encouraged to maintain a Rolling system where they can do package testing.
You can add the testing repositories with the OpenMandriva Software Repository Selector GUI or from command line
For Main repo only:
Rock system:
sudo dnf config-manager --enable rock-testing-$ARCH
Rolling system:
sudo dnf config-manager --enable rolling-testing-$ARCH
Replace $ARCH with your architecture.
For all testing repos:
Rock system:
sudo dnf config-manager --enable rock-testing-$ARCH rock-testing-$ARCH-unsupported rock-testing-$ARCH-restricted rock-testing-$ARCH-non-free
Rolling system:
sudo dnf config-manager --enable rolling-testing-$ARCH rolling-testing-$ARCH-unsupported rolling-testing-$ARCH-restricted rolling-testing-$ARCH-non-free
To disable simply replace --enable with --disable.
Package Testing with Kahinah
Now that your system is set up, it's time to vote for the packages. Do they work? Are there really bad issues?
We use a system called Kahinah, which uses voting to determine which packages to push to the stable repository or not.
First, login to Kahinah. This uses your Github login.
You can see what packages are waiting to be tested in 'Recent Builds'. Give it a thumbs up or thumbs down, and let us know why.
The current procedure is that packages require 3 'Accept' votes to move forward, unless there are any 'Reject' votes. If there is even one 'Reject' vote it should be questioned and discussed before moving packages. Also packages that get stuck in Kahinah with no votes for over 7 days can be moved due to QA inaction. Discussion about this takes place on Freenode IRC channel #openmandriva-cooker.
Testing new Alpha/Beta/RC ISOs
This is discussed [here]: OpenMandriva_Release_QA
Triaging New Bugs with Bugzilla
This process is in development at this time. (We need to implement something for triaging bug reports.)