Version 5, last updated by henrikau at May 03, 2010 UTC
Test-cases before releasing a new version
For each release (starting with v0.4), a set of tests will be performed before the final release is tagged. The list should be formatted as a test-matrix (use the numbering to make the table more compact), and only when everything is green should a new release be tagged and released.
Normal operations for each type of user (NREN-admin, Subscriber-admin, subscriber-subadmin, user)
1. User:
- Create new certificate (CSR paste, CSR upload, browser signing)
- Listing of certificates (are all ordered and valid certs listed, can they be inspected etc.)
- Download and mail reception of certificates
- Revoke certificate
2. NREN-Admin:
- Mass revoke
- Settings (need sublevels on this)
- Manage admins
- Manage Subscribers
- Map
3. Subscriber Admin:
- RI, upload cert
- RI, list certs
- Manage admins
- Revoke certs
- Map
4. Notification logic
- Does the new-cert mail work as expected
- Content of notification mail (the template) work properly
- Severe warnings sent via email to operations
- Help-info for subscribers displayed properly to users
5. Robotic Interface
- library works as expected
- Correct list of issued certificates are returned
- Revocation works
6. Nagios and self-diagnosis:
- Testcases cover everything (include list of nagios-tests performed)
- Reset severe warnings
7. Does installation work seamlessly?
- Are all config options and DB tables covered in the installation scripts?
- If possible, test to deploy an instance of the new Confusa version from scratch, for instance in a Virtual machine.
8. Are all pages displayed as inteded? (including all subpages, substates etc). Test for supported browsers to catch xhtml-oddities.
- User is not authenticated
- User is authenticated.