Skip to content

Commit 8c61f7e

Browse files
ladisginNypiaka
authored andcommitted
Add regression checklist template (#589)
1 parent 2dc0309 commit 8c61f7e

File tree

1 file changed

+50
-0
lines changed

1 file changed

+50
-0
lines changed
Lines changed: 50 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,50 @@
1+
---
2+
name: Regression checklist
3+
about: Checklist for smoke testing of release build
4+
title: ''
5+
labels: qa
6+
assignees: ''
7+
---
8+
9+
Get build from this run - https://github.com/UnitTestBot/UTBotCpp/actions/workflows/publish-utbot.yml
10+
11+
Setup dedicated server according to following manual - https://github.com/UnitTestBot/UTBotCpp/wiki/install-server
12+
Setup local server according to following manual - https://github.com/UnitTestBot/UTBotCpp/wiki/docker-free-wsl2
13+
14+
_**Delete project folders with sample project on remote and local server if they are left from previous test runs.**_
15+
16+
VSCode:
17+
- [ ] Install plugin (`Ctrl-Shift-P` - `Extensions: Install plugin from VSIX`)
18+
- [ ] Verify version on plugin page (`Ctrl-Shift-X` search for `@installed unittestbot`)
19+
20+
- [ ] Open folder with unpacked attached sample project - UnitTestBot Wizard should be started
21+
- [ ] SFTP and Sarif Viewer plugins are marked as installed on first page of the Wizard
22+
- [ ] On Server configuration check that both local and server connection could be established.
23+
- [ ] When cannot connect proper error should be shown
24+
- [ ] Connect to remote server and complete the wizard - build folder created, project configured
25+
26+
27+
- [ ] Open `lib\calc.c` file, generate tests for `div(int a, int b)` function - tests are generated, Sarif report is opened
28+
- [ ] Run only one test - `regression` tests pass, `error` tests fails, coverage shown in `calc.c` file.
29+
- [ ] Run all generated tests in test file - `regression` tests pass, `error` tests fails, coverage shown in `calc.c` file.
30+
31+
32+
- [ ] Generate and run tests for items listed below. Before the test remove `tests` folder. After test verify proper number of tests files appeared and run one of them.
33+
- [ ] File `lib\str_utils.c`
34+
- [ ] Folder `src`
35+
- [ ] Project
36+
37+
- [ ] Verbose
38+
- [ ] On
39+
- [ ] Off
40+
41+
- [ ] Log windows (writing to log could be unstable - see #430)
42+
- [ ] UTBot: Client Log
43+
- [ ] UTBot: Server Log
44+
- [ ] UTBot: Test console
45+
46+
- [ ] Open UTBot Explorer (at left pane)
47+
- [ ] [Target window](https://github.com/UnitTestBot/UTBotCpp/wiki/targets)
48+
- [ ] Source Code window
49+
50+
- [ ] CLion plugin - do simple test - install plugin - configure to work with local server generate and run some test. Additionally verifying that coverage is generated.

0 commit comments

Comments
 (0)