|
| 1 | +--- |
| 2 | +name: Regression checklist |
| 3 | +about: Checklist for smoke testing of release build |
| 4 | +title: '' |
| 5 | +labels: qa |
| 6 | +assignees: '' |
| 7 | +--- |
| 8 | + |
| 9 | +Get build from this run - https://github.com/UnitTestBot/UTBotCpp/actions/workflows/publish-utbot.yml |
| 10 | + |
| 11 | +Setup dedicated server according to following manual - https://github.com/UnitTestBot/UTBotCpp/wiki/install-server |
| 12 | +Setup local server according to following manual - https://github.com/UnitTestBot/UTBotCpp/wiki/docker-free-wsl2 |
| 13 | + |
| 14 | +_**Delete project folders with sample project on remote and local server if they are left from previous test runs.**_ |
| 15 | + |
| 16 | +VSCode: |
| 17 | +- [ ] Install plugin (`Ctrl-Shift-P` - `Extensions: Install plugin from VSIX`) |
| 18 | +- [ ] Verify version on plugin page (`Ctrl-Shift-X` search for `@installed unittestbot`) |
| 19 | + |
| 20 | +- [ ] Open folder with unpacked attached sample project - UnitTestBot Wizard should be started |
| 21 | +- [ ] SFTP and Sarif Viewer plugins are marked as installed on first page of the Wizard |
| 22 | +- [ ] On Server configuration check that both local and server connection could be established. |
| 23 | +- [ ] When cannot connect proper error should be shown |
| 24 | +- [ ] Connect to remote server and complete the wizard - build folder created, project configured |
| 25 | + |
| 26 | + |
| 27 | +- [ ] Open `lib\calc.c` file, generate tests for `div(int a, int b)` function - tests are generated, Sarif report is opened |
| 28 | +- [ ] Run only one test - `regression` tests pass, `error` tests fails, coverage shown in `calc.c` file. |
| 29 | +- [ ] Run all generated tests in test file - `regression` tests pass, `error` tests fails, coverage shown in `calc.c` file. |
| 30 | + |
| 31 | + |
| 32 | +- [ ] Generate and run tests for items listed below. Before the test remove `tests` folder. After test verify proper number of tests files appeared and run one of them. |
| 33 | + - [ ] File `lib\str_utils.c` |
| 34 | + - [ ] Folder `src` |
| 35 | + - [ ] Project |
| 36 | + |
| 37 | +- [ ] Verbose |
| 38 | + - [ ] On |
| 39 | + - [ ] Off |
| 40 | + |
| 41 | +- [ ] Log windows (writing to log could be unstable - see #430) |
| 42 | + - [ ] UTBot: Client Log |
| 43 | + - [ ] UTBot: Server Log |
| 44 | + - [ ] UTBot: Test console |
| 45 | + |
| 46 | +- [ ] Open UTBot Explorer (at left pane) |
| 47 | +- [ ] [Target window](https://github.com/UnitTestBot/UTBotCpp/wiki/targets) |
| 48 | +- [ ] Source Code window |
| 49 | + |
| 50 | +- [ ] CLion plugin - do simple test - install plugin - configure to work with local server generate and run some test. Additionally verifying that coverage is generated. |
0 commit comments