Skip to content

CDRIVER-3422 add unified test setup/teardown #699

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Dec 4, 2020

Conversation

kevinAlbs
Copy link
Collaborator

@kevinAlbs kevinAlbs commented Nov 29, 2020

This is part 2 of unified test runner:

  • Model the "Test Runner", "Test File", and "Test" types described in the spec.
  • Add runOnRequirement checking
  • Add initialData handling

Next up: creating and tearing down the entity map for each test.

@kevinAlbs kevinAlbs changed the title WIP Unified test runner CDRIVER-3422 Unified test runner test setup/teardown Nov 30, 2020
@kevinAlbs kevinAlbs changed the title CDRIVER-3422 Unified test runner test setup/teardown CDRIVER-3422 unified test setup/teardown Nov 30, 2020
@kevinAlbs kevinAlbs changed the title CDRIVER-3422 unified test setup/teardown CDRIVER-3422 add unified test setup/teardown Nov 30, 2020
test_runner_t *test_runner;
test_file_t *test_file;
test_t *test;
} test_diagnostics;
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not yet clear to me whether this is useful. The spec recommends not aborting while a test is running so server state can be cleaned up:

If at any point while executing this test an unexpected error is encountered or an assertion fails, the test runner MUST consider this test to have failed and SHOULD continue with the instructions in this section to ensure that the test environment is cleaned up (e.g. disable fail points, kill sessions) while also forgoing any additional assertions.

I plan to havetest_run return an error instead of aborting when something within the test fails. So, if that means the signal handler diagnostics is not useful, I may remove it later.

@kevinAlbs kevinAlbs marked this pull request as ready for review November 30, 2020 14:50
Copy link
Contributor

@bazile-clyde bazile-clyde left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@kevinAlbs kevinAlbs merged commit d677bbb into mongodb:master Dec 4, 2020
chardan pushed a commit to chardan/mongo-c-driver that referenced this pull request Aug 26, 2021
Tweak make_release.py
- add requirements.txt for dependencies
- add --skip-distcheck option
- fail if running on Python 2
- fix some pylint errors
- refactor running shell script
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants