Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split performance measurements from unit tests #35

Open
2 tasks
JamieJQuinn opened this issue Feb 12, 2024 · 1 comment
Open
2 tasks

Split performance measurements from unit tests #35

JamieJQuinn opened this issue Feb 12, 2024 · 1 comment
Assignees
Labels
priority medium Medium priority issue test To do with the unit test and CI

Comments

@JamieJQuinn
Copy link
Collaborator

Currently performance measurements are performed at the end of some unit tests. These slow down the testing cycle and can be pulled out into their own subroutines. This will additionally help identify some common setup code that can be refectored out.

We also need:

  • A way to tag tests so a user can run only the unit/performance test
  • A way of regularly running performance tests to check for perf regression
@Nanoseb Nanoseb added the test To do with the unit test and CI label Feb 16, 2024
@semi-h
Copy link
Member

semi-h commented Feb 19, 2024

How about running the same set of test programs with an optional argument such as --perf so that when the argument is present the test program calls the subroutine being tested in a loop say a 100 times and reports the performance?

I'm not actually sure how to enable this in ctests or whether if this is possible or not, but if we add this optional argument and loop over the call many times if the argument is present, we can at least do performance tests by hand.

@JamieJQuinn JamieJQuinn self-assigned this Feb 26, 2024
@JamieJQuinn JamieJQuinn added the priority medium Medium priority issue label Feb 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority medium Medium priority issue test To do with the unit test and CI
Projects
None yet
Development

No branches or pull requests

3 participants