-
Notifications
You must be signed in to change notification settings - Fork 253
Closed
Description
The OSAL tests (in the "tests" directory, NOT "unit-test") provide reasonable "black-box" style testing of the OSAL features via the public API. However they are currently implemented with the expectation of being explicitly run by a user at the console, not from an automated script:
- Most run infinitely, requiring a CTRL+C to stop the test
- They do not count errors or provide a status code to indicate whether the test worked as expected or not.
In order to integrate with a continuous integration system, these tests need to be more automated.
This ticket is to add a "script-mode" feature to the tests which:
- Checks for the expected conditions and maintains an error counter of any tests that did not satisfy expected conditions
- Limits the time of execution and exits the test automatically (no CTRL+C)
- Returns a non-zero exit code if any errors occurred (for scripting)
(Note: this does not apply to the "unit-tests" directory which is more white-box style code coverage testing -- this will possibly need other tweaks to work with a CI system and that is a separate ticket)
Reactions are currently unavailable