Skip to content

[Testing] Enqued test that was never completed should be shown as skipped, not as the last result #272888

@Skn0tt

Description

@Skn0tt

Does this issue occur when all extensions are disabled?: No

  • VS Code Version: 8fd821a
  • OS Version: macOS 26.0.1

Steps to Reproduce:

  1. Have a Test Provider that provides two tests A and B.
  2. Start a test run and mark both tests as passed.
  3. Start another test run and do: testRun.enqueued(A); testRun.enqueued(B); testRun.passed(B); testRun.end();

Expected Behaviour: The user can tell from the UI that test A was never completed.

Actual Behaviour:
You'll see how both A and B switch to the "enqueued" icon, and then both switch to the "passed" icon. To the user, this looks like both tests were executed and both tests are green.

The reason for this is that:

This is a footgun, because a buggy test extension that forgets executing or recording a test result will produce false negatives. Extensions can work around this by tracking unfinished tests themselves, and marking them as skipped before ending the test run.

Metadata

Metadata

Assignees

Labels

bugIssue identified by VS Code Team member as probable buginsiders-releasedPatch has been released in VS Code InsiderstestingBuilt-in testing supportverifiedVerification succeeded

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions