Skip to content

Added a flag to run additional tests for additional tests#815

Merged
PingXie merged 6 commits intovalkey-io:unstablefrom
madolson:label_with_tests
Jul 23, 2024
Merged

Added a flag to run additional tests for additional tests#815
PingXie merged 6 commits intovalkey-io:unstablefrom
madolson:label_with_tests

Conversation

@madolson
Copy link
Member

This PR allows running a subset of the daily tests with a PR by attaching the run-extra-tests flag. This is done by conditionally running the daily tests when the label is attached. (I will do that for this PR to demonstrate).

One downside of this PR is that a lot of tests will forever show-up as "skipped" for most PRs, as long as that doesn't bother us it should be OK. Skipped tests don't take up any of our runner compute.

Another note, if the label isn't attached on the first commit, the submitter will need to push something to get the tests to run again. There is a way to make it kick off tests during a label, but that added a bunch more complexity so just wanted to start with this.

@madolson madolson added the run-extra-tests Run extra tests on this PR (Runs all tests from daily except valgrind and RESP) label Jul 22, 2024
madolson added 3 commits July 22, 2024 16:11
Signed-off-by: Madelyn Olson <[email protected]>
Signed-off-by: Madelyn Olson <[email protected]>
Signed-off-by: Madelyn Olson <[email protected]>
@madolson madolson requested review from PingXie and naglera July 22, 2024 23:18
@madolson madolson assigned ranshid and unassigned ranshid Jul 22, 2024
@madolson madolson requested a review from ranshid July 22, 2024 23:20
@codecov
Copy link

codecov bot commented Jul 22, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.31%. Comparing base (14e09e9) to head (cedbe86).

Additional details and impacted files
@@             Coverage Diff              @@
##           unstable     #815      +/-   ##
============================================
- Coverage     70.36%   70.31%   -0.06%     
============================================
  Files           112      112              
  Lines         61275    61275              
============================================
- Hits          43115    43084      -31     
- Misses        18160    18191      +31     

see 10 files with indirect coverage changes

@PingXie PingXie merged commit ccafbb7 into valkey-io:unstable Jul 23, 2024
hwware pushed a commit to hwware/valkey that referenced this pull request Jul 25, 2024
)

This PR allows running a subset of the daily tests with a PR by
attaching the `run-extra-tests` flag. This is done by conditionally
running the daily tests when the label is attached. (I will do that for
this PR to demonstrate).

One downside of this PR is that a lot of tests will forever show-up as
"skipped" for most PRs, as long as that doesn't bother us it should be
OK. Skipped tests don't take up any of our runner compute.

Another note, if the label isn't attached on the first commit, the
submitter will need to push something to get the tests to run again.
There is a way to make it kick off tests during a label, but that added
a bunch more complexity so just wanted to start with this.

---------

Signed-off-by: Madelyn Olson <[email protected]>
@roshkhatri roshkhatri moved this to To be backported in Valkey 7.2 Nov 5, 2025
dmitrypol pushed a commit to dmitrypol/valkey that referenced this pull request Nov 6, 2025
@roshkhatri roshkhatri moved this from To be backported to 7.2.12 in Valkey 7.2 Jan 30, 2026
roshkhatri pushed a commit to roshkhatri/valkey that referenced this pull request Jan 30, 2026
)

This PR allows running a subset of the daily tests with a PR by
attaching the `run-extra-tests` flag. This is done by conditionally
running the daily tests when the label is attached. (I will do that for
this PR to demonstrate).

One downside of this PR is that a lot of tests will forever show-up as
"skipped" for most PRs, as long as that doesn't bother us it should be
OK. Skipped tests don't take up any of our runner compute.

Another note, if the label isn't attached on the first commit, the
submitter will need to push something to get the tests to run again.
There is a way to make it kick off tests during a label, but that added
a bunch more complexity so just wanted to start with this.

---------

Signed-off-by: Madelyn Olson <[email protected]>
roshkhatri pushed a commit to roshkhatri/valkey that referenced this pull request Jan 30, 2026
)

This PR allows running a subset of the daily tests with a PR by
attaching the `run-extra-tests` flag. This is done by conditionally
running the daily tests when the label is attached. (I will do that for
this PR to demonstrate).

One downside of this PR is that a lot of tests will forever show-up as
"skipped" for most PRs, as long as that doesn't bother us it should be
OK. Skipped tests don't take up any of our runner compute.

Another note, if the label isn't attached on the first commit, the
submitter will need to push something to get the tests to run again.
There is a way to make it kick off tests during a label, but that added
a bunch more complexity so just wanted to start with this.

---------

Signed-off-by: Madelyn Olson <[email protected]>
Signed-off-by: Roshan Khatri <[email protected]>
roshkhatri pushed a commit to roshkhatri/valkey that referenced this pull request Feb 19, 2026
)

This PR allows running a subset of the daily tests with a PR by
attaching the `run-extra-tests` flag. This is done by conditionally
running the daily tests when the label is attached. (I will do that for
this PR to demonstrate).

One downside of this PR is that a lot of tests will forever show-up as
"skipped" for most PRs, as long as that doesn't bother us it should be
OK. Skipped tests don't take up any of our runner compute.

Another note, if the label isn't attached on the first commit, the
submitter will need to push something to get the tests to run again.
There is a way to make it kick off tests during a label, but that added
a bunch more complexity so just wanted to start with this.

---------

Signed-off-by: Madelyn Olson <[email protected]>
Signed-off-by: Roshan Khatri <[email protected]>
hpatro pushed a commit that referenced this pull request Feb 24, 2026
This PR allows running a subset of the daily tests with a PR by
attaching the `run-extra-tests` flag. This is done by conditionally
running the daily tests when the label is attached. (I will do that for
this PR to demonstrate).

One downside of this PR is that a lot of tests will forever show-up as
"skipped" for most PRs, as long as that doesn't bother us it should be
OK. Skipped tests don't take up any of our runner compute.

Another note, if the label isn't attached on the first commit, the
submitter will need to push something to get the tests to run again.
There is a way to make it kick off tests during a label, but that added
a bunch more complexity so just wanted to start with this.

---------

Signed-off-by: Madelyn Olson <[email protected]>
Signed-off-by: Roshan Khatri <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-extra-tests Run extra tests on this PR (Runs all tests from daily except valgrind and RESP)

Projects

Status: 7.2.12 WIP

Development

Successfully merging this pull request may close these issues.

3 participants