Skip to content

Conversation

@jkleinsc
Copy link
Member

@jkleinsc jkleinsc commented Aug 28, 2025

Description of Change

  • This PR was inspired by a conversation with @reitowo. It adds logic to rerun failed tests individually. This should help avoid having to do full reruns of test suites when flakes happen.

  • Additionally, this PR fixes a CI issue where a macOS system dialog was appearing with the following text which broke/interfered with some of our tests:

"bash" is requesting to bypass the system private window picker and directly access your screen and audio.

Checklist

Release Notes

Notes: none

@jkleinsc jkleinsc changed the title test: put junit results into test artifacts test: rerun failed tests individually Aug 29, 2025
@socket-security
Copy link

socket-security bot commented Sep 2, 2025

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Added@​xmldom/​xmldom@​0.8.1110010010087100

View full report

@socket-security
Copy link

socket-security bot commented Sep 2, 2025

All alerts resolved. Learn more about Socket for GitHub.

This PR previously contained dependency changes with security issues that have been resolved, removed, or ignored.

View full report

@jkleinsc jkleinsc force-pushed the rerun-failed-tests branch 3 times, most recently from 536b059 to 307b598 Compare September 11, 2025 19:48
@jkleinsc jkleinsc force-pushed the rerun-failed-tests branch 2 times, most recently from 8d3d043 to 0ee88e2 Compare September 12, 2025 18:19
@jkleinsc jkleinsc added target/36-x-y PR should also be added to the "36-x-y" branch. target/37-x-y PR should also be added to the "37-x-y" branch. target/38-x-y PR should also be added to the "38-x-y" branch. target/39-x-y PR should also be added to the "39-x-y" branch. labels Sep 12, 2025
@jkleinsc jkleinsc marked this pull request as ready for review September 12, 2025 18:41
@jkleinsc jkleinsc requested a review from a team as a code owner September 12, 2025 18:41
Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.
No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.
@reitowo
Copy link
Member

reitowo commented Sep 16, 2025

I thought I could see this PR in action right in this CI, but find out it actually all passed at first time! XD

@ckerr
Copy link
Member

ckerr commented Sep 19, 2025

@electron/wg-infra could this get a review? #48291 is still causing a lot of CI failures

@trop
Copy link
Contributor

trop bot commented Sep 25, 2025

@jkleinsc has manually backported this PR to "38-x-y", please check out #48387

@trop
Copy link
Contributor

trop bot commented Sep 25, 2025

@jkleinsc has manually backported this PR to "37-x-y", please check out #48390

jkleinsc added a commit that referenced this pull request Sep 26, 2025
test: rerun failed tests individually (#48205)

* test: rerun failed tests individually

* ci: use screencapture-nag-remover

Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.

* Revert "chore: test with 1st quadrant of the window"

No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.

* test: fixup navigationHistory flake

* rerun test up to 3 times
@trop trop bot added merged/39-x-y PR was merged to the "39-x-y" branch. merged/37-x-y PR was merged to the "37-x-y" branch. and removed in-flight/39-x-y in-flight/37-x-y labels Sep 26, 2025
@trop
Copy link
Contributor

trop bot commented Sep 26, 2025

@jkleinsc has manually backported this PR to "36-x-y", please check out #48397

@trop trop bot added in-flight/36-x-y merged/38-x-y PR was merged to the "38-x-y" branch. and removed needs-manual-bp/36-x-y in-flight/38-x-y labels Sep 26, 2025
kigh-ota pushed a commit to kigh-ota/electron that referenced this pull request Sep 30, 2025
* test: rerun failed tests individually

* ci: use screencapture-nag-remover

Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.

* Revert "chore: test with 1st quadrant of the window"

No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.

* test: fixup navigationHistory flake

* rerun test up to 3 times
@trop trop bot added merged/36-x-y PR was merged to the "36-x-y" branch. and removed in-flight/36-x-y labels Oct 6, 2025
TheCommieAxolotl pushed a commit to TheCommieAxolotl/electron that referenced this pull request Nov 2, 2025
* test: rerun failed tests individually

* ci: use screencapture-nag-remover

Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.

* Revert "chore: test with 1st quadrant of the window"

No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.

* test: fixup navigationHistory flake

* rerun test up to 3 times
nilayarya pushed a commit to nilayarya/electron that referenced this pull request Nov 21, 2025
* test: rerun failed tests individually

* ci: use screencapture-nag-remover

Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.

* Revert "chore: test with 1st quadrant of the window"

No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.

* test: fixup navigationHistory flake

* rerun test up to 3 times
nilayarya added a commit to nilayarya/electron that referenced this pull request Nov 21, 2025
* test: rerun failed tests individually

* ci: use screencapture-nag-remover

Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.

* Revert "chore: test with 1st quadrant of the window"

No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.

* test: fixup navigationHistory flake

* rerun test up to 3 times
nilayarya added a commit to nilayarya/electron that referenced this pull request Nov 21, 2025
* test: rerun failed tests individually

* ci: use screencapture-nag-remover

Needed to bypass the popup message "bash" is requesting to bypass the system private window picker and directly access your screen and audio.

* Revert "chore: test with 1st quadrant of the window"

No longer needed because of the addition of the
screencapture-nag-remover script.

This reverts commit f4a7e04.

* test: fixup navigationHistory flake

* rerun test up to 3 times
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

merged/36-x-y PR was merged to the "36-x-y" branch. merged/37-x-y PR was merged to the "37-x-y" branch. merged/38-x-y PR was merged to the "38-x-y" branch. merged/39-x-y PR was merged to the "39-x-y" branch. semver/none

Projects

None yet

7 participants