Skip to content

Disable some Windows tests that are flaking on CI#189477

Merged
auto-submit[bot] merged 2 commits into
flutter:masterfrom
jason-simmons:bug_177172_disable_tests
Jul 15, 2026
Merged

Disable some Windows tests that are flaking on CI#189477
auto-submit[bot] merged 2 commits into
flutter:masterfrom
jason-simmons:bug_177172_disable_tests

Conversation

@jason-simmons

Copy link
Copy Markdown
Member

See #177172

@jason-simmons
jason-simmons requested a review from jtmcdole July 14, 2026 22:19
@jason-simmons
jason-simmons marked this pull request as ready for review July 14, 2026 22:20
@jason-simmons
jason-simmons requested a review from a team as a code owner July 14, 2026 22:20

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request disables the TooltipWindowUpdatesPositionOnViewSizeChange and PopupWindowUpdatesPositionOnViewSizeChange unit tests on Windows. The feedback recommends adding TODO comments with links to tracking issues for both disabled tests to ensure they are addressed in the future.

Comment on lines +628 to +629
TEST_F(WindowManagerTest,
DISABLED_TooltipWindowUpdatesPositionOnViewSizeChange) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

When disabling a test, it is best practice to add a TODO comment referencing the tracking issue. This ensures the test is not permanently forgotten and provides context on why it was disabled.

Suggested change
TEST_F(WindowManagerTest,
DISABLED_TooltipWindowUpdatesPositionOnViewSizeChange) {
// TODO(https://github.com/flutter/flutter/issues/177172): Flaky on Windows.
TEST_F(WindowManagerTest,
DISABLED_TooltipWindowUpdatesPositionOnViewSizeChange) {
References
  1. Documentation should be useful: Explain the why and the how. (link)

@loic-sharma loic-sharma Jul 14, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
TEST_F(WindowManagerTest,
DISABLED_TooltipWindowUpdatesPositionOnViewSizeChange) {
// TODO(team-windows): Flaky:
// https://github.com/flutter/flutter/issues/177172
TEST_F(WindowManagerTest,
DISABLED_TooltipWindowUpdatesPositionOnViewSizeChange) {

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

}

TEST_F(WindowManagerTest, PopupWindowUpdatesPositionOnViewSizeChange) {
TEST_F(WindowManagerTest, DISABLED_PopupWindowUpdatesPositionOnViewSizeChange) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

When disabling a test, it is best practice to add a TODO comment referencing the tracking issue. This ensures the test is not permanently forgotten and provides context on why it was disabled.

Suggested change
TEST_F(WindowManagerTest, DISABLED_PopupWindowUpdatesPositionOnViewSizeChange) {
// TODO(https://github.com/flutter/flutter/issues/177172): Flaky on Windows.
TEST_F(WindowManagerTest, DISABLED_PopupWindowUpdatesPositionOnViewSizeChange) {
References
  1. Documentation should be useful: Explain the why and the how. (link)

@loic-sharma loic-sharma Jul 14, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or alternative:

Suggested change
TEST_F(WindowManagerTest, DISABLED_PopupWindowUpdatesPositionOnViewSizeChange) {
// TODO(team-windows): Flaky. See:
// https://github.com/flutter/flutter/issues/177172
TEST_F(WindowManagerTest, DISABLED_PopupWindowUpdatesPositionOnViewSizeChange) {

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

@loic-sharma
loic-sharma requested a review from mattkae July 14, 2026 22:31
loic-sharma
loic-sharma previously approved these changes Jul 14, 2026

@loic-sharma loic-sharma left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but please add links to the tracking issue so that it's easier to remember why we had to disable these tests :)

@loic-sharma loic-sharma added the CICD Run CI/CD label Jul 14, 2026
@jason-simmons jason-simmons added the autosubmit Merge PR when tree becomes green via auto submit App label Jul 14, 2026
@github-actions github-actions Bot added engine flutter/engine related. See also e: labels. platform-windows Building on or for Windows specifically a: desktop Running on desktop team-windows Owned by the Windows platform team labels Jul 14, 2026
@auto-submit auto-submit Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Jul 14, 2026
@auto-submit

auto-submit Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

autosubmit label was removed for flutter/flutter/189477, because - The status or check suite Google testing has failed. Please fix the issues identified (or deflake) before re-applying this label.

@jason-simmons jason-simmons added the autosubmit Merge PR when tree becomes green via auto submit App label Jul 15, 2026
@auto-submit
auto-submit Bot added this pull request to the merge queue Jul 15, 2026
Merged via the queue into flutter:master with commit b683af3 Jul 15, 2026
214 of 215 checks passed
@flutter-dashboard flutter-dashboard Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Jul 15, 2026
auto-submit Bot pushed a commit to flutter/packages that referenced this pull request Jul 15, 2026
flutter/flutter@846664b...fc1ad95

2026-07-15 [email protected] [iOS] Migrate FlutterKeyboardInsetManager to Swift (flutter/flutter#189425)
2026-07-15 [email protected] Roll Dart SDK from 05bf153370c4 to 0c408ff6dce9 (4 revisions) (flutter/flutter#189487)
2026-07-15 [email protected] Implement UberSDF lines to replace LineContents-based AA lines (flutter/flutter#188514)
2026-07-15 [email protected] Fix stale eagerWinner reference in GestureArenaManager when rejected before arena close (flutter/flutter#187008)
2026-07-15 [email protected] Disable some Windows tests that are flaking on CI (flutter/flutter#189477)
2026-07-15 dmgr Added unified check-run user manual (flutter/flutter#189453)
2026-07-15 [email protected] Roll Skia from 88954ef8f36d to ab2410bc857c (9 revisions) (flutter/flutter#189474)
2026-07-14 [email protected] [agents] Refactor shepherd-prs skill into a pure Markdown runbook using native gh CLI (flutter/flutter#189095)
2026-07-14 [email protected] Add missing name to mirroring workflow (flutter/flutter#189439)
2026-07-14 [email protected] Add support for WASM deferred loading. (flutter/flutter#189308)
2026-07-14 [email protected] fix `templateDefaultGradleVersion` todo (flutter/flutter#189466)
2026-07-14 [email protected] Roll Fuchsia Linux SDK from oOETA0ISPouDt2xBo... to lLFbh5kFWbUGgC9Ek... (flutter/flutter#189469)
2026-07-14 [email protected] Use ServicesBinding.instance.exitApplication instead of exit(0) in multiple_windows example (flutter/flutter#189364)
2026-07-14 [email protected] Add CpuArch to the Device class (flutter/flutter#189207)
2026-07-14 [email protected] Fix space formatting in cherry-pick label for flutter_cp.dart (flutter/flutter#189463)
2026-07-14 [email protected] Roll pub packages (flutter/flutter#189454)
2026-07-14 [email protected] [flutter_tools] Format plugin example template to match dart format (flutter/flutter#188382)
2026-07-14 [email protected] Move renamed x64->ARM benchmarks out of bringup (flutter/flutter#189400)

If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-packages
Please CC [email protected],[email protected] on the revert to ensure that a human
is aware of the problem.

To file a bug in Packages: https://github.com/flutter/flutter/issues/new/choose

To report a problem with the AutoRoller itself, please file a bug:
https://issues.skia.org/issues/new?component=1389291&template=1850622

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

a: desktop Running on desktop CICD Run CI/CD engine flutter/engine related. See also e: labels. platform-windows Building on or for Windows specifically team-windows Owned by the Windows platform team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants