Mac_arm64 tool_tests_commands is 3.03% flaky

The post-submit test builder Mac_arm64 tool_tests_commands had a flaky ratio 3.03% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13479
Commit: d61fad3

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13479
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13448
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13447
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13446
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13445
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13444
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13402

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_arm64%20tool_tests_commands

Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Most of these are:

Failing tests:
  /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade Doesn't throw on known tag, beta branch, no force
  /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade does not throw on unknown tag, official branch, force
  /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade does not throw tool exit with uncommitted changes and force
  /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade full command upgrade continue prints welcome message

One of these:

Failing tests:
  /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/hermetic/widget_preview/preview_detector/preview_detector_test.dart: PreviewDetector can detect changes in the pubspec.yaml

And one of these:

Failing tests:
  /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/hermetic/widget_preview/preview_detector/preview_detector_workspace_test.dart: PreviewDetector - Workspace can detect changes in a subproject's pubspec.yaml

Waiting on the bot to report back this Wednesday.

[prod pool] flaky ratio for the past (up to) 100 commits between 2026-07-29 and 2026-08-04 is 0.00%. Flaky number: 0; total number: 99.

Looks like this is better

[prod pool] flaky ratio for the past (up to) 100 commits between 2026-08-05 and 2026-08-11 is 1.01%. Flaky number: 1; total number: 99.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13814
Commit: 1cd7c6b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13814

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_arm64%20tool_tests_commands

I see two "Command exited with exit code 1 but expected zero exit code." in the last 100 post submits.

 25:46 +908 ~4 -1: /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/hermetic/widget_preview/preview_detector/preview_detector_test.dart: PreviewDetector can detect changes in the pubspec.yaml [E]
   TimeoutException after 0:15:00.000000: Test timed out after 15 minutes.
   dart:isolate  _RawReceivePort._handleMessage

[prod pool] flaky ratio for the past (up to) 100 commits between 2026-08-12 and 2026-08-18 is 0.00%. Flaky number: 0; total number: 100.

Looks like there is a PR out, and even better, we are not seeing flakes last week.

[flutter_tools] Resolve symlinks and fix flakiness in widget preview …

This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

Navigation Menu

Repository navigation

Mac_arm64 tool_tests_commands is 3.03% flaky #189849

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Mac_arm64 tool_tests_commands is 3.03% flaky #189849

Description

Activity

Piinks commented on Jul 27, 2026

Piinks commented on Aug 3, 2026

fluttergithubbot commented on Aug 5, 2026

Piinks commented on Aug 10, 2026

fluttergithubbot commented on Aug 12, 2026

jtmcdole commented on Aug 12, 2026

fluttergithubbot commented on Aug 19, 2026

Piinks commented on Aug 24, 2026

github-actions commented on Sep 8, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions