Skip to content

Modify analyze.dart to have flags to run only or exclude each verification step. #185618

Merged
auto-submit[bot] merged 3 commits into
flutter:masterfrom
reidbaker:r-break-out-analyze-steps-into-individual-flags
Apr 27, 2026
Merged

Modify analyze.dart to have flags to run only or exclude each verification step. #185618
auto-submit[bot] merged 3 commits into
flutter:masterfrom
reidbaker:r-break-out-analyze-steps-into-individual-flags

Conversation

@reidbaker

@reidbaker reidbaker commented Apr 27, 2026

Copy link
Copy Markdown
Contributor

Default behavior should be unchanged for backwards compatibility.
Added a Verification class for each verification step with a name that can be passed to new flags.
New flags allow you to run only a subset or to exclude slow analyze steps.
New help flag that describes how to use the analyze.dart code.
Broke out the 2 inline verification steps into new methods.

AI: Assisted pr, antigravity, dragonally

Pre-launch Checklist

- Added `-h`/`--help` flag to `dev/bots/analyze.dart` to print usage instructions and list all available validation rules.
- Refactored `_Validation` to be public as `Validation` and annotated it with `@visibleForTesting`.
- Parameterized the `run` function in `analyze.dart` to accept an optional list of validations for testing.
- Added comprehensive unit tests in `dev/bots/test/analyze_test.dart` for `--only`, `--skip`, and the new help flag.
- Added a runtime check in `analyze.dart` to ensure all validation names are unique and error out if duplicates are found.
- Extracted the closures for `private-lints` and `mega-gallery` into their own private methods to clean up the main `run` function.
- Addressed associated lints and verified that analysis and formatting are clean.
@github-actions github-actions Bot added the f: material design flutter/packages/flutter/material repository. label Apr 27, 2026
@reidbaker reidbaker added the CICD Run CI/CD label Apr 27, 2026
@github-actions github-actions Bot removed f: material design flutter/packages/flutter/material repository. CICD Run CI/CD labels Apr 27, 2026
@reidbaker reidbaker added the CICD Run CI/CD label Apr 27, 2026
@reidbaker
reidbaker marked this pull request as ready for review April 27, 2026 14:48

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors dev/bots/analyze.dart by introducing a Validation class to structure analysis steps, enabling the use of --only and --skip flags to filter execution. It also adds a help message and corresponding unit tests in dev/bots/test/analyze_test.dart. Feedback suggests refactoring the large validation list into a helper method to improve readability, updating the argument parsing to allow multiple filtering flags by appending values, and restoring documentation and safety checks for private lints that were lost during refactoring.

Comment thread dev/bots/analyze.dart Outdated
Comment thread dev/bots/analyze.dart
Comment thread dev/bots/analyze.dart Outdated
@github-actions github-actions Bot removed the CICD Run CI/CD label Apr 27, 2026
@reidbaker reidbaker added the CICD Run CI/CD label Apr 27, 2026

@eyebrowsoffire eyebrowsoffire left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@reidbaker reidbaker added the autosubmit Merge PR when tree becomes green via auto submit App label Apr 27, 2026
@auto-submit
auto-submit Bot added this pull request to the merge queue Apr 27, 2026
Merged via the queue into flutter:master with commit e18e011 Apr 27, 2026
168 checks passed
@flutter-dashboard flutter-dashboard Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Apr 27, 2026
auto-submit Bot pushed a commit to flutter/packages that referenced this pull request Apr 28, 2026
…11595)

Manual roll Flutter from 31001886cbe8 to 61fca76dd523 (53 revisions)

Manual roll requested by [email protected]

flutter/flutter@3100188...61fca76

2026-04-27 [email protected] Adds integration test for the FLTEnableSDFs flag for iOS (flutter/flutter#185637)
2026-04-27 [email protected] Fix sdfs being enabled for MacOS regardless of FLTEnableSDFs value (flutter/flutter#185565)
2026-04-27 [email protected] Don't use UberSDF for paint with incompatible blend modes (flutter/flutter#184889)
2026-04-27 [email protected] Roll Dart SDK from de495e3de9a0 to 941ca325cfc9 (2 revisions) (flutter/flutter#185653)
2026-04-27 [email protected] [a11y] Add CONTENT_CHANGE_TYPE_EXPANDED support on android. (flutter/flutter#185305)
2026-04-27 [email protected] Roll pub packages (flutter/flutter#185641)
2026-04-27 [email protected] Modify analyze.dart to have flags to run only or exclude each verification step.  (flutter/flutter#185618)
2026-04-27 [email protected] Fix debugNeedsPaint/Layout/CompositedLayerUpdate crashing in release mode (flutter/flutter#184627)
2026-04-27 [email protected] Enable `var_with_no_type_annotation` lint. (flutter/flutter#185215)
2026-04-27 [email protected] Fix SelectionArea handles overlapping context menu on Android (flutter/flutter#182663)
2026-04-27 [email protected] Adds debugging information to compiled metal shaders (flutter/flutter#185629)
2026-04-27 [email protected] Roll pub packages (flutter/flutter#185638)
2026-04-27 [email protected] Use null-aware elements in dev/devicelab/lib/framework/browser.dart (flutter/flutter#184778)
2026-04-27 [email protected] Sync CHANGELOG.md from stable (flutter/flutter#185633)
2026-04-27 [email protected] Added useOriginalColors flag which allows ImageIcon to bypass IconTheme colorization and use the original colors (flutter/flutter#180491)
2026-04-27 [email protected] Roll Packages from 8400f71 to 23280da (2 revisions) (flutter/flutter#185619)
2026-04-27 [email protected] Roll Skia from f1238e0f1022 to ce82d32b3e03 (1 revision) (flutter/flutter#185616)
2026-04-27 [email protected] [SwiftPM] Enable package resolution on xcodebuild commands (flutter/flutter#185208)
2026-04-27 [email protected] [iOS] Refactor keyboard inset logic into FlutterKeyboardInsetManager (flutter/flutter#185535)
2026-04-27 [email protected] [Win32] FlutterDesktopEngineGetGraphicsAdapter should use out parameter (flutter/flutter#185590)
2026-04-27 [email protected] Roll Skia from d77e3356d526 to f1238e0f1022 (4 revisions) (flutter/flutter#185604)
2026-04-27 [email protected] Roll Fuchsia Linux SDK from flsn8jC4LkTn6WECf... to i6d0NoDueUiXpePfX... (flutter/flutter#185601)
2026-04-26 [email protected] Roll Dart SDK from a108dfe2d227 to de495e3de9a0 (1 revision) (flutter/flutter#185599)
2026-04-26 [email protected] Roll Skia from ce9aa2231292 to d77e3356d526 (1 revision) (flutter/flutter#185596)
2026-04-26 [email protected] Roll Skia from 622fff4c24d2 to ce9aa2231292 (1 revision) (flutter/flutter#185588)
2026-04-25 [email protected] Roll Fuchsia Linux SDK from 9fPnyEo9PaNdXtasl... to flsn8jC4LkTn6WECf... (flutter/flutter#185585)
2026-04-25 [email protected] Roll Dart SDK from 605a8faf0dda to a108dfe2d227 (1 revision) (flutter/flutter#185584)
2026-04-25 [email protected] Roll Dart SDK from 6b8c39765f17 to 605a8faf0dda (1 revision) (flutter/flutter#185578)
2026-04-25 [email protected] Roll Skia from 185f6b57d64f to 622fff4c24d2 (1 revision) (flutter/flutter#185573)
2026-04-25 [email protected] Implement square-like round superellipses with circular corners in the SDF uber shader (flutter/flutter#185370)
2026-04-25 [email protected] Add @awaitNotRequired annotation to flutter sdk (flutter/flutter#181513)
2026-04-25 [email protected] Roll Dart SDK from 01228cb7af42 to 6b8c39765f17 (2 revisions) (flutter/flutter#185569)
2026-04-25 [email protected] Adapt the DisplayList benchmarks into a primitive rendering benchmark suite (flutter/flutter#185270)
2026-04-25 [email protected] Enable SPM for GoogleMobileAds (flutter/flutter#185548)
2026-04-25 [email protected] Roll Skia from 3f467a581942 to 185f6b57d64f (1 revision) (flutter/flutter#185564)
2026-04-25 [email protected] Fix Table crash when a cell child paints below the row bottom (flutter/flutter#185323)
2026-04-24 [email protected] Make sure that an Image doesn't crash in 0x0 environment (flutter/flutter#181154)
2026-04-24 [email protected] Roll Skia from 300d432048b0 to 3f467a581942 (3 revisions) (flutter/flutter#185558)
2026-04-24 [email protected] Roll Dart SDK from c26627715892 to 01228cb7af42 (4 revisions) (flutter/flutter#185559)
2026-04-24 [email protected] Reland "[web] Fix LateInitializationError in CkSurface and SkwasmSurface (#185116)" (flutter/flutter#185553)
2026-04-24 [email protected] [github]fix git ls-file glob pattern in labeler.yml instruction (flutter/flutter#185495)
2026-04-24 [email protected] [ios]update ios-reviewers tags to include more files (flutter/flutter#185490)
2026-04-24 [email protected] Add initial support for Cross-Origin Storage (flutter/flutter#184149)
2026-04-24 [email protected] tool: Skip cached engine artifacts with local engine (flutter/flutter#185546)
...
creatorpiyush pushed a commit to creatorpiyush/packages that referenced this pull request Jun 10, 2026
…lutter#11595)

Manual roll Flutter from 31001886cbe8 to 61fca76dd523 (53 revisions)

Manual roll requested by [email protected]

flutter/flutter@3100188...61fca76

2026-04-27 [email protected] Adds integration test for the FLTEnableSDFs flag for iOS (flutter/flutter#185637)
2026-04-27 [email protected] Fix sdfs being enabled for MacOS regardless of FLTEnableSDFs value (flutter/flutter#185565)
2026-04-27 [email protected] Don't use UberSDF for paint with incompatible blend modes (flutter/flutter#184889)
2026-04-27 [email protected] Roll Dart SDK from de495e3de9a0 to 941ca325cfc9 (2 revisions) (flutter/flutter#185653)
2026-04-27 [email protected] [a11y] Add CONTENT_CHANGE_TYPE_EXPANDED support on android. (flutter/flutter#185305)
2026-04-27 [email protected] Roll pub packages (flutter/flutter#185641)
2026-04-27 [email protected] Modify analyze.dart to have flags to run only or exclude each verification step.  (flutter/flutter#185618)
2026-04-27 [email protected] Fix debugNeedsPaint/Layout/CompositedLayerUpdate crashing in release mode (flutter/flutter#184627)
2026-04-27 [email protected] Enable `var_with_no_type_annotation` lint. (flutter/flutter#185215)
2026-04-27 [email protected] Fix SelectionArea handles overlapping context menu on Android (flutter/flutter#182663)
2026-04-27 [email protected] Adds debugging information to compiled metal shaders (flutter/flutter#185629)
2026-04-27 [email protected] Roll pub packages (flutter/flutter#185638)
2026-04-27 [email protected] Use null-aware elements in dev/devicelab/lib/framework/browser.dart (flutter/flutter#184778)
2026-04-27 [email protected] Sync CHANGELOG.md from stable (flutter/flutter#185633)
2026-04-27 [email protected] Added useOriginalColors flag which allows ImageIcon to bypass IconTheme colorization and use the original colors (flutter/flutter#180491)
2026-04-27 [email protected] Roll Packages from 8400f71 to 23280da (2 revisions) (flutter/flutter#185619)
2026-04-27 [email protected] Roll Skia from f1238e0f1022 to ce82d32b3e03 (1 revision) (flutter/flutter#185616)
2026-04-27 [email protected] [SwiftPM] Enable package resolution on xcodebuild commands (flutter/flutter#185208)
2026-04-27 [email protected] [iOS] Refactor keyboard inset logic into FlutterKeyboardInsetManager (flutter/flutter#185535)
2026-04-27 [email protected] [Win32] FlutterDesktopEngineGetGraphicsAdapter should use out parameter (flutter/flutter#185590)
2026-04-27 [email protected] Roll Skia from d77e3356d526 to f1238e0f1022 (4 revisions) (flutter/flutter#185604)
2026-04-27 [email protected] Roll Fuchsia Linux SDK from flsn8jC4LkTn6WECf... to i6d0NoDueUiXpePfX... (flutter/flutter#185601)
2026-04-26 [email protected] Roll Dart SDK from a108dfe2d227 to de495e3de9a0 (1 revision) (flutter/flutter#185599)
2026-04-26 [email protected] Roll Skia from ce9aa2231292 to d77e3356d526 (1 revision) (flutter/flutter#185596)
2026-04-26 [email protected] Roll Skia from 622fff4c24d2 to ce9aa2231292 (1 revision) (flutter/flutter#185588)
2026-04-25 [email protected] Roll Fuchsia Linux SDK from 9fPnyEo9PaNdXtasl... to flsn8jC4LkTn6WECf... (flutter/flutter#185585)
2026-04-25 [email protected] Roll Dart SDK from 605a8faf0dda to a108dfe2d227 (1 revision) (flutter/flutter#185584)
2026-04-25 [email protected] Roll Dart SDK from 6b8c39765f17 to 605a8faf0dda (1 revision) (flutter/flutter#185578)
2026-04-25 [email protected] Roll Skia from 185f6b57d64f to 622fff4c24d2 (1 revision) (flutter/flutter#185573)
2026-04-25 [email protected] Implement square-like round superellipses with circular corners in the SDF uber shader (flutter/flutter#185370)
2026-04-25 [email protected] Add @awaitNotRequired annotation to flutter sdk (flutter/flutter#181513)
2026-04-25 [email protected] Roll Dart SDK from 01228cb7af42 to 6b8c39765f17 (2 revisions) (flutter/flutter#185569)
2026-04-25 [email protected] Adapt the DisplayList benchmarks into a primitive rendering benchmark suite (flutter/flutter#185270)
2026-04-25 [email protected] Enable SPM for GoogleMobileAds (flutter/flutter#185548)
2026-04-25 [email protected] Roll Skia from 3f467a581942 to 185f6b57d64f (1 revision) (flutter/flutter#185564)
2026-04-25 [email protected] Fix Table crash when a cell child paints below the row bottom (flutter/flutter#185323)
2026-04-24 [email protected] Make sure that an Image doesn't crash in 0x0 environment (flutter/flutter#181154)
2026-04-24 [email protected] Roll Skia from 300d432048b0 to 3f467a581942 (3 revisions) (flutter/flutter#185558)
2026-04-24 [email protected] Roll Dart SDK from c26627715892 to 01228cb7af42 (4 revisions) (flutter/flutter#185559)
2026-04-24 [email protected] Reland "[web] Fix LateInitializationError in CkSurface and SkwasmSurface (#185116)" (flutter/flutter#185553)
2026-04-24 [email protected] [github]fix git ls-file glob pattern in labeler.yml instruction (flutter/flutter#185495)
2026-04-24 [email protected] [ios]update ios-reviewers tags to include more files (flutter/flutter#185490)
2026-04-24 [email protected] Add initial support for Cross-Origin Storage (flutter/flutter#184149)
2026-04-24 [email protected] tool: Skip cached engine artifacts with local engine (flutter/flutter#185546)
...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CICD Run CI/CD

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants