Skip to content

Golden file testing for flutter/flutter is unreliable #141880

@Piinks

Description

@Piinks

#140101 introduced a regression that causes failures at head to not break the tree.
Because of this, there is no enforcement of approved/unapproved images right now for flutter/flutter.

The revert is currently blocked.

Until resolved, contributors should consider refraining from introducing image changes. If necessary, i.e. from an engine roll, please check https://flutter-gold.skia.org/ after the change lands to ensure any new images or updated images are properly approved. Otherwise changes may cascade down to other PRs looking for approval.

We do have a safety net of sorts against regressions due to extensive golden file testing inside of Google, which is executed when Flutter rolls into Google.

Metadata

Metadata

Assignees

Labels

P0Critical issues such as a build break or regressiona: tests"flutter test", flutter_test, or one of our testsc: contributor-productivityTeam-specific productivity, code health, technical debt.fyi-designFor the attention of Design Languages teamfyi-engineFor the attention of Engine teamfyi-infraFor the attention of Infrastructure teamfyi-webFor the attention of Web platform teamteam-frameworkOwned by Framework teamtriaged-frameworkTriaged by Framework team

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions