Skip to content

Running Mac framework_tests* on arm64 Macs flakes with "Skia Gold received an unapproved image in post-submit" #119880

@jmagman

Description

@jmagman

We have new ARM Mac Mini capacity available to run Mac framework tests, and I tried to turn on running the framework_tests_libraries, framework_tests_misc, and framework_tests_widgets on these new bots in #119762

However I had to revert it because, though they passed in presubmit, they failed in postsubmit with Skia gold diffs:
https://ci.chromium.org/p/flutter/builders/prod/Mac%20framework_tests_libraries/9202
https://ci.chromium.org/p/flutter/builders/prod/Mac%20framework_tests_misc/9026
https://ci.chromium.org/p/flutter/builders/prod/Mac%20framework_tests_widgets/9122

Example:

══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞════════════════════════════════════════════════════
The following SkiaException was thrown while running async test code:
Skia Gold received an unapproved image in post-submit
testing. Golden file images in flutter/flutter are triaged
in pre-submit during code review for the given PR.

Visit https://flutter-gold.skia.org// to view and approve
the image(s), or revert the associated change. For more
information, visit the wiki:
https://github.com/flutter/flutter/wiki/Writing-a-golden-file-test-for-package:flutter

Debug information for Gold --------------------------------
stdout: Given image with hash b3df9b168969c63476708476137a356d for test
animation.LiveBinding.press.animation.2
...
Untriaged or negative image:
https://flutter-gold.skia.org/detail?test=animation.LiveBinding.press.animation.2&digest=b3df9b168969c63476708476137a356d


stderr: Test: animation.LiveBinding.press.animation.2 FAIL

https://flutter-gold.skia.org/detail?test=animation.LiveBinding.press.animation.2&digest=b3df9b168969c63476708476137a356d

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issues not at the top of the work listc: contributor-productivityTeam-specific productivity, code health, technical debt.frameworkflutter/packages/flutter repository. See also f: labels.team-frameworkOwned by Framework teamtriaged-frameworkTriaged by Framework team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions