-
Notifications
You must be signed in to change notification settings - Fork 29.7k
Description
We have new ARM Mac Mini capacity available to run Mac framework tests, and I tried to turn on running the framework_tests_libraries, framework_tests_misc, and framework_tests_widgets on these new bots in #119762
However I had to revert it because, though they passed in presubmit, they failed in postsubmit with Skia gold diffs:
https://ci.chromium.org/p/flutter/builders/prod/Mac%20framework_tests_libraries/9202
https://ci.chromium.org/p/flutter/builders/prod/Mac%20framework_tests_misc/9026
https://ci.chromium.org/p/flutter/builders/prod/Mac%20framework_tests_widgets/9122
Example:
══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞════════════════════════════════════════════════════
The following SkiaException was thrown while running async test code:
Skia Gold received an unapproved image in post-submit
testing. Golden file images in flutter/flutter are triaged
in pre-submit during code review for the given PR.
Visit https://flutter-gold.skia.org// to view and approve
the image(s), or revert the associated change. For more
information, visit the wiki:
https://github.com/flutter/flutter/wiki/Writing-a-golden-file-test-for-package:flutter
Debug information for Gold --------------------------------
stdout: Given image with hash b3df9b168969c63476708476137a356d for test
animation.LiveBinding.press.animation.2
...
Untriaged or negative image:
https://flutter-gold.skia.org/detail?test=animation.LiveBinding.press.animation.2&digest=b3df9b168969c63476708476137a356d
stderr: Test: animation.LiveBinding.press.animation.2 FAIL