Skip to content

Engine test PlatformViewMutationClipRectAfterMovedTests testPlatformView failing in CI on macOS 13 #137547

@vashworth

Description

@vashworth
Test Case '-[PlatformViewMutationClipRectAfterMovedTests testPlatformView]' started.
    t =     0.00s Start Test at 2023-10-29 19:45:18.660
    t =     0.00s Set Up
    t =     0.00s     Open dev.flutter.Scenarios
    t =     0.00s         Launch dev.flutter.Scenarios
    t =     0.00s             Terminate dev.flutter.Scenarios:32972
    t =     1.24s             Setting up automation session
    t =     1.51s             Wait for dev.flutter.Scenarios to idle
    t =     2.57s Waiting 30.0s for "platform_view[10000]" Other to exist
    t =     3.61s     Checking `Expect predicate `exists == 1` for object "platform_view[10000]" Other`
    t =     3.61s         Checking existence of `"platform_view[10000]" Other`
    t =     3.67s Waiting 30.0s for TextView to exist
    t =     4.72s     Checking `Expect predicate `exists == 1` for object TextView`
    t =     4.73s         Checking existence of `TextView`
2023-10-29 19:45:23.464005-0700 ScenariosUITests-Runner[32882:184235] GOLDEN DIFF FAILED: image diff greater than threshold. Current diff: 11.53593182792057, threshold: 0.5
    t =     4.83s Added attachment named 'golden_platform_view_cliprect_after_moved_iPhone SE (3rd generation)_16.2_simulator_actual.png'
/Volumes/Work/s/w/ir/cache/builder/src/out/ios_debug_sim_arm64_extension_safe/scenario_app/Scenarios/ScenariosUITests/GoldenTestManager.m:103: error: -[PlatformViewMutationClipRectAfterMovedTests testPlatformView] : failed - Goldens do not match. Follow the steps in the README to update golden named golden_platform_view_cliprect_after_moved_iPhone SE (3rd generation)_16.2_simulator if needed.
    t =     4.90s Tear Down
Test Case '-[PlatformViewMutationClipRectAfterMovedTests testPlatformView]' failed (5.102 seconds).
Test Suite 'PlatformViewMutationClipRectAfterMovedTests' failed at 2023-10-29 19:45:23.762.

It seems to only fail sometimes on ios_debug_sim_arm64_extension_safe and ios_debug_sim_arm64

ios_debug_sim_arm64_extension_safe
passing:
https://ci.chromium.org/ui/p/flutter/builders/try.shadow/Mac%20Engine%20Drone/10946/overview
https://ci.chromium.org/ui/p/flutter/builders/try.shadow/Mac%20Engine%20Drone/10958/overview (failed the first time, passed the second)
failing:
https://ci.chromium.org/ui/p/flutter/builders/try/Mac%20Engine%20Drone/480262/overview

ios_debug_sim_arm64
failing:
https://ci.chromium.org/ui/p/flutter/builders/try.shadow/Mac%20Engine%20Drone/10957/overview
https://ci.chromium.org/ui/p/flutter/builders/try.shadow/Mac%20Engine%20Drone/10945/overview
https://ci.chromium.org/ui/p/flutter/builders/try/Mac%20Engine%20Drone/480261/overview (ignore cancellation, if you look at the stdout of step 29, you'll see test failed)

Metadata

Metadata

Assignees

Labels

P1High-priority issues at the top of the work listengineflutter/engine related. See also e: labels.platform-iosiOS applications specificallyteam-iosOwned by iOS platform team

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions