Mac Host Engine is 24% flaky on step test: Host Tests for host_release #106589
Description
There are 24 post-submit flakes in recent 100 runs.
Example flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20Host%20Engine/16571/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20Host%20Engine/16570/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20Host%20Engine/16567/overview
Error logs:
[223/224] EmbedderTest.CanInvokeCustomEntrypoint (142 ms)
[224/224] EmbedderA11yTest.A11yTreeIsConsistent (120170 ms)
[INFO:test_timeout_listener.cc(76)] Test timeout of 120 seconds per test case will be enforced.
�[0;33mNote: Google Test filter = EmbedderA11yTest.A11yTreeIsConsistent
�[m�[0;32m[==========] �[mRunning 1 test from 1 test suite.
�[0;32m[----------] �[mGlobal test environment set-up.
�[0;32m[----------] �[m1 test from EmbedderA11yTest
�[0;32m[ RUN ] �[mEmbedderA11yTest.A11yTreeIsConsistent
[FATAL:flutter/testing/test_timeout_listener.cc(45)] Check failed: delay < timeout_. Test EmbedderA11yTest.A11yTreeIsConsistent did not complete in 120 seconds and is assumed to be hung. Killing the test harness.
[ERROR:flutter/fml/backtrace.cc(116)] Caught signal SIGABRT during program execution.
Frame 0: 0x7ff81e629d10 abort
Frame 1: 0x107a5e169 fml::KillProcess()
Frame 2: 0x107a5e14c fml::LogMessage::~LogMessage()
Frame 3: 0x10781d244 flutter::testing::PendingTests::CheckTimedOutTests()
Frame 4: 0x10781d0c0 std::__1::__function::__func<>::operator()()
Frame 5: 0x107a5febe fml::MessageLoopImpl::FlushTasks()
Frame 6: 0x107a68b9c fml::MessageLoopDarwin::OnTimerFire()
Frame 7: 0x7ff81e7bd84f __CFRUNLOOP_IS_CALLING_OUT_TO_A_TIMER_CALLBACK_FUNCTION__
Frame 8: 0x7ff81e7bd33e __CFRunLoopDoTimer
Frame 9: 0x7ff81e7bce9d __CFRunLoopDoTimers
Frame 10: 0x7ff81e7a345f __CFRunLoopRun
Frame 11: 0x7ff81e7a25dd CFRunLoopRunSpecific
Frame 12: 0x107a68e0e fml::MessageLoopDarwin::Run()
Frame 13: 0x107a5fcd4 fml::MessageLoopImpl::DoRun()
Frame 14: 0x107a67272 std::__1::__thread_proxy<>()
Frame 15: 0x7ff81e6dd4f4 _pthread_start
Frame 16: 0x7ff81e6d900f thread_start
[224/224] EmbedderA11yTest.A11yTreeIsConsistent returned/aborted with exit code -6 (120170 ms)
FAILED TESTS (1/224):
120170 ms: /opt/s/w/ir/cache/builder/src/out/host_release/embedder_unittests EmbedderA11yTest.A11yTreeIsConsistent (try #2)
SUMMARY:
/opt/s/w/ir/cache/builder/src/out/host_release/embedder_unittests EmbedderA11yTest.A11yTreeIsConsistent passed 1 / 2 times.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Failed Command:
python3 /opt/s/w/ir/cache/builder/src/third_party/gtest-parallel/gtest-parallel /opt/s/w/ir/cache/builder/src/out/host_release/embedder_unittests --repeat=2
Exit Code: 250
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Traceback (most recent call last):
File "/opt/s/w/ir/cache/builder/src/flutter/testing/run_tests.py", line 1071, in <module>
sys.exit(main())
File "/opt/s/w/ir/cache/builder/src/flutter/testing/run_tests.py", line 1021, in main
build_dir, engine_filter, args.coverage, args.engine_capture_core_dump
File "/opt/s/w/ir/cache/builder/src/flutter/testing/run_tests.py", line 397, in RunCCTests
gtest=True
File "/opt/s/w/ir/cache/builder/src/flutter/testing/run_tests.py", line 225, in RunEngineExecutable
env=env
File "/opt/s/w/ir/cache/builder/src/flutter/testing/run_tests.py", line 80, in RunCmd
(command_string, process.returncode)
Exception: Command "python3 /opt/s/w/ir/cache/builder/src/third_party/gtest-parallel/gtest-parallel /opt/s/w/ir/cache/builder/src/out/host_release/embedder_unittests --repeat=2" exited with code 250.