Skip to content

Linux_android_emu_vulkan_stable android_engine_vulkan_tests is 2.04% flaky #185070

Closed

Activity

  1. added
    P0Critical issues such as a build break or regression
    c: flakeTests that sometimes, but not always, incorrectly pass
    on Apr 15, 2026
  2. gmackall commented on Apr 15, 2026

    @gmackall
    Member

    It seems like there is some issue with the texture widget/tlhc, which are the elements being used by the failing tests. They seem to fail with a common problem, where instead of the content that is intended to be displayed we are seeing an entirely black box. The set of tests:

    external_texture_surface_texture_smiley_face
    external_texture_surface_producer_smiley_face
    platform_view_tap_color_change_initial
    fluttered_rendered_blue_rectangle
    texture_layer_hybrid_composition_platform_view
    

    Perhaps we should consider splitting the hcpp tests to their own ci.yaml target so they aren't impacted by the flakiness of the other modes. I don't have any immediate suggestions to fix the flakiness of these tests, it seems like there is a genuine problem there being exposed by the test failures.

  3. fluttergithubbot commented on May 6, 2026

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2026-04-29 and 2026-05-05 is 0.00%. Flaky number: 0; total number: 99.

  4. Piinks commented on May 11, 2026

    @Piinks
    Contributor

    Looks like this is improving, waiting this Wednesday's report.

  5. Piinks commented on Jun 1, 2026

    @Piinks
    Contributor

    I am going to mark this suppressed on the dashboard for now.

  6. 30 remaining items

  7. Piinks commented on Sep 21, 2026

    @Piinks
    Contributor

    PR landed last week, let's see what the bot says this week.

  8. added
    P1High-priority issues at the top of the work list
    and removed
    P0Critical issues such as a build break or regression
    on Sep 29, 2026
  9. fluttergithubbot commented on Sep 30, 2026

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2026-09-23 and 2026-09-29 is 6.06%. Flaky number: 6; total number: 99.
    One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4596
    Commit: 6363ecb
    Flaky builds:
    https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4596
    https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4578
    https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4564
    https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4536
    https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4527
    https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests/4500

    Recent test runs:
    https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux_android_emu_vulkan_stable%20android_engine_vulkan_tests

  10. added
    P0Critical issues such as a build break or regression
    and removed
    P1High-priority issues at the top of the work list
    on Sep 30, 2026
  11. Piinks commented on Oct 1, 2026

    @Piinks
    Contributor

    Looks like this is still pretty flaky.

  12. Piinks commented on Oct 19, 2026

    @Piinks
    Contributor

    @gmackall do we have any sense about the root cause here? This has been a P0 off and on due to flakes since April. :(

  13. gmackall commented on Oct 19, 2026

    @gmackall
    Member

    There have been a couple of unrelated issues that have contributed, but the main unchanging issue seems to be that the vulkan emulators we are using are not in fact stable. 15/18 of the last failures have been the underlying vulkan emulator crashing/disconnecting, which does not ever happen when running the same harness in the same way on the OpenGLES emulators. Unfortunately the cipd bundle we depend on is owned by Chrome, not us, and when we last looked in to upgrading the newer versions were unfortunately fully broken for our case, so

    1. the current version is unstable
    2. the newer versions don't work at all
    3. we don't own the package in the first place

    I can try to see if any of this has changed though (and if we are unblocked from upgrading) because it has been a while

  14. gmackall commented on Oct 22, 2026

    @gmackall
    Member

    This should hopefully be helped by #194887, which finally upgrades us to newer vulkan emulators which should hopefully stop crashing so much

  15. gmackall commented on Nov 3, 2026

    @gmackall
    Member

    Hmm crashing reduced but continued, but there is more space to upgrade if we go to 36. Perhaps crashes are fixed on newest
    #195856

  16. gmackall commented on Nov 9, 2026

    @gmackall
    Member

    Hmm crashing reduced but continued, but there is more space to upgrade if we go to 36. Perhaps crashes are fixed on newest #195856

    No flakes since this landed AFAICT, can monitor for one more week

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P0Critical issues such as a build break or regressionc: flakeTests that sometimes, but not always, incorrectly passteam-androidOwned by Android platform team

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions