Skip to content

Linux_android_emu_vulkan_stable android_hardware_smoke_vulkan_instrumented_tests is 3.03% flaky #193205

Closed

Description

@fluttergithubbot

The post-submit test builder Linux_android_emu_vulkan_stable android_hardware_smoke_vulkan_instrumented_tests had a flaky ratio 3.03% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_hardware_smoke_vulkan_instrumented_tests/240
Commit: e847cfe

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_hardware_smoke_vulkan_instrumented_tests/240
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_hardware_smoke_vulkan_instrumented_tests/231
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android_emu_vulkan_stable%20android_hardware_smoke_vulkan_instrumented_tests/221

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux_android_emu_vulkan_stable%20android_hardware_smoke_vulkan_instrumented_tests

Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Activity

  1. added
    P0Critical issues such as a build break or regression
    c: flakeTests that sometimes, but not always, incorrectly pass
    on Sep 23, 2026
  2. andywolff commented on Oct 5, 2026

    @andywolff
    Contributor

    Oh interesting. Unlike #193557, this is a different failure case: Only one test case failed, backdropFilterBlurTest. I fixed the same issue in google3, I just need to upstream my fix. It's a synchronization problem. If a platform view test case comes before a non platform view test case, the latter can take its screenshot before composition completes, resulting in a blank image. There's some additional synchronization to be added. I'll make a PR

  3. fluttergithubbot commented on Oct 7, 2026

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2026-09-30 and 2026-10-06 is 0.00%. Flaky number: 0; total number: 99.

  4. added
    P1High-priority issues at the top of the work list
    and removed
    P0Critical issues such as a build break or regression
    on Oct 12, 2026
  5. gaaclarke commented on Oct 12, 2026

    @gaaclarke
    Member

    moving to p1 since the tests are suppresed

  6. andywolff commented on Nov 11, 2026

    @andywolff
    Contributor

    I've unsuppressed this after landing #195708, please open a new issue if we see further flakiness

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P1High-priority issues at the top of the work listc: flakeTests that sometimes, but not always, incorrectly passteam-engineOwned by Engine teamtriaged-engineTriaged by Engine team

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions