Skip to content

Conversation

@fluttergithubbot
Copy link
Contributor

The test has been passing for 50 consecutive runs.
This test can be marked as unflaky.

@flutter-dashboard flutter-dashboard bot added c: flake Tests that sometimes, but not always, incorrectly pass c: tech-debt Technical debt, code quality, testing, etc. labels Jan 22, 2025
@github-actions github-actions bot removed the c: tech-debt Technical debt, code quality, testing, etc. label Jan 22, 2025
@harri35
Copy link
Contributor

harri35 commented Feb 26, 2025

@jtmcdole
Copy link
Member

@jtmcdole I guess based on #153828 comments and the recent logs from staging https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_mokey%20microbenchmarks?limit=200, this can be merged?

It could be merged, but it could go flakey again in the future due to the random seed.

  1. I could revive my efforts to make these on-demand when launched. I was able to get Android working, but I was stuck with iOS
  2. We could remove the random seed.
  3. Roll the dice.

@harri35
Copy link
Contributor

harri35 commented Mar 5, 2025

@jtmcdole Sorry, my mistake, I was looking at a wrong issue.

Based on Git history of:

flutter/.ci.yaml

Lines 4655 to 4660 in e4c726a

# mac mokey benchmark
- name: Mac_mokey microbenchmarks
recipe: devicelab/devicelab_drone
presubmit: false
bringup: true # Flaky: codefu
timeout: 60

this is the last relevant discussion: #161550 The problem is indeed not fixed. I propose we close this PR without merging.

Note: I was unable to find either a followup issue for #161550 or the bug issue to get benchmarks restartable. Can you point me to it/them? Would be good to link it from here and/or from the YAML, then these PRs bringup=false can be easily dealt with in the future until the issue is fixed :)

Thanks!

@jtmcdole
Copy link
Member

jtmcdole commented Mar 5, 2025

#156506 should be the issue tracking this. I've just been focused on infra and monorepo.

@harri35
Copy link
Contributor

harri35 commented Mar 6, 2025

Cool, I'll close this PR; no point in reenabling it at this stage.
I created a PR to add the issue id for easier discovery in the future: #164694
Thanks!

@harri35 harri35 closed this Mar 6, 2025
github-merge-queue bot pushed a commit that referenced this pull request Mar 12, 2025
…i config for easier discovery (#164694)

Update the comment in .ci.yaml with the issue link for easier discovery.
Related issue: #156506
Related discussion: #162000

## Pre-launch Checklist

- [x] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [x] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [x] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [x] I signed the [CLA].
- [x] I listed at least one issue that this PR fixes in the description
above.
- [x] I updated/added relevant documentation (doc comments with `///`).
- [x] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [x] I followed the [breaking change policy] and added [Data Driven
Fixes] where supported.
- [x] All existing and new tests are passing.
romanejaquez pushed a commit to romanejaquez/flutter that referenced this pull request Aug 14, 2025
…i config for easier discovery (flutter#164694)

Update the comment in .ci.yaml with the issue link for easier discovery.
Related issue: flutter#156506
Related discussion: flutter#162000

## Pre-launch Checklist

- [x] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [x] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [x] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [x] I signed the [CLA].
- [x] I listed at least one issue that this PR fixes in the description
above.
- [x] I updated/added relevant documentation (doc comments with `///`).
- [x] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [x] I followed the [breaking change policy] and added [Data Driven
Fixes] where supported.
- [x] All existing and new tests are passing.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

c: flake Tests that sometimes, but not always, incorrectly pass

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants