Skip to content

Fix Reducing-Test-Flakiness.md: promoting a test to prod removes bringup - #192983

Merged
auto-submit[bot] merged 2 commits into
flutter:masterfrom
okorohelijah:docs/fix-flakiness-bringup-promotion
Sep 24, 2026
Merged

auto-submit[bot] merged 2 commits into
flutter:masterfrom
okorohelijah:docs/fix-flakiness-bringup-promotion

Conversation

@okorohelijah

Copy link
Copy Markdown
Contributor

docs/infra/Reducing-Test-Flakiness.md describes the process for adding a new DeviceLab test: enable it in the staging pool with bringup: true, monitor it, then promote it to prod. The final bullet of that list said:

  • Switch bringup to true.

That is the state the target is already in while it is in staging. Promoting a target to prod (tree-blocking, runs in presubmit) means removing bringup: true (or setting it to false). This is what the same document already says further down ("remove the bringup: true entry for that target"), what docs/infra/Adding-a-new-Test-Shard.md says, and what the authoritative schema doc in flutter/cocoon says:

bringup: Whether this target is under active development and should not block the tree. If true, will not run in presubmit and will not block postsubmit.
— https://github.com/flutter/cocoon/blob/main/CI_YAML.md

This PR fixes the single wrong bullet and links to the "Adding new targets" section of CI_YAML.md (the same anchor Adding-a-new-Test-Shard.md already uses).

Docs-only change; no behavior or code is affected. No issue is listed as this fixes a trivial (one-line) documentation error, per the template guidance.

Pre-launch Checklist

  • I read the Contributor Guide and followed the process outlined there for submitting PRs.
  • I read the AI contribution guidelines and understand my responsibilities, or I am not using AI tools.
  • I read the Tree Hygiene wiki page, which explains my responsibilities.
  • I read and followed the Flutter Style Guide, including Features we expect every widget to implement.
  • I signed the CLA.
  • I listed at least one issue that this PR fixes in the description above. (Not required: trivial docs fix, per the template.)
  • I updated/added relevant in-code documentation (doc comments with ///). (N/A — markdown docs only.)
  • If this PR introduces a new feature or capability, I created and linked a website documentation issue or PR in flutter/website (or verified none is needed). (N/A — no new feature.)
  • I added new tests to check the change I am making, or this PR is test-exempt. (Test-exempt: documentation-only change.)
  • I followed the breaking change policy and added Data Driven Fixes where supported. (N/A — no breaking change.)
  • All existing and new tests are passing. (No tests affected.)

The "enable the test in the prod env" step told readers to "Switch
`bringup` to `true`", which is the state the test is already in while
in the staging pool. Promoting a target to prod (tree-blocking,
presubmit-enabled) means removing `bringup: true` (or setting it to
`false`), as described further down in this same document and in
flutter/cocoon's CI_YAML.md.
@github-actions github-actions Bot added team-infra Owned by Infrastructure team d: docs/ flutter/flutter/docs, for contributors labels Sep 18, 2026
@okorohelijah
okorohelijah marked this pull request as ready for review September 18, 2026 16:42

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the documentation in docs/infra/Reducing-Test-Flakiness.md to clarify how to enable a test in the production environment by removing bringup: true or setting it to false in .ci.yaml, referencing CI_YAML.md. There are no review comments, and I have no feedback to provide.

@okorohelijah okorohelijah added autosubmit Merge PR when tree becomes green via auto submit App CICD Run CI/CD labels Sep 23, 2026
@auto-submit auto-submit Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Sep 24, 2026
@auto-submit

auto-submit Bot commented Sep 24, 2026

Copy link
Copy Markdown
Contributor

autosubmit label was removed for flutter/flutter/192983, because - The status or check suite ci.yaml validation has failed. Please fix the issues identified (or deflake) before re-applying this label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CICD Run CI/CD d: docs/ flutter/flutter/docs, for contributors team-infra Owned by Infrastructure team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants