Prerequisites

• Upgrade 1 arm64 and 1 x86 chromium staging bots to macOS 14.5 #148860

Instructions

Update to latest depot_tools by running gclient:

For each macOS engine test, you have to run the sub-builds individually. Using test/orchestrator Linux linux_web_engine as an example:

1. Open https://ci.chromium.org/ui/p/flutter/builders/luci.flutter.prod/Linux%20linux_web_engine
2. Click the top build
3. Ensure build is for main branch (Under the Infra tab, check git_branch under "Input Properties" section)
4. Check what sub-builds use macOS
   • https://github.com/flutter/engine/blob/main/ci/builders/linux_web_engine.json
   • Search for os=Mac
5. Copy sub-build BuildbucketID
   
6. Run led get-build "[insert BuildbucketID]" > properties.json
7. Replace the following in the properties.json:
   • "bucket": "prod.shadow", -> "bucket": "staging.shadow",
   • "shadowed_bucket": "prod" -> "shadowed_bucket": "staging"
   • "service_account": "flutter-prod-builder@chops-service-accounts.iam.gserviceaccount.com" -> "service_account": "flutter-staging-builder@chops-service-accounts.iam.gserviceaccount.com"
   • "value": "luci.flutter.prod" -> "value": "luci.flutter.staging"
8. Run cat properties.json | led edit-recipes-bundle | led launch

❗ File issues for tests that fail and add links to the issues in #148882. This is important so we can track any fixes that need to be cherrypicked to beta/stable and so steps that are steps are not completed before issues are resolved.